# All Questions

9,244 questions
Filter by
Sorted by
Tagged with
38 views

### MCTS: What if all children of a node are terminal?

If all children Nodes of the selected node are terminal in the selection phase - you obviously run into a problem. So how do I prevent a Node to be selected that only has terminal children?
33 views

### Are monotonically increasing functions easier to learn?

A monotonically increasing function is a function that as x gets bigger so does its output. So, if plotted, it will never go down. Although the outputs might stay constant. Logically this seems like ...
62 views

### What is $\nabla_{\theta_{k-1}} \theta_{k}$ in the context of MAML?

I am attempting to fully understand the explicit derivation and computation of the Hessian and how it is used in MAML. I came across this blog: https://lilianweng.github.io/lil-log/2018/11/30/meta-...
100 views

### How to extract parameters from a text using AI/NLP

lets say I have three texts: "make a heading that says hello word" "make a heading of hello world" "create heading consist of hello world" How can I fetch those groups ...
82 views

### Offline/Batch Reinforcement Learning: when to stop training and what agent to select

Context: My team and I are working on a RL problem for a specific application. We have data collected from user interactions (states, actions, rewards, etc.). It is too costly for us to emulate agents....
29 views

### Why does batch norm standardize with sample mean/variance, when it also learns parameters to scale the mean/variance?

Batch norm is a normalizing layer that is shown to help deep networks learn faster and with higher generalization accuracy. It normalizes the activations of the previous layer to a mean $\beta$ and ...
166 views

### What are the advantages of RL with actor-critic methods over actor-only methods?

In general, what are the advantages of RL with actor-critic methods over actor-only (or policy-based) methods? This is not a comparison with the Q-learning series, but probably a method of learning ...
28 views

### ML method for detecting which individuals are best predicted by the features

Broad question to help in finding an appropriate method. So I have a given feature set of (DNA/genetic) predictors and a group of individuals which are either cases or controls for diseaseX. While I ...
16 views

### how to define objective function using linear programming for university timetabling problem?

I have been trying a lot define an objective function using linear programming for time scheduling problem. Our problem is allocation of classes to time and all the courses that student. I have a set ...
30 views

### Graph Neural Networks: Quesitons about different GCN Architectures

This might be moreof a question about nested function classes: For k class node classification in a graph with n nodes, and d feature vector. I want to compare Architecture I: the GCN model of Kipf/ ...
16 views

### How can an “architectural motif” be extracted from a trained MLP?

I am trying to reproduce the paper Synthetic Petri Dish: A novel surrogate model for Rapid Architecture Search. In the paper, the authors try to reduce the architecture of an MLP model trained on ...
32 views

### variational auto encoder loss goes down but does not reconstruct input. out of debugging ideas

My variational autoencoder seems to work for MNIST, but fails on slightly "harder" data. By "fails" I mean there are at least two apparent problems: Very poor reconstruction, for ...
58 views

### What place do Agent Communications Language have in Multi-Agent Systems nowadays?

I am currently working on implementing a Multi-Agent System for Smart Grids. There's a lot of literature for that and some things confuse me. I have read that there is FIPA, which aimed to create a ...
32 views

### What is the definition of pre-training?

I want to pre-train a model (combined by two popular modules A and B, and both are large blocks), then fine-tune it on downstream tasks. What if for the weight initialization for pre-training, module ...
47 views

### What is the smoothness assumption in SVMs?

In this research paper, we have the following claim the smoothness assumption that underlies many kernel methods such as Support Vector Machines (SVMs) does not hold for deep neural networks trained ...
43 views

### Is a team of ML scientists an “intelligent agent”?

I am writing about the role of machine learning scientists in developing a solution. Is there a term for the humans who do learning? Can we call a "team of machine learning scientists with their ...
59 views

### How can I use Monte Carlo Dropout in a pre-trained CNN model?

In Monte Carlo Dropout (MCD), I know that I should enable dropout during training and testing, then get multiple predictions for the same input $x$ by performing multiple forward passes with $x$, then,...
18 views

### Neural Network trains towards 1 despite target

So I'm trying to make my first neural network and have just finished my back propagation functions. I got the algebra from brilliant and thought I'd understood it, but my bug proves otherwise. The bug ...
57 views

### In few-shot classification, should I use my custom dataset as the validation dataset and mini-ImageNet as the training dataset?

I am new to few-shot learning, and I wanted to get a hands-on understanding of it, using Reptile algorithm, applied to my custom dataset. My custom dataset has 30 categories, with 5 images per ...
63 views

### VAE giving near zero output when latent space dimension is large

I'm training a VAE to reconstruct some input (channels picked up by some MIMO BS for context) and I ran an experiment on the training set to see how the performance improves with the latent space ...
37 views

### How and why do state-of-the-art models in medical segmentation differ from general segmentation models?

I am just getting into medical image segmentation and have been able to understand the state-of-the-art architectures, like Double UNet, UNet++, and Multiresunet. What I haven't understood yet: Why ...
161 views

### Is it really possible to create the “Perfect Cylinder” used in Universal Approximation Theorem for 1-hidden layer Neural Network?

There are proofs for the universal approximation theorem with just 1 hidden layer. The proof goes like this: Create a "bump" function using 2 neurons. Create (infinitely) many of these ...
26 views

### Which AI technique should I use for (key)point detection (in an image of a plantar pressure)?

I am relatively new to the field of AI. I have a problem that I would like to solve with AI, but I don't know which buzzwords I should use to search for solutions. I have a plantar pressure scan, like ...
16 views

### Is parameter sharing in AlBERT akin to repeated application of same function on input?

I read the AlBERT and saw that its architecture used "Parameter Sharing" among layers of the encoder. They mentioned that this was done to save model space, make fewer training parameters ...
20 views

### What's the best machine learning algorithm / neural network architecture to use for a task that maps between images and textual descriptions of them?

Title says it all really. I want to train a network to take images of diagrams and produce a standard textual definition of them. What ML architecture is best for this?
29 views

### In the Binary Flower Pollination Algorithm (using the sigmoid function), is it possible that no feature is selected?

I'm trying to use the Binary Flower Pollination Algorithm (BFPA) for feature selection. In the BFPA, the sigmoid function is used to compute a binary vector that represents whether a feature is ...
62 views

### Is my reward function non-Markovian?

I am working on an RL problem where the time when the agent obtains the reward for taking action $a$ in time step $t$ is stochastic. In fact, there is no immediate reward for taking action $a$ in time ...
32 views

### Multivariate time-series classification with many variables

I am attempting to use time-series classification algorithms for fraud detection applications. I have came across several works in the literature that propose novel techniques for multivariate time-...
314 views

### Why does regular Q-learning (and DQN) overestimate the Q values?

The motivation for the introduction of double DQN (and double Q-learning) is that the regular Q-learning (or DQN) can overestimate the Q value, but is there a brief explanation as to why it is ...
53 views

### How can I find words in a string that are related to a given word, then associate a sentiment to that found word?

I came up with an NLP-related problem where I have a list of words and a string. My goal is to find any word in the list of words that is related to the given string. Here is an example. Suppose a ...
20 views

### Can DQN outperform DoubleDQN?

I found a similar post about this issue, but unfortunately I did not find a proper answer. Are there any references where DQN is better than DoubleDQN, that is DoubleDQN does not improve DQN ?
70 views

### What algorithm would you advise me to use for my task?

I have an image and a mask. I want the image to be the same, but rotated, scaled and positioned like mask. What can I use?
7 views

### How to classify “composite” gestures from “primitive” gestures (with IMU data)

I'm exploring this idea: I record IMU data for "primitive" gestures (up-down, left-right, diagonal, circle...) I train a classifier to classify them (on my dataset, RandomForest achieves &...
68 views

### What does the parameter $y$ stand for in function $g(y,\mu,\sigma)$ related to REINFORCE algorithm?

I am wondering what the parameter $y$ in the function $g(y,\mu,\sigma)=\frac{1}{(2\pi)^{1/2}\sigma}e^{-(y-\mu)^{2/2\sigma^2}}$ stands for in Section 6 (page 14) of the paper introducing the REINFORCE ...