# All Questions

3,537 questions
8 views

### Can an OpenAI Gym Action be any object?

The gym core file simply defines action as in step(action) as an "object". I've searched for an Action object in the code without success. Can it be any python ...
8 views

### Understanding Hebb network

Can anyone help me in understanding Hebb networking and how different function like AND, OR used to solve by this network. I couldn’t understand properly through the google.
20 views

### CNN Translation invariant or translation equivariant?

I am trying to understand this post, but get confused by the definitions and the differences. Not sure what's definition of equivariant? If I remove all the pooling layers from CNN it will make the ...
9 views

### How to properly optimize shared network between actor and critic?

I'm building an actor-critic reinforcment learning algorithm to solve environments. I want to use a single encoder to find representation of my environment. When I share the encoder with the actor ...
22 views

### Picking a random move in exploitation in Q-Learning

I've been unsure about a principle of Q-Learning, I was hoping someone could clear it up. When a new state is encountered, and thus there are no existing Q values, and that the algorithm decides to ...
21 views

### Understanding Constraint Search

What is the goal of a constraint solver? How are constraints propagated in a constraint satisfaction search? Any references are also appreciated.
19 views

### I have a million records of duty trades between two users, need to figure out which ML to use [migrated]

I have a million records of duty trades between two users. One user drops a duty, and other user will pick it up if he/she likes it (There are 50k users in total) and anybody could pick it up, in 20 ...
11 views

### Point Cloud Alignment using a Neural Network?

Having two point clouds, the second being a transformation of the first, how could I utilize a neural network in order to solve the pose (transformation in terms of x, y, z, rx, ry, rz) of the second ...
26 views

### In Artificial Intelligence, what are semantic analyses used for?

Semantics means the meaning and interpretation of words, signs, and sentence structure. Semantics largely determine our reading comprehension, how we understand others, and even what decisions we make ...
27 views

### $\epsilon$-greedy policies for huge state space

I'm currently building an agent that learns to play Kalah through reinforcement learning. I've gotten quite far along. With an $\epsilon$ of 0, meaning no exploration and only exploitation, it is able ...
19 views

### Unsupervised LSTM

I have a big amount of light curves (image below) and I am trying to label the points as signal or background (the signal appears usually periodically, several times, for a given light curve). However,...
27 views

### How to stop DQN Q function from increasing during learning?

Following the DQN algorithm with experience replay: We calculate the $loss=(Q(s,a)-(r+Q(s+1,a)))^2$. Assume I have positive but changing rewards. Meaning, $r>0$. Thus, since the rewards are ...
28 views

### How does a PDDL-Solver find a solution for a given problem?

As far as I know: In PDDL an environment is designed as well as the initial state described. When we describe the target state the solver creates some sort of a graph. How is the graph built and what ...
21 views

### Alphazero policy head loss not decreasing

I am now working on training an alphazero player for a board game. The implementation of board game is mine, MCTS for alphazero was taken elsewhere. Due to complexity of the game, it takes a much ...
11 views

### How to combine features with different temporal scale in machine learning

We have various types of data features with different temporal scale. For example, some of them describe the state per second while others may describe the state per day or per month from another ...
27 views

### Does reinforcing correct predictions increase model accuracy further?

Let's say I've trained a CNN that is predicting/inferring live samples that it hasn't seen before. In the event the network makes a correct prediction, would including this as a new sample in its ...
23 views

### What are some examples of tasks in which, currently, neuroevolution outperforms gradient-based approaches?

Note: I am NOT asking for general advantages of neuroevolution over standard approaches (e.g.: architecture search, parallelization), I am asking for examples of tasks in which, currently, ...
52 views

### How is local minima possible in gradient descent?

Gradient descent works on the equation of mean squared error, which is an equation of a parabola $y=x^2$. We often say that weight adjustment in a neural network by gradient descent algorithm can hit ...
11 views

### Edge AI device to run inference

I'm trying to figure out what's the best way to get a trained model that does facial detection to run on a camera that's connected to a computer and perform inference. Since I don't need the device ...
61 views

### What is an artificial neural network?

What is an artificial neural network in artificial intelligence? It is apparently used to find patterns in data and it is loosely inspired by human neural networks.
10 views

### Simple weakly supervised Object localizetion using keras. How to visualize the results?

I am following this link : Weakly-supervised-object-localization to create heatmap of the region in an image where the CNN looks to identify the class. As per the above mentioned repository , ...
22 views

### Binary vector expected value

Raul Rojas' Neural Networks A Systematic Introduction, section 8.2.1 calculates the variance of the output of a hidden neuron. Raul Rojas says that "for binary vectors we have $E[x_i^2] = \frac{1}{3}$...
18 views

### Why the loss is nan by using linear activation function in the last layer? [migrated]

I want to use neural network to solve a simple regression problem, and I try to program by myself accroding to lecture Backpropagation and Neural Networks . However, I meet loss divergence problem. ...
25 views

### Does changing the order of the convolution layers in a CNN have any impact?

Could changing the order of convolution layers in a CNN improve accuracy or training time?
26 views

### Is there any example of using Q-learning with big data?

Could we even use reinforcement learning with big datasets? Or in RL does the agent built its own dataset ?
23 views

### Use Image data from Drive to Colab for Image Augmentation

I am working on CNN. I have saved images in drive to do image augmentation in keras, I have used method (.flow_from_directory(directory)) Since it require directory path. I have mounted drive and give ...
17 views

### How to integrate Microsoft chatbot with wechat [on hold]

How to integrate Microsoft chatbot with wechat. I have developed my chatbot using nodejs with bot framework version 4. My bot development is completed and it is published to Azure. Now i got ...
32 views

### Difficulty in balancing Pendulum using Deep Reinforcement Learning Algorithm

I am using OpenAI Gym framework for reinforcement learning where I am trying solve classic control problem of balancing an Inverted Pendulum, which is similar to the "Pendulum-v0" with some changes in ...
11 views

### Benefits in using multiple LSTM layers?

I am working on a time series forecasting problem and I am in the process of choosing the optimum network structure. Currently I have a 200 cell LSTM layer fully connected to 100 neurons in an ...
12 views

### Is anyone able to reproduce Hinton's matrix capsule networks?

I've been working on Hinton's matrix capsule networks for several months. I searched each corner of the internet. But I couldn't find anyone that can reproduce Hinton's matrix capsule network. Can ...
69 views

### How do I choose the search algorithm for a particular task?

How do I choose the search algorithm for a particular task? Which criteria should I take into account?
64 views

### What are the domains where SVMs are still state-of-the-art?

It seems that deep neural networks and other neural network based models are dominating many current areas like computer vision, object classification, reinforcement learning, etc. Are there domains ...
18 views

### File management [on hold]

Explain the importance of file management and how to control files over time. Be sure to give examples based on the hierarchical system used by Windows. How would you use file and folder names to ...
14 views

### Do bounding boxes increase accuracy in and of themselves?

Say I have a standard image classification problem (ie: CNN is shown a single image and predicts a single classification for it). If I were to use bounding boxes to surround the target image (ie: ...
37 views

### Will robots rebel against their human creators? [duplicate]

There are several science fiction movies where the robots rebel against their creators: for example, the Terminator's series or I Robot. In the future, is it possible that robots will rebel against ...
23 views

### Can artificial intelligence create the next wonder material?

The theory and development of computer systems able to perform tasks normally requiring human intelligence, such as visual perception, speech recognition, decision-making, and translation between ...
23 views

### What is the relation between neural embedding and neural code?

Lets consider knowledge graph and operations on it. There are notions of neural embedding and neural coding for it. What is the relation between neural embedding and neural code? Is neural coding a ...
40 views

### Is there any AI system for finding the best way to schedule university classes?

I was wondering whether there is an AI system which could be used to resolve the class clashes problem which mostly happens in universities. In almost every university students face this problem, ...
19 views

### Why experience reply memory in DQN instead of a RNN memory?

I was trying to implement a DQN without experience reply memory, and the agent is not learning anything at all. I know from readings that experience reply is used for stabilizing gradients. But how ...
24 views

### Do AI and data protection go together? [on hold]

Is it safe that when AI systems collect and analyze data,our data protection and privacy will be safe?
24 views

### How should the values of the filters of a CNN change?

I wrote a convolutional neural network for the MNIST dataset with Numpy from scratch. I am currently trying to understand every part and calculation. But one thing I noticed was the "just positive" ...
26 views

### DQN Agent not learning anymore - what can I do to fix this?

I am trying to use Deep-Q-Learning to learn an ANN which controls a 7-DOF robotic arm. The robotic arm must avoid an obstacle and reach a target. I have implemented a number of state-of-art ...
22 views

### AlphaGo neural network inputs

I have two questions: 1) I have been reading an article on AlphaGo and one sentence confused me a little bit, because I'm not sure what it exactly means. The article says: AlphaGo Zero only uses ...
21 views

### Has anyone succeeded to (intentionally) overfit the neural network with MNIST?

I am currently studying myself with a subject "representational(expressive power) of neural network" and trying to intentionally fully overfit the neural network which means that at least the model ...
39 views

### How is the policy gradient calculated in REINFORCE?

Reading Sutton and Barto, I see the following in describing policy gradients: How is the gradient calculated with respect to an action (taken at time t)? I've read implementations of the algorithm, ...
39 views

### Will we be able to build an artificial intelligence that feels empathy?

Nowadays, robots or artificial agents often only perform a specific task or they are restricted to do what they have been programmed to do. Will we be able to build an artificial intelligence that ...
6 views

### Training LSTM with class imbalance

I need to train an LSTM on some light curves, in order to find a signal (there are 2 classes signal and background). However the signal (data points corresponding to signal) is around 100 times less ...
34 views

### Do my cats really knows I exist? [on hold]

I wonder if my cat really knows me as an individual or just a mysterious connected object that hands and legs are attached to a body somehow. When I pet him, does he know that this action is ...