All Questions

0
votes
0answers
8 views

Can an OpenAI Gym Action be any object?

The gym core file simply defines action as in step(action) as an "object". I've searched for an Action object in the code without success. Can it be any python ...
0
votes
0answers
8 views

Understanding Hebb network

Can anyone help me in understanding Hebb networking and how different function like AND, OR used to solve by this network. I couldn’t understand properly through the google.
0
votes
1answer
20 views

CNN Translation invariant or translation equivariant?

I am trying to understand this post, but get confused by the definitions and the differences. Not sure what's definition of equivariant? If I remove all the pooling layers from CNN it will make the ...
0
votes
0answers
9 views

How to properly optimize shared network between actor and critic?

I'm building an actor-critic reinforcment learning algorithm to solve environments. I want to use a single encoder to find representation of my environment. When I share the encoder with the actor ...
0
votes
1answer
22 views

Picking a random move in exploitation in Q-Learning

I've been unsure about a principle of Q-Learning, I was hoping someone could clear it up. When a new state is encountered, and thus there are no existing Q values, and that the algorithm decides to ...
0
votes
1answer
21 views

Understanding Constraint Search

What is the goal of a constraint solver? How are constraints propagated in a constraint satisfaction search? Any references are also appreciated.
0
votes
0answers
19 views

I have a million records of duty trades between two users, need to figure out which ML to use [migrated]

I have a million records of duty trades between two users. One user drops a duty, and other user will pick it up if he/she likes it (There are 50k users in total) and anybody could pick it up, in 20 ...
1
vote
0answers
11 views

Point Cloud Alignment using a Neural Network?

Having two point clouds, the second being a transformation of the first, how could I utilize a neural network in order to solve the pose (transformation in terms of x, y, z, rx, ry, rz) of the second ...
3
votes
2answers
26 views

In Artificial Intelligence, what are semantic analyses used for?

Semantics means the meaning and interpretation of words, signs, and sentence structure. Semantics largely determine our reading comprehension, how we understand others, and even what decisions we make ...
0
votes
0answers
27 views

$\epsilon$-greedy policies for huge state space

I'm currently building an agent that learns to play Kalah through reinforcement learning. I've gotten quite far along. With an $\epsilon$ of 0, meaning no exploration and only exploitation, it is able ...
0
votes
0answers
19 views

Unsupervised LSTM

I have a big amount of light curves (image below) and I am trying to label the points as signal or background (the signal appears usually periodically, several times, for a given light curve). However,...
0
votes
2answers
27 views

How to stop DQN Q function from increasing during learning?

Following the DQN algorithm with experience replay: We calculate the $loss=(Q(s,a)-(r+Q(s+1,a)))^2$. Assume I have positive but changing rewards. Meaning, $r>0$. Thus, since the rewards are ...
1
vote
1answer
28 views

How does a PDDL-Solver find a solution for a given problem?

As far as I know: In PDDL an environment is designed as well as the initial state described. When we describe the target state the solver creates some sort of a graph. How is the graph built and what ...
0
votes
1answer
21 views

Alphazero policy head loss not decreasing

I am now working on training an alphazero player for a board game. The implementation of board game is mine, MCTS for alphazero was taken elsewhere. Due to complexity of the game, it takes a much ...
1
vote
0answers
11 views

How to combine features with different temporal scale in machine learning

We have various types of data features with different temporal scale. For example, some of them describe the state per second while others may describe the state per day or per month from another ...
2
votes
1answer
27 views

Does reinforcing correct predictions increase model accuracy further?

Let's say I've trained a CNN that is predicting/inferring live samples that it hasn't seen before. In the event the network makes a correct prediction, would including this as a new sample in its ...
1
vote
0answers
23 views

What are some examples of tasks in which, currently, neuroevolution outperforms gradient-based approaches?

Note: I am NOT asking for general advantages of neuroevolution over standard approaches (e.g.: architecture search, parallelization), I am asking for examples of tasks in which, currently, ...
5
votes
2answers
52 views

How is local minima possible in gradient descent?

Gradient descent works on the equation of mean squared error, which is an equation of a parabola $y=x^2$. We often say that weight adjustment in a neural network by gradient descent algorithm can hit ...
0
votes
0answers
11 views

Edge AI device to run inference

I'm trying to figure out what's the best way to get a trained model that does facial detection to run on a camera that's connected to a computer and perform inference. Since I don't need the device ...
1
vote
1answer
61 views

What is an artificial neural network?

What is an artificial neural network in artificial intelligence? It is apparently used to find patterns in data and it is loosely inspired by human neural networks.
1
vote
0answers
10 views

Simple weakly supervised Object localizetion using keras. How to visualize the results?

I am following this link : Weakly-supervised-object-localization to create heatmap of the region in an image where the CNN looks to identify the class. As per the above mentioned repository , ...
0
votes
1answer
22 views

Binary vector expected value

Raul Rojas' Neural Networks A Systematic Introduction, section 8.2.1 calculates the variance of the output of a hidden neuron. Raul Rojas says that "for binary vectors we have $E[x_i^2] = \frac{1}{3}$...
0
votes
0answers
18 views

Why the loss is nan by using linear activation function in the last layer? [migrated]

I want to use neural network to solve a simple regression problem, and I try to program by myself accroding to lecture Backpropagation and Neural Networks . However, I meet loss divergence problem. ...
1
vote
1answer
25 views

Does changing the order of the convolution layers in a CNN have any impact?

Could changing the order of convolution layers in a CNN improve accuracy or training time?
1
vote
1answer
26 views

Is there any example of using Q-learning with big data?

Could we even use reinforcement learning with big datasets? Or in RL does the agent built its own dataset ?
-1
votes
1answer
23 views

Use Image data from Drive to Colab for Image Augmentation

I am working on CNN. I have saved images in drive to do image augmentation in keras, I have used method (.flow_from_directory(directory)) Since it require directory path. I have mounted drive and give ...
-1
votes
0answers
17 views

How to integrate Microsoft chatbot with wechat [on hold]

How to integrate Microsoft chatbot with wechat. I have developed my chatbot using nodejs with bot framework version 4. My bot development is completed and it is published to Azure. Now i got ...
1
vote
0answers
32 views

Difficulty in balancing Pendulum using Deep Reinforcement Learning Algorithm

I am using OpenAI Gym framework for reinforcement learning where I am trying solve classic control problem of balancing an Inverted Pendulum, which is similar to the "Pendulum-v0" with some changes in ...
0
votes
0answers
11 views

Benefits in using multiple LSTM layers?

I am working on a time series forecasting problem and I am in the process of choosing the optimum network structure. Currently I have a 200 cell LSTM layer fully connected to 100 neurons in an ...
1
vote
0answers
12 views

Is anyone able to reproduce Hinton's matrix capsule networks?

I've been working on Hinton's matrix capsule networks for several months. I searched each corner of the internet. But I couldn't find anyone that can reproduce Hinton's matrix capsule network. Can ...
1
vote
1answer
69 views

How do I choose the search algorithm for a particular task?

How do I choose the search algorithm for a particular task? Which criteria should I take into account?
6
votes
2answers
64 views

What are the domains where SVMs are still state-of-the-art?

It seems that deep neural networks and other neural network based models are dominating many current areas like computer vision, object classification, reinforcement learning, etc. Are there domains ...
-1
votes
0answers
18 views

File management [on hold]

Explain the importance of file management and how to control files over time. Be sure to give examples based on the hierarchical system used by Windows. How would you use file and folder names to ...
1
vote
1answer
14 views

Do bounding boxes increase accuracy in and of themselves?

Say I have a standard image classification problem (ie: CNN is shown a single image and predicts a single classification for it). If I were to use bounding boxes to surround the target image (ie: ...
0
votes
1answer
37 views

Will robots rebel against their human creators? [duplicate]

There are several science fiction movies where the robots rebel against their creators: for example, the Terminator's series or I Robot. In the future, is it possible that robots will rebel against ...
0
votes
1answer
23 views

Can artificial intelligence create the next wonder material?

The theory and development of computer systems able to perform tasks normally requiring human intelligence, such as visual perception, speech recognition, decision-making, and translation between ...
0
votes
0answers
23 views

What is the relation between neural embedding and neural code?

Lets consider knowledge graph and operations on it. There are notions of neural embedding and neural coding for it. What is the relation between neural embedding and neural code? Is neural coding a ...
2
votes
1answer
40 views

Is there any AI system for finding the best way to schedule university classes?

I was wondering whether there is an AI system which could be used to resolve the class clashes problem which mostly happens in universities. In almost every university students face this problem, ...
2
votes
0answers
19 views

Why experience reply memory in DQN instead of a RNN memory?

I was trying to implement a DQN without experience reply memory, and the agent is not learning anything at all. I know from readings that experience reply is used for stabilizing gradients. But how ...
-2
votes
0answers
24 views

Do AI and data protection go together? [on hold]

Is it safe that when AI systems collect and analyze data,our data protection and privacy will be safe?
0
votes
1answer
24 views

How should the values of the filters of a CNN change?

I wrote a convolutional neural network for the MNIST dataset with Numpy from scratch. I am currently trying to understand every part and calculation. But one thing I noticed was the "just positive" ...
2
votes
0answers
26 views

DQN Agent not learning anymore - what can I do to fix this?

I am trying to use Deep-Q-Learning to learn an ANN which controls a 7-DOF robotic arm. The robotic arm must avoid an obstacle and reach a target. I have implemented a number of state-of-art ...
1
vote
1answer
22 views

AlphaGo neural network inputs

I have two questions: 1) I have been reading an article on AlphaGo and one sentence confused me a little bit, because I'm not sure what it exactly means. The article says: AlphaGo Zero only uses ...
0
votes
0answers
21 views

Has anyone succeeded to (intentionally) overfit the neural network with MNIST?

I am currently studying myself with a subject "representational(expressive power) of neural network" and trying to intentionally fully overfit the neural network which means that at least the model ...
4
votes
1answer
39 views

How is the policy gradient calculated in REINFORCE?

Reading Sutton and Barto, I see the following in describing policy gradients: How is the gradient calculated with respect to an action (taken at time t)? I've read implementations of the algorithm, ...
0
votes
1answer
39 views

Will we be able to build an artificial intelligence that feels empathy?

Nowadays, robots or artificial agents often only perform a specific task or they are restricted to do what they have been programmed to do. Will we be able to build an artificial intelligence that ...
0
votes
0answers
6 views

Training LSTM with class imbalance

I need to train an LSTM on some light curves, in order to find a signal (there are 2 classes signal and background). However the signal (data points corresponding to signal) is around 100 times less ...
-1
votes
0answers
34 views

Do my cats really knows I exist? [on hold]

I wonder if my cat really knows me as an individual or just a mysterious connected object that hands and legs are attached to a body somehow. When I pet him, does he know that this action is ...
0
votes
1answer
32 views

Encourage Deep Q to seek short-term reward

I understand that gamma is an important factor in determining the rewards for a deep Q agent, however during testing of my network I am noticing that the agent is outputting more actions to "do ...
0
votes
0answers
18 views

Can an AI be created to work on itself independently without human assistance from the time it is created?

Can an AI be created to work on itself independently without human assistance from the time it is created? Can it access all the data it wants to from the internet as well as the dark web? Can it have ...

15 30 50 per page