All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
4 views

DQN unlearns certain OpenAI-Gym environments

I solved the OpenAI-Gym MountainCar-v0 environment using dqn(using low-state-dimensional input). When I used the same code for solving CartPole-v0 environment, the network got trained in the reverse ...
0
votes
0answers
3 views

How would an AI undertand grids?

OK, now I think an AI must view grids in a different way to computers. For example a computer would represent a grid like this: ...
0
votes
0answers
7 views

Why does my NN produce Nan values after something like the 3rd iteration?

After about the 2nd or 3rd iteration/epoch, the outputs from my forward prop all contain NaN values. The softmax function produces extreme values which probably is the reason for this. However, I am ...
0
votes
0answers
8 views

Formal definition of a “nonlocal” game?

This is an area I'm just getting into and starting to review the literature, but I can't easily find a fundamental definition of "nonlocal game". (Comparing to the ease of finding the definitions of ...
0
votes
0answers
9 views

How to change this RNN text classification code to become text generation code?

I can do text classification with RNN, in which the last output of RNN (rnn_outputs[-1]) is used to matmul with output layer weight and plus bias. That is getting a word (class name) after the last T ...
1
vote
0answers
22 views

Algorithm to solve a fault independent of its type

I am looking to plan a solution for a workspace fault and not hardware faults. Consider a task where a robot has to move balls from one place to another. In case it faces any condition which is ...
0
votes
0answers
14 views

Employing an Agent to Learn through Undirected Exploration?

So, I’m looking to automate some tasks at my job. I work at an engineering company. One of my tasks is produce these “reports” in excel that track some design metrics in our company. It’s a soul ...
0
votes
0answers
11 views

Numbers to image regression

I would like to create a machine learnig framework that could predict the 3D heat distribution of a room(of size 120x120x120) , given multiple parameters(position of the heater, orientation, power of ...
0
votes
0answers
12 views

Is federated learning a privacy breach?

Is federated learning a privacy breach, given that the model transmission, for a period of time, may cause the adversarial to reach and manipulate the model and the data?
2
votes
1answer
22 views

Neural network does not give out the required out put?

Made a neural network using tensor flows that was supposed matches an Ip to one of the 7 type of vulnerabilities and gives out what type of vulnerability that IP has. ...
2
votes
2answers
19 views

How can we find find the input image which maximizes the class-probability for an ANN?

Let's assume we have an ANN which takes a vector $x\in R^D$, representing an image, and classifies it over two classes. The output is a vector of probabilities $N(x)=(p(x\in C_1), p(x\in C_2))^T$ and ...
4
votes
1answer
42 views

Why evolutionary training of neural networks is not popular?

Evolutionary algorithms are mentioned in some sources as possible to be used to train a neural network (finding weights, not hyperparameters), however I have not heard about one practical application ...
3
votes
1answer
28 views

How Machine Learning Studies Correlation?

This is my problem: I have 10 variables that I intend to evaluate two by two (in pairs). I want to know which variables have the strongest relationships with each other. And I'm only interested in ...
0
votes
0answers
8 views

Is automatic parking a technical or an educational topic?

On the first look, self-parking has to do with a computer program which calculates the trajectory of a car and controls the steering wheel. It's realized by algorithms and implemented by AI experts. ...
3
votes
0answers
27 views

What is the difference between random and sequential sampling from the reply memory?

I was working on an RL problem and I am confused at one specific point. We use replay memory so that the network learns about previous actions and how these actions lead to a success or a failure. ...
1
vote
1answer
13 views

Is there a train simulator with scripting interface?

Artificial Intelligence is usually teached with robotics in mind. The problem with car like robots is, that the amount of control which is needed is huge. A car has a position, a speed value, a ...
0
votes
2answers
38 views

LSTM network doesn't converge, what should be changed? [on hold]

I'm testing out TensorFlow LSTM layer text generation task, not classification task; but something is wrong with my code, it doesn't converge. What changes should be done? Source code: ...
1
vote
0answers
22 views

How to get same accuracy with identical models in Keras and Tensorflow?

As we all know Keras backend uses Tensorflow and so it should give out same kind of results when we provide same parameters, hyper-parameters, weights and biases initialisation at each layer, but ...
0
votes
0answers
21 views

Why doesn't stability in prediction imply stability in control in off-policy reinforcement learning?

Prediction's goal is to get an estimate of a performance of a policy given a specific state. Control's goal is to improve the policy wrt. the prediction. The alternation between the two is the ...
3
votes
1answer
31 views

What are the differences between stability and convergence in reinforcement learning?

The terms are mentioned in the paper: “An Emphatic Approach to the Problem of off-Policy Temporal-Difference Learning.” (Sutton, Mahmood, White; 2016) and more, of course. In which paper, they ...
4
votes
0answers
19 views

Transformer: Position-wise Feed-Forward network

The Transformer model introduced in "Attention is all you need" by Vaswani et al. incorporates a so-called position-wise feed-forward network (FFN): In addition to attention sub-layers, each of the ...
2
votes
3answers
58 views

Which movies have the most realistic artificial intelligence?

I want to give some examples of AI via movies to my students. There are many movies that include AI, whether being the main character or extras. Which movies have the most realistic (the most ...
0
votes
0answers
12 views

Make an LSTM model for each class separately

I have a dataset of some activities. The dataset contains the status of different sensors and the label of activity. T trained a model in Keras with the following architecture which models the ...
3
votes
1answer
23 views

Query on another perspective on Deep Learning

At least at some level, maybe not end-to-end always, but Deep Learning always learns a function, essentially a mapping from a Domain to a Range. The Domain and Range, at least in most cases, would be ...
1
vote
1answer
21 views

DQN regarding fitting off actions

While studying DQN, I rarely if ever see an explanation of what to fit off actions to. Meaning, if the highest valued action of 3 choices if the first, when training, what do we do with the other two ...
2
votes
0answers
11 views

Tensorflow and Keras model having same parameters, hyperparameters, weight and bias initialization give different accuracy?

I have made sure that layers,parameters, hyperparameters,kernel_initialization, bias_initialization, seed and dataset are all equal. But still the output for both the models are different. ...
2
votes
1answer
19 views

What is the best way to find the similarities between two text document

The Problem I would like to develop a platform which people will write text and upload images. I am going to use Google API to classify the text and extract from the image all kind of meta data. In ...
0
votes
1answer
24 views

How to map X to Y for TensorFlow RNN training data

Usually for DNN, I have the training data of matching X (2D) to Y (2D), for example, XOR data: X = [[0,0],[0,1],[1,0],[1,1]]; Y = [[0], [1], [1], [0] ]; ...
2
votes
0answers
17 views

What is the State-of-the-Art open source Voice Cloning tool right now?

I would like to clone a voice as precisely as possible. Lately, impressive models have been released that only need about 10 s of voice input (cf. https://github.com/CorentinJ/Real-Time-Voice-Cloning),...
1
vote
1answer
19 views

Can Fuzzy logic become more objective?

On the first look, fuzzy logic is an efficient way in dealing with uncertainty. It allows to store vague information into a float variable which allows similar to a color gradient a realistic ...
0
votes
2answers
58 views

Is AGI likely to be developed in the next decade?

AI experts like Ben Goertzel and Ray Kurzweil say that AGI will be developed in the coming decade. Are they credible?
-1
votes
1answer
23 views

Does higher Accuracy in Reinforcement Learning indicate better model performance?

If a reinforcement learning algorithm uses a Deep Neural Network to predict the action given a state (a NN for a policy function), an Monte Carlo Tree Search in a model-based learning setup, then ...
2
votes
0answers
16 views

Doubt on formulating cost function for GloVe

I'm reading the notes here and have a doubt on page 2 ("Least squares objective" section). The probability of a word $j$ occurring in the context of word $i$ is $$Q_{ij}=\frac{\exp(u_j^Tv_i)}{\sum_{w=...
1
vote
1answer
38 views

Training Keras Towards Or Against Analog Value?

For example, if I want to do a cat and mouse AI, the cat would wish to minimize the time taken for it to catch the mouse and the mouse would want to maximize that time. The time is analog and thus I ...
2
votes
0answers
22 views

What is the best option to test the data set of images using weka? [migrated]

I have two hundred and fifty images, and extracted the features from them and put them in an Excel file, how to use the weka program so that the first 200 images for training and the remaining fifty ...
4
votes
0answers
28 views

Get the position of an object, out of an image

I have some images with a fixed background and a single object on them which is placed, in each image, at a different position on that background. I want to find a way to extract, in an unsupervised ...
3
votes
0answers
28 views

Show that if $H$ is PAC learnable (in the standard one-oracle model), then $H$ is also learnable in the two-oracle model

Consider a variant of the PAC model in which there are two example oracles: one that generates positive examples and one that generates negative examples, both according to the underlying distribution ...
0
votes
0answers
6 views

Looking for the right type of 1D-Convolution that only considers one column/attribute

My input has the shape of n rows (time steps) and m columns (attributes). I want to train a convolutional neural network on it to predict a class. I am currently using 1D-Convolutions. I got a good ...
0
votes
0answers
15 views

How to implement AdamW? [on hold]

I have implemented AdamW but I am not getting good results, is there some mistake in my implementation? ...
0
votes
0answers
13 views

A2C for the game of Hanabi underfits

I am trying to solve the game of Hanabi (paper describing game) with actor-critic algorithm. I took code for the environment from the Deepmind's repository and implemented a2c algorithm myself. From ...
3
votes
1answer
28 views

What are AI-related information which are easy to consume?

The term edutainment was introduced with the advent of the television and summarizes a corpus of books and TV-shows in which academic topics are presented with lower access barrier. What edutainment ...
0
votes
0answers
8 views

How much data is needed to train a deep learning model to detect instance masks?

I am trying to get an idea of how much data is needed to train a deep convolutional neural network to detect instance masks from images. I am interested in both papers that have been written on the ...
0
votes
1answer
15 views

Real time ticket similarity

I'm dealing with a "ticket similarity task". Every time new tickets arrive at the help desk (customer service), I need to compare them and find out about similar ones. In this way, once the operator ...
0
votes
0answers
26 views

Neural Network training on one example to try overfitting leads to strange predictions

tldr; if I train the network on 1 training example, the outcome sometimes makes no sense at all, sometimes is as expected. If I train it on more examples and higher iterations, the network, which ...
2
votes
1answer
36 views

Why does estimation error increase with $|H|$ and decrease with $m$ in PAC learning?

Why does estimation error increase with $|H|$ and decrease with $m$ in PAC learning? I came across this statement in the section 5.2 of the book "understanding machine learning: from theory to ...
2
votes
0answers
9 views

Metrics of quality of parameter space exploration

Considering a black box optimization problem on non-linear, non-convex function where we want to minimize an objective function. One way to assess the quality of an optimizer is to look at the best ...
36
votes
14answers
9k views

How could artificial intelligence harm us?

We often hear that artificial intelligence may harm or even kill humans, so it might prove dangerous. How could artificial intelligence harm us?
0
votes
0answers
7 views

Learning to rank on collections of ordered objects?

Are there examples of LTR algorithms applied to variable length lists of ordered objects? E.g. perhaps 4 specific photos in a sequence layout would rate higher than another 3 or another 4 where the ...
2
votes
1answer
31 views

How do policy gradients compute an infinite probability distribution from a neural network

Do neural networks compute the probability distribution for policy gradient methods. If so, how do they compute an infinite probability distribution? How do you represent a continuous action policy ...
2
votes
1answer
41 views

What happens to the optimal value function if the reward is multiplied by a constant?

What happens to the optimal action-value function, $q_*$ if the reward is multiplied by a constant $c$? Is the optimal action-value function also multiplied by such a constant?

15 30 50 per page