# All Questions

4,561 questions
Filter by
Sorted by
Tagged with
4 views

### DQN unlearns certain OpenAI-Gym environments

I solved the OpenAI-Gym MountainCar-v0 environment using dqn(using low-state-dimensional input). When I used the same code for solving CartPole-v0 environment, the network got trained in the reverse ...
3 views

### How would an AI undertand grids?

OK, now I think an AI must view grids in a different way to computers. For example a computer would represent a grid like this: ...
7 views

### Why does my NN produce Nan values after something like the 3rd iteration?

After about the 2nd or 3rd iteration/epoch, the outputs from my forward prop all contain NaN values. The softmax function produces extreme values which probably is the reason for this. However, I am ...
8 views

### Formal definition of a “nonlocal” game?

This is an area I'm just getting into and starting to review the literature, but I can't easily find a fundamental definition of "nonlocal game". (Comparing to the ease of finding the definitions of ...
9 views

### How to change this RNN text classification code to become text generation code?

I can do text classification with RNN, in which the last output of RNN (rnn_outputs[-1]) is used to matmul with output layer weight and plus bias. That is getting a word (class name) after the last T ...
22 views

### Algorithm to solve a fault independent of its type

I am looking to plan a solution for a workspace fault and not hardware faults. Consider a task where a robot has to move balls from one place to another. In case it faces any condition which is ...
14 views

### Employing an Agent to Learn through Undirected Exploration?

So, I’m looking to automate some tasks at my job. I work at an engineering company. One of my tasks is produce these “reports” in excel that track some design metrics in our company. It’s a soul ...
11 views

### Numbers to image regression

I would like to create a machine learnig framework that could predict the 3D heat distribution of a room(of size 120x120x120) , given multiple parameters(position of the heater, orientation, power of ...
12 views

### Is federated learning a privacy breach?

Is federated learning a privacy breach, given that the model transmission, for a period of time, may cause the adversarial to reach and manipulate the model and the data?
22 views

### Neural network does not give out the required out put?

Made a neural network using tensor flows that was supposed matches an Ip to one of the 7 type of vulnerabilities and gives out what type of vulnerability that IP has. ...
19 views

### How can we find find the input image which maximizes the class-probability for an ANN?

Let's assume we have an ANN which takes a vector $x\in R^D$, representing an image, and classifies it over two classes. The output is a vector of probabilities $N(x)=(p(x\in C_1), p(x\in C_2))^T$ and ...
42 views

### Why evolutionary training of neural networks is not popular?

Evolutionary algorithms are mentioned in some sources as possible to be used to train a neural network (finding weights, not hyperparameters), however I have not heard about one practical application ...
28 views

### How Machine Learning Studies Correlation?

This is my problem: I have 10 variables that I intend to evaluate two by two (in pairs). I want to know which variables have the strongest relationships with each other. And I'm only interested in ...
8 views

### Is automatic parking a technical or an educational topic?

On the first look, self-parking has to do with a computer program which calculates the trajectory of a car and controls the steering wheel. It's realized by algorithms and implemented by AI experts. ...
27 views

### What is the difference between random and sequential sampling from the reply memory?

I was working on an RL problem and I am confused at one specific point. We use replay memory so that the network learns about previous actions and how these actions lead to a success or a failure. ...
13 views

### Is there a train simulator with scripting interface?

Artificial Intelligence is usually teached with robotics in mind. The problem with car like robots is, that the amount of control which is needed is huge. A car has a position, a speed value, a ...
38 views

### LSTM network doesn't converge, what should be changed? [on hold]

I'm testing out TensorFlow LSTM layer text generation task, not classification task; but something is wrong with my code, it doesn't converge. What changes should be done? Source code: ...
22 views

### How to get same accuracy with identical models in Keras and Tensorflow?

As we all know Keras backend uses Tensorflow and so it should give out same kind of results when we provide same parameters, hyper-parameters, weights and biases initialisation at each layer, but ...
21 views

### Why doesn't stability in prediction imply stability in control in off-policy reinforcement learning?

Prediction's goal is to get an estimate of a performance of a policy given a specific state. Control's goal is to improve the policy wrt. the prediction. The alternation between the two is the ...
31 views

### What are the differences between stability and convergence in reinforcement learning?

The terms are mentioned in the paper: “An Emphatic Approach to the Problem of off-Policy Temporal-Difference Learning.” (Sutton, Mahmood, White; 2016) and more, of course. In which paper, they ...
19 views

### Transformer: Position-wise Feed-Forward network

The Transformer model introduced in "Attention is all you need" by Vaswani et al. incorporates a so-called position-wise feed-forward network (FFN): In addition to attention sub-layers, each of the ...
58 views

### Which movies have the most realistic artificial intelligence?

I want to give some examples of AI via movies to my students. There are many movies that include AI, whether being the main character or extras. Which movies have the most realistic (the most ...
12 views

### Make an LSTM model for each class separately

I have a dataset of some activities. The dataset contains the status of different sensors and the label of activity. T trained a model in Keras with the following architecture which models the ...
23 views

### Query on another perspective on Deep Learning

At least at some level, maybe not end-to-end always, but Deep Learning always learns a function, essentially a mapping from a Domain to a Range. The Domain and Range, at least in most cases, would be ...
21 views

### DQN regarding fitting off actions

While studying DQN, I rarely if ever see an explanation of what to fit off actions to. Meaning, if the highest valued action of 3 choices if the first, when training, what do we do with the other two ...
11 views

### Tensorflow and Keras model having same parameters, hyperparameters, weight and bias initialization give different accuracy?

I have made sure that layers,parameters, hyperparameters,kernel_initialization, bias_initialization, seed and dataset are all equal. But still the output for both the models are different. ...
19 views

### What is the best way to find the similarities between two text document

The Problem I would like to develop a platform which people will write text and upload images. I am going to use Google API to classify the text and extract from the image all kind of meta data. In ...
24 views

### How to map X to Y for TensorFlow RNN training data

Usually for DNN, I have the training data of matching X (2D) to Y (2D), for example, XOR data: X = [[0,0],[0,1],[1,0],[1,1]]; Y = [[0], [1], [1], [0] ]; ...
17 views

### What is the State-of-the-Art open source Voice Cloning tool right now?

I would like to clone a voice as precisely as possible. Lately, impressive models have been released that only need about 10 s of voice input (cf. https://github.com/CorentinJ/Real-Time-Voice-Cloning),...
19 views

### Can Fuzzy logic become more objective?

On the first look, fuzzy logic is an efficient way in dealing with uncertainty. It allows to store vague information into a float variable which allows similar to a color gradient a realistic ...
58 views

### Is AGI likely to be developed in the next decade?

AI experts like Ben Goertzel and Ray Kurzweil say that AGI will be developed in the coming decade. Are they credible?
23 views

### Does higher Accuracy in Reinforcement Learning indicate better model performance?

If a reinforcement learning algorithm uses a Deep Neural Network to predict the action given a state (a NN for a policy function), an Monte Carlo Tree Search in a model-based learning setup, then ...
16 views

### Doubt on formulating cost function for GloVe

I'm reading the notes here and have a doubt on page 2 ("Least squares objective" section). The probability of a word $j$ occurring in the context of word $i$ is Q_{ij}=\frac{\exp(u_j^Tv_i)}{\sum_{w=...
38 views

### Training Keras Towards Or Against Analog Value?

For example, if I want to do a cat and mouse AI, the cat would wish to minimize the time taken for it to catch the mouse and the mouse would want to maximize that time. The time is analog and thus I ...
22 views

### What is the best option to test the data set of images using weka? [migrated]

I have two hundred and fifty images, and extracted the features from them and put them in an Excel file, how to use the weka program so that the first 200 images for training and the remaining fifty ...
28 views

### Get the position of an object, out of an image

I have some images with a fixed background and a single object on them which is placed, in each image, at a different position on that background. I want to find a way to extract, in an unsupervised ...
28 views

### Show that if $H$ is PAC learnable (in the standard one-oracle model), then $H$ is also learnable in the two-oracle model

Consider a variant of the PAC model in which there are two example oracles: one that generates positive examples and one that generates negative examples, both according to the underlying distribution ...
6 views

### Looking for the right type of 1D-Convolution that only considers one column/attribute

My input has the shape of n rows (time steps) and m columns (attributes). I want to train a convolutional neural network on it to predict a class. I am currently using 1D-Convolutions. I got a good ...
15 views

### How to implement AdamW? [on hold]

I have implemented AdamW but I am not getting good results, is there some mistake in my implementation? ...
13 views

### A2C for the game of Hanabi underfits

I am trying to solve the game of Hanabi (paper describing game) with actor-critic algorithm. I took code for the environment from the Deepmind's repository and implemented a2c algorithm myself. From ...
28 views

### What are AI-related information which are easy to consume?

The term edutainment was introduced with the advent of the television and summarizes a corpus of books and TV-shows in which academic topics are presented with lower access barrier. What edutainment ...
8 views

### How much data is needed to train a deep learning model to detect instance masks?

I am trying to get an idea of how much data is needed to train a deep convolutional neural network to detect instance masks from images. I am interested in both papers that have been written on the ...
15 views

### Real time ticket similarity

I'm dealing with a "ticket similarity task". Every time new tickets arrive at the help desk (customer service), I need to compare them and find out about similar ones. In this way, once the operator ...
26 views

### Neural Network training on one example to try overfitting leads to strange predictions

tldr; if I train the network on 1 training example, the outcome sometimes makes no sense at all, sometimes is as expected. If I train it on more examples and higher iterations, the network, which ...
36 views

### Why does estimation error increase with $|H|$ and decrease with $m$ in PAC learning?

Why does estimation error increase with $|H|$ and decrease with $m$ in PAC learning? I came across this statement in the section 5.2 of the book "understanding machine learning: from theory to ...
9 views

### Metrics of quality of parameter space exploration

Considering a black box optimization problem on non-linear, non-convex function where we want to minimize an objective function. One way to assess the quality of an optimizer is to look at the best ...
9k views

### How could artificial intelligence harm us?

We often hear that artificial intelligence may harm or even kill humans, so it might prove dangerous. How could artificial intelligence harm us?
7 views

### Learning to rank on collections of ordered objects?

Are there examples of LTR algorithms applied to variable length lists of ordered objects? E.g. perhaps 4 specific photos in a sequence layout would rate higher than another 3 or another 4 where the ...
What happens to the optimal action-value function, $q_*$ if the reward is multiplied by a constant $c$? Is the optimal action-value function also multiplied by such a constant?