# All Questions

8,595 questions
Filter by
Sorted by
Tagged with
4 views

### PyTorch: LSTM error while trying to update the hidden state

I am trying to train an LSTM while keeping its hidden state (LSTM stateful) until the moment when I am going to start a new epoch(episode). But here it's come an interesting situation because I am ...
6 views

### What to use as a proxy for AI

Im trying to build a model using AI and the economy and only came my head to use patents as a proxy, do you guys know what else i can use as proxy for AI. I thought about using data from ...
14 views

### Double DQN backpropagation of negative final rewards?

My problem is that in my Double DQN model, negative final rewards are not being backpropagated into action Q-values, and so some Q-values are positive, when they should be negative, and hence ...
24 views

### With Monte Carlo off-policy learning what do we correct by using importance sampling?

I do not understand the link of importance sampling to Monte Carlo off-policy learning. We estimate a value using sampling on whole episodes, and we take these values to construct the target policy. ...
10 views

### Is is not possible to achieve average reward of more than 20-40 with simple Q-Learning

I have implemented the simple Q-Learning based solution for AI-gym's Cartpole-v0. However, despite changing hyper-parameters, and rechecking my code, I cannot get an average reward (N-running reward) ...
21 views

### Why is the logarithm of the standard deviation used in this implementation of proximal policy optimization?

I am currently writing my bachelor thesis, which is an implementation of proximal policy optimization. Sometimes, I hit a wall because of the gaps in my mathematical knowledge. However, implementing ...
17 views

### Do larger numbers of hidden layers have a bigger effect on a classification model's accuracy?

I trained different classification models using Keras with different numbers of hidden layers and the same number of neurons in each layer. What I found was the accuracy of the models decreased as the ...
5 views

### Split a city into a set of candidate locations (cells) via a clustering algorithm (DBSCAN or OPTICS)

The authors of the following paper predict the market attraction for restaurants based on user reviews for different locations to select an ideal location. To do so they have split the city into a set ...
12 views

### How to add prior information when predicting using deep learning models?

Background I'm building a binary classification model for a pair match problem using CNN, e.g. whether person A1 likes product B1 or not. Model input features are sequence features of the person and ...
12 views

### What is the meaning of “Our current objective weights every token equally and lacks a notion of what is most important to predict” in the GPT-3 paper?

On page 34 of OpenAI's GPT-3, there is a sentence demonstrating the limitation of objective function: Our current objective weights every token equally and lacks a notion of what is most important to ...
20 views

### Why does Batch Normalization work?

Adding BatchNorm layers improves training time and makes the whole deep model more stable. That's an experimental fact that is widely used in machine learning practice. My question is - why does it ...
16 views

### Are there any inverse RNN layers?

Given the model: Sequence([ GRU(200, input_shape=(None,100), return_sequences=False) ]) Which maps the space ...
185 views

### How to fight with unstability in self play?

I'm working on a neural network that plays some board games like reversi or tic-tac-toe (zero-sum games, two players). I'm trying to have one network topology for all the games - I specifically don't ...
7 views

### How does the loss landscape look like or change when a model is overfitting?

My understanding is that when a model starts overfitting, it no longer learns useful features and starts remembering the training data set. Given enough epochs and sufficient parameters, a model can ...
12 views

### How to Select Model Parameters for Transformer (Heads, number of layers, etc)

Is there a general guideline on how the Transformer model parameters should be selected, or the range of these parameters that should be included in a hyperparameter sweep? Number of heads Number of ...
28 views

### Viola-Jones algorithm: Haar-like features, how are the features extracted?

If I have an image like this 1 2 3 4 5 6 7 8 a b c d e f g h ... And I apply a Haar-like feature with a template ...
28 views

### Is it possible to use Internal layer in loss function?

For a network of the form: Input(10) Dense(200) Dense(100+10) Dense(20) Output() Those +10 outputs are what I want to add to ...
27 views

### Is a true RNN auto encoder possible with Keras/TF

I want to get some encodings for temporal data (with a highly varying number of timesteps). The dataset is of the format: ...
29 views

### is “riding” a polysemy? [closed]

If "riding" is not a polysemy, then what are its characteristics? We can say ride an elephant, ride a car, ride a horse, and ride a bike. The actions are the same but not necessarily have ...
12 views

### Extracting “hidden” costs from financial statements using NLP

I'm designing a NLP model to extract various kinds of "hidden" expenses from 10-K and 10-Q financial statements. I've come up with about 7 different expense categories (restructuring costs, ...
32 views

### How many papers about AI / ML were published in the recent years?

I am trying to formulate an argument at work saying the disruption in AI/ML is very high and that it is hard to stay "state of the art". I would like to support that hypothesis by numbers. ...
12 views

### Advice required for identifying bone fragments in CT-scans using STL Files (3D image segmentation)

I am working on a project related to automating the procedure of manually segmenting some bones in CT scans and hopefully if everything goes alright in this stage, move on to do something more with ...
38 views

### How to recover the target Q network's weights solely from the snapshots of the primary Q network's weights in DQN?

Suppose that I have a DQN agent, which has two neural networks: one is the primary Q network and the other is the target Q network. In every update, the target Q network is updated with a soft update ...
27 views

### What is the difference between learning agents and other kinds of agents, and more specifically, between performance standard and performance measure?

I am reading AI: A Modern Approach. In the 2nd chapter when introducing different agent types, i.e., reflex, utility-based, goal-based, and learning agents, I understood that all types of agents, ...
3 views

### How can we add complex preprocessing in AWS Sagemaker inference [closed]

I am using AWS Sagemaker to deploy my speech models trained outside of Sagemaker. I am able to convert my model into something Sagemaker would understand and have deployed it as an endpoint. Problem ...
178 views

### Does gradient descent in deep learning assume a smooth fitness landscape?

I've come across the concept of fitness landscape before and, in my understanding, a smooth fitness landscape is one where the algorithm can converge on the global optimum through incremental ...
8 views

### Keras memory allocation [closed]

I have been trying to build a deep learning model, using Keras as API with tensorflow 2.2 and cuda 102.89. My dataset is "relatively big" (27500 400x400 images) and so I've tried using both <...
20 views

24 views

### Why do you calculate the mean and standard deviation over the complete dataset before training rather than for every batch?

In most implementations of neural networks the features are scaled to make the optimization of the loss function as stable as possible. Mostly a min-max scaler is used. Alternatively, there is also a ...
10 views

### How to make CNN to recognize whole picture, not just the details?

In my current project I use CNNs to analize plots (CNN autoencoders for feature extraction and KMeans for clusterization) and I get the feeling that these networks, can extract only features that are ...
9 views

### The best cloud python platform for AI models by speed [closed]

I am searching for a platform that would allow me cloud computing for training AI models. Something similar like: Kaggle Kernal Colab Datalore -... 1. Reasone Speed I would like to have better speed ...
14 views

### Is there any use of having connections between nodes in the output layer of a neural network?

Is there any use of having connections between nodes in the output layer of a neural network? In some cases some outputs may depend on other outputs; by this logic, is it possible to have such neural ...
20 views

### What would be the state of the art image captioning deep learning model?

I saw a couple of architectures, like CNN-LSTM, with and without attention model, use of Glove vector, self-critical models, etc. I am overwhelmed looking at different notebooks and architectures, ...
6 views

### Is it possible to use agent coordinates directly as part of the state

I am working on graph optimisation problem using DQN - the graph is represented as an adjacency matrix and an agent moves through this matrix removing edges between nodes (add a 0) or adding edges ...
19 views

### What are some strong algorithms for Perfect Information, Deterministic Multiplayer Games?

I have a series of games with the following properties: 3 or more players, but purely non-cooperative (i.e., no coalition forming); sequential moves; perfect information; deterministic state ...
11 views

### The Effect of Batch Size in CNN Image Classifier, Given Different Image Domain

I am currently training image classifiers on CelebA face attribute dataset (Binary classifiers), which will be used on images generated by StyleGAN (that is trained on FFHQ256 dataset). These ...
18 views

### extract desire keyword/text pair

I am looking for extract keyword pair from text files. They might not be next to each other and do not have same pattern for each occurrence. And I would not think regex will works because there is no ...
10 views

### Perform mini batch k means on large dataset of 16GB using pandas [closed]

I have a time series dataset of 16GB split into 200 files of 80MB each e.g. A1.csv to A200.csv. How do I perform mini-batch k means clustering on all these 200 files using pandas? Any sample source ...
9 views

### Word2Vec: Identifying many-to-one relationships between words

Standard introductory examples in Word2Vec, like king - queen = man - woman and tokyo - japan = london - uk, involve one-to-one ...
33 views

### Is there a clustering algorithm that can make n clusters and the n+1 “others” cluster?

As far as I know all clustering algorithms assume that all delivered data points have to find its cluster. My question is, is there an algorithm that could focus only on n clusters (number stated by ...
35 views

### Is the policy gradient expression in Fundamentals of Deep Learning wrong?

I don't understand the policy gradient as explained in Chapter-9 (Deep Reinforcement Learning) of the book Fundamentals of deep learning. Here is the whole paragraph: Policy Learning via Policy ...
12 views

### Extracting patterns from step data [closed]

I have step data for n people. What I am trying to achieve is to extract activities from the step data i.e. relate steps to activities. The primary goal is to fingerprint people based on step data. I ...
16 views

### PyTorch: How to deal with hidden states of an LSTM?

I have a time series in which each date is correlated with the preview one, and base on that I am trying to predict action 1 and action 2. But the problem is that I am not sure how to deal with the <...
31 views

### Why the optimal Bellman operator of a Q-function can be approximated by a single point

I am currently studying reinforcement learning, especially DQN. In DQN, learning proceeds in such a way as to minimize the norm (least-squares, Huber, etc.) of the optimal Bellman equation and the ...
17 views

### Backpropagation in REINFORCE algorithms with Categorical / Multinomial Distribution

From a paper by Williams, I know in general how to backpropagate log-probabilities of chosen actions when applying the REINFORCE weight update rule. However, I was wondering about a case not being ...
25 views

### About AI time traveling capability [closed]

Based of ai nature(needs to information and Calculayion unit) I guess, it could do the time traveling in the our univerese by finding some calculation unit for doing it's calculation and do its ...
I want to use RL instead of genetic or any other evolutionary algorithm in order to find the best parameter for a function. Here is the problem: Given a function $$f(x,y,z,data)$$ x,y and z are some ...