All Questions

Filter by
Sorted by
Tagged with
0
votes
0answers
4 views

PyTorch: LSTM error while trying to update the hidden state

I am trying to train an LSTM while keeping its hidden state (LSTM stateful) until the moment when I am going to start a new epoch(episode). But here it's come an interesting situation because I am ...
0
votes
0answers
6 views

What to use as a proxy for AI

Im trying to build a model using AI and the economy and only came my head to use patents as a proxy, do you guys know what else i can use as proxy for AI. I thought about using data from ...
0
votes
0answers
14 views

Double DQN backpropagation of negative final rewards?

My problem is that in my Double DQN model, negative final rewards are not being backpropagated into action Q-values, and so some Q-values are positive, when they should be negative, and hence ...
1
vote
2answers
24 views

With Monte Carlo off-policy learning what do we correct by using importance sampling?

I do not understand the link of importance sampling to Monte Carlo off-policy learning. We estimate a value using sampling on whole episodes, and we take these values to construct the target policy. ...
1
vote
0answers
10 views

Is is not possible to achieve average reward of more than 20-40 with simple Q-Learning

I have implemented the simple Q-Learning based solution for AI-gym's Cartpole-v0. However, despite changing hyper-parameters, and rechecking my code, I cannot get an average reward (N-running reward) ...
1
vote
1answer
21 views

Why is the logarithm of the standard deviation used in this implementation of proximal policy optimization?

I am currently writing my bachelor thesis, which is an implementation of proximal policy optimization. Sometimes, I hit a wall because of the gaps in my mathematical knowledge. However, implementing ...
0
votes
2answers
17 views

Do larger numbers of hidden layers have a bigger effect on a classification model's accuracy?

I trained different classification models using Keras with different numbers of hidden layers and the same number of neurons in each layer. What I found was the accuracy of the models decreased as the ...
0
votes
0answers
5 views

Split a city into a set of candidate locations (cells) via a clustering algorithm (DBSCAN or OPTICS)

The authors of the following paper predict the market attraction for restaurants based on user reviews for different locations to select an ideal location. To do so they have split the city into a set ...
2
votes
0answers
12 views

How to add prior information when predicting using deep learning models?

Background I'm building a binary classification model for a pair match problem using CNN, e.g. whether person A1 likes product B1 or not. Model input features are sequence features of the person and ...
0
votes
0answers
12 views

What is the meaning of “Our current objective weights every token equally and lacks a notion of what is most important to predict” in the GPT-3 paper?

On page 34 of OpenAI's GPT-3, there is a sentence demonstrating the limitation of objective function: Our current objective weights every token equally and lacks a notion of what is most important to ...
3
votes
0answers
20 views

Why does Batch Normalization work?

Adding BatchNorm layers improves training time and makes the whole deep model more stable. That's an experimental fact that is widely used in machine learning practice. My question is - why does it ...
0
votes
0answers
16 views

Are there any inverse RNN layers?

Given the model: Sequence([ GRU(200, input_shape=(None,100), return_sequences=False) ]) Which maps the space ...
2
votes
1answer
185 views

How to fight with unstability in self play?

I'm working on a neural network that plays some board games like reversi or tic-tac-toe (zero-sum games, two players). I'm trying to have one network topology for all the games - I specifically don't ...
1
vote
0answers
7 views

How does the loss landscape look like or change when a model is overfitting?

My understanding is that when a model starts overfitting, it no longer learns useful features and starts remembering the training data set. Given enough epochs and sufficient parameters, a model can ...
2
votes
0answers
12 views

How to Select Model Parameters for Transformer (Heads, number of layers, etc)

Is there a general guideline on how the Transformer model parameters should be selected, or the range of these parameters that should be included in a hyperparameter sweep? Number of heads Number of ...
2
votes
1answer
28 views

Viola-Jones algorithm: Haar-like features, how are the features extracted?

If I have an image like this 1 2 3 4 5 6 7 8 a b c d e f g h ... And I apply a Haar-like feature with a template ...
0
votes
1answer
28 views

Is it possible to use Internal layer in loss function?

For a network of the form: Input(10) Dense(200) Dense(100+10) Dense(20) Output() Those +10 outputs are what I want to add to ...
1
vote
0answers
27 views

Is a true RNN auto encoder possible with Keras/TF

I want to get some encodings for temporal data (with a highly varying number of timesteps). The dataset is of the format: ...
-1
votes
0answers
29 views

is “riding” a polysemy? [closed]

If "riding" is not a polysemy, then what are its characteristics? We can say ride an elephant, ride a car, ride a horse, and ride a bike. The actions are the same but not necessarily have ...
1
vote
0answers
12 views

Extracting “hidden” costs from financial statements using NLP

I'm designing a NLP model to extract various kinds of "hidden" expenses from 10-K and 10-Q financial statements. I've come up with about 7 different expense categories (restructuring costs, ...
2
votes
0answers
32 views

How many papers about AI / ML were published in the recent years?

I am trying to formulate an argument at work saying the disruption in AI/ML is very high and that it is hard to stay "state of the art". I would like to support that hypothesis by numbers. ...
1
vote
0answers
12 views

Advice required for identifying bone fragments in CT-scans using STL Files (3D image segmentation)

I am working on a project related to automating the procedure of manually segmenting some bones in CT scans and hopefully if everything goes alright in this stage, move on to do something more with ...
2
votes
1answer
38 views

How to recover the target Q network's weights solely from the snapshots of the primary Q network's weights in DQN?

Suppose that I have a DQN agent, which has two neural networks: one is the primary Q network and the other is the target Q network. In every update, the target Q network is updated with a soft update ...
0
votes
0answers
27 views

What is the difference between learning agents and other kinds of agents, and more specifically, between performance standard and performance measure?

I am reading AI: A Modern Approach. In the 2nd chapter when introducing different agent types, i.e., reflex, utility-based, goal-based, and learning agents, I understood that all types of agents, ...
0
votes
0answers
3 views

How can we add complex preprocessing in AWS Sagemaker inference [closed]

I am using AWS Sagemaker to deploy my speech models trained outside of Sagemaker. I am able to convert my model into something Sagemaker would understand and have deployed it as an endpoint. Problem ...
5
votes
3answers
178 views

Does gradient descent in deep learning assume a smooth fitness landscape?

I've come across the concept of fitness landscape before and, in my understanding, a smooth fitness landscape is one where the algorithm can converge on the global optimum through incremental ...
0
votes
0answers
8 views

Keras memory allocation [closed]

I have been trying to build a deep learning model, using Keras as API with tensorflow 2.2 and cuda 102.89. My dataset is "relatively big" (27500 400x400 images) and so I've tried using both <...
1
vote
0answers
20 views

The MLP output of a neural network can be written as $\|x\|\|w_l\|\cos(\theta_l)$: why is the norm easier to maximize?

The MLP output of a neural network is a dot product between the weights and the input and therefore can be written as $\|x\|\|w_l\|\cos(\theta_l)$ (see this for more details), where $x$ is the input, $...
0
votes
0answers
11 views

AI in football for offside decisions [closed]

I saw this in the paper today: https://www.thetimes.co.uk/article/fifa-ready-to-use-automated-offsides-at-2022-world-cup-in-qatar-says-ars-ne-wenger-n0smzfrpj Any idea whether it will be effective? ...
1
vote
0answers
31 views

What is the output of neuron $y_{2}$ at time step $t$?

In Fundamentals of Neural Networks: Architectures, Algorithms And Applications by Laurene V. Fausett on $\text{Page:32}$ it describes Hot and Cold perception modeling with McCulloch-Pitts Net the ...
1
vote
0answers
24 views

Why do you calculate the mean and standard deviation over the complete dataset before training rather than for every batch?

In most implementations of neural networks the features are scaled to make the optimization of the loss function as stable as possible. Mostly a min-max scaler is used. Alternatively, there is also a ...
0
votes
0answers
10 views

How to make CNN to recognize whole picture, not just the details?

In my current project I use CNNs to analize plots (CNN autoencoders for feature extraction and KMeans for clusterization) and I get the feeling that these networks, can extract only features that are ...
-2
votes
0answers
9 views

The best cloud python platform for AI models by speed [closed]

I am searching for a platform that would allow me cloud computing for training AI models. Something similar like: Kaggle Kernal Colab Datalore -... 1. Reasone Speed I would like to have better speed ...
-1
votes
0answers
14 views

Is there any use of having connections between nodes in the output layer of a neural network?

Is there any use of having connections between nodes in the output layer of a neural network? In some cases some outputs may depend on other outputs; by this logic, is it possible to have such neural ...
1
vote
1answer
20 views

What would be the state of the art image captioning deep learning model?

I saw a couple of architectures, like CNN-LSTM, with and without attention model, use of Glove vector, self-critical models, etc. I am overwhelmed looking at different notebooks and architectures, ...
0
votes
0answers
6 views

Is it possible to use agent coordinates directly as part of the state

I am working on graph optimisation problem using DQN - the graph is represented as an adjacency matrix and an agent moves through this matrix removing edges between nodes (add a 0) or adding edges ...
1
vote
0answers
19 views

What are some strong algorithms for Perfect Information, Deterministic Multiplayer Games?

I have a series of games with the following properties: 3 or more players, but purely non-cooperative (i.e., no coalition forming); sequential moves; perfect information; deterministic state ...
0
votes
0answers
11 views

The Effect of Batch Size in CNN Image Classifier, Given Different Image Domain

I am currently training image classifiers on CelebA face attribute dataset (Binary classifiers), which will be used on images generated by StyleGAN (that is trained on FFHQ256 dataset). These ...
-2
votes
0answers
18 views

extract desire keyword/text pair

I am looking for extract keyword pair from text files. They might not be next to each other and do not have same pattern for each occurrence. And I would not think regex will works because there is no ...
-2
votes
0answers
10 views

Perform mini batch k means on large dataset of 16GB using pandas [closed]

I have a time series dataset of 16GB split into 200 files of 80MB each e.g. A1.csv to A200.csv. How do I perform mini-batch k means clustering on all these 200 files using pandas? Any sample source ...
-1
votes
0answers
9 views

Word2Vec: Identifying many-to-one relationships between words

Standard introductory examples in Word2Vec, like king - queen = man - woman and tokyo - japan = london - uk, involve one-to-one ...
1
vote
1answer
33 views

Is there a clustering algorithm that can make n clusters and the n+1 “others” cluster?

As far as I know all clustering algorithms assume that all delivered data points have to find its cluster. My question is, is there an algorithm that could focus only on n clusters (number stated by ...
0
votes
1answer
35 views

Is the policy gradient expression in Fundamentals of Deep Learning wrong?

I don't understand the policy gradient as explained in Chapter-9 (Deep Reinforcement Learning) of the book Fundamentals of deep learning. Here is the whole paragraph: Policy Learning via Policy ...
-1
votes
0answers
12 views

Extracting patterns from step data [closed]

I have step data for n people. What I am trying to achieve is to extract activities from the step data i.e. relate steps to activities. The primary goal is to fingerprint people based on step data. I ...
0
votes
0answers
16 views

PyTorch: How to deal with hidden states of an LSTM?

I have a time series in which each date is correlated with the preview one, and base on that I am trying to predict action 1 and action 2. But the problem is that I am not sure how to deal with the <...
-2
votes
1answer
31 views

Why the optimal Bellman operator of a Q-function can be approximated by a single point

I am currently studying reinforcement learning, especially DQN. In DQN, learning proceeds in such a way as to minimize the norm (least-squares, Huber, etc.) of the optimal Bellman equation and the ...
0
votes
0answers
17 views

Backpropagation in REINFORCE algorithms with Categorical / Multinomial Distribution

From a paper by Williams, I know in general how to backpropagate log-probabilities of chosen actions when applying the REINFORCE weight update rule. However, I was wondering about a case not being ...
-1
votes
0answers
25 views

About AI time traveling capability [closed]

Based of ai nature(needs to information and Calculayion unit) I guess, it could do the time traveling in the our univerese by finding some calculation unit for doing it's calculation and do its ...
0
votes
1answer
39 views

Must all CNNs and RNNs not have a fully connected layer in order to be considered as such?

In the paper Wrist-worn blood pressure tracking in healthy free-living individuals using neural networks, the authors talk about a combination of feed-forward and recurrent layers, as if FC layers ...
0
votes
1answer
41 views

Use Reinforcement Learning instead of genetic algorithm for optimization

I want to use RL instead of genetic or any other evolutionary algorithm in order to find the best parameter for a function. Here is the problem: Given a function $$f(x,y,z,data)$$ x,y and z are some ...

15 30 50 per page
1
2 3 4 5
172