# All Questions

9,850 questions
Filter by
Sorted by
Tagged with
9 views

### Reduction of state space of the game Connect Four to apply RL algorithms SARSA and Q-Learning

I would like to implement the reinforcement learning algorithms SARSA and Q-Learning for the board game Connect Four. I am familiar with the algorithms and know about their limitations regarding large ...
4 views

### What is remembering in Hopfield network?

Hopfield is a simple and traditional network. We feed into the network some patterns (Learning/Training). Actually there is no training in Hopfield as the weight calculation is just adding up all the ...
15 views

### How do I use machine learning to create an optimization algorithm?

Let's say that I want to create an optimization algorithm, which is supposed to find an optimum value for a given objective function. Creating an optimization algorithm to explore through the search ...
9 views

### Is there a way to adapt Particle Swarm Optimization to an incremental/online learning setting?

As stated in the title, is there a way to adapt PSO to an online scenario where new data samples arrive continuously? In more detail: suppose that I have a classifier with several parameters for which ...
9 views

### Picking Order with expert knowledge: Modeling issues

I want to guess the optimal picking order. The orders have 10-50 positions and the optimal picking order not available. (The picking order depends on several things: (not every box is stackable; some ...
7 views

### Which software or app using IBM Watson or LUIS as voice assistant to chat and answer question?

Which software or app using IBM Watson or Microsoft LUIS or open-ai as voice assistant to chat and answer question? Is there a list of these product names? How can they have basic chat knowledge like ...
18 views

### How many epochs should I iterate for tuning an ANN?

I have been using Keras-Tuner for tuning my ANN before going into training. The tuner seems to be iterating forever even though I set a limit of 1000 epochs. After that, I have decided to terminate ...
14 views

### Encoding Image Priors into CNN

There's a core problem with all of ML which I haven't really seen made explicit: the issue is every model needs to have an assumption on the structure of the data you learn and this assumption needs ...
13 views

### [SOLVED]Backward pass with a layer of neurons and a batch of samples - I don't understand the example in the book - Need help understanding

Two great guys on reddit explained this problem to me. I'm leaving link to reddit post incase someone in the future will have the same problem :) [SOLVED] https://www.reddit.com/r/neuralnetworks/...
12 views

### What are some applications of virtual try-on other than in the fashion industry?

I've been considering doing research in virtual try-on technology. There are various computer vision techniques that go into this, but I was wondering if there is any potential application of virtual ...
23 views

### Does anti-time prove simulation theory? [closed]

Anti-time is analogous to anti-matter. Postulate the concept of anti-time. How would anti-time effect space time? If anti-time was possible and that proves that the universe doesn’t exist, then wouldn’...
43 views

### Why is val accuracy 100% within 2 epochs and incorrectly predicting new images? (1,000 images per class when training)

My CNN tensorflow model reports 100% validation accuracy within 2 epochs. But it incorrectly predicts on single new images. (It is multiclass problem. I have 3 classes). How to resolve this? Can you ...
18 views

### How to predict using softmax having separate inputs and outputs?

I am new to Deep Learning. Having completed the coursera courses and read something from Deep Learning with Python, I am trying to implement one idea using DL. There is a number of user equipment (UE) ...
9 views

### Why batch normalization before upsampling is giving worse results?

I am training a model to generate images. I am applying the batch normalization layers just before upsampling and I am not getting the results that are at least comparable to the results by the model ...
15 views

### 320 x 200 Pixelfield as ScreenView for optical recognition - with rotation in SBCL LISP? [closed]

Hello LISP users / programmers, How could it be see/work about the question topic ? How could I compare two black white pictures with forms or lines ? A picture is available as 2D-Array - each Byte a ...
28 views

### OpenAI Gym changes: Where is "PongNoFrameskip-v4" now? [closed]

Pong is one of the Reinforcement Learning environments that demonstrated the ability of deep RL methods to solve control problems in really massive state spaces. Hence there are probably 20-30 ...
31 views

### How do I calculate the number of trainable parameters of an LSTM model?

I am currently learning about LSTMs, and I was working through this tutorial. I created a network with an LSTM layer just as described in the tutorial: ...
13 views

### How to find the accuracy of LDA model?

I am working on topic modeling using the latent Dirichlet allocation model. I have a dataset that contains tweets and topics corresponding to these tweets. In total, there are 65 different topics. I ...
24 views

### What is the stride information of an image referring here?

In convolutional neural networks, the convolution and pooling operations have a parameter known as stride, which decides the jump the kernel needs to do on the input image. You can get more ...
29 views

### What are the approaches towards developing self-aware programs? [closed]

Thanks for giving comment. I want to ask that whether a program that is executing can be able to adapt to the external environment it operates? Also can this program be also aware of its internal ...
36 views

### Why do Transformers have a sequence limit at inference time?

As far as I understand, Transformer's time complexity increases quadratically with respect to the sequence length. As a result, during training to make training feasible, a maximum sequence limit is ...
26 views

### Are derived or computed inputs bad for CNNs?

I am building a CNN and am wondering if inputting derived or computed inputs are generally bad for the effectiveness of CNNs? Or just NNs in general? By derived or computed values I mean data that is ...
16 views

### What loss function should be used for negative log likelihood labels

I am trying to build a ranking CNN model for document - query pairs using MS Marco dataset and python pytorch. My supervisor suggested to use the same CNN to extract feature vector for document and ...
11 views

### tfp.Distributions.Categorical.sample() is picking the same action everytime after certain iterations

I have written a code for an RL agent such that at each state the model calculates the probabilities of all possible actions and samples one action randomly to proceed further. To acheive this, I have ...
14 views

### Custom LRscheduler and val loss logging in detectron2 [closed]

I want to add validation loss logging in the training process of detectron2 MRCNN. I also want to add a LR scheduler in the process as the inbuilt one is multiplier. I have configured the code for ...
19 views

### FrozenLake-v0 not training using REINFORCE

I am implementing a simple REINFORCE (policy gradient) algorithm for openAI's FrozenLake-v0 environment. However, it does not seem to learn anything at all. I have used the same neural architecture ...
37 views

### Are there neural networks with (hard) constraints on the weights?

I don't know too much about Deep Learning, so my question might be silly. However, I was wondering whether there are NN architectures with some hard constraints on the weights of some layers. For ...
55 views

### Are Genetic Algorithms suitable for a problem with a non-unique optimal solution?

I was wondering if a genetic algorithm is useful if the optimization problem has several optimal solutions. My thought was that I should not use it since when combining two members of a population who ...
20 views

### dDQN converges, but makes suboptimal decisions that are mainly focused on retrieving short-term reward

I use a dDQN to dispatch drivers in a ride-hailing environment. The action space has size (#drivers + 1), which means we can choose one of the drivers or choose to refuse an order (and wait for the ...
20 views

### How to properly evaluate RL agents while varying evaluation environments?

I am using Stable-Baselines and my goal is to have agents rank a list of items (or rather, put the relevant items on top), similarly to what learning to rank algorithms (e.g. lambdarank) do as part of ...
18 views

### How can I initialize KerasTuner with a specific setting? [closed]

My situation is like this: I have started ten Keras-Tuner jobs in a machine 'A' that doesn't have a GPU and has a lesser number of CPU cores. These jobs are still running. How my P.I. tells me to ...
17 views

### Rank of gradient-of-loss with respect to layer weights in an MLP

The paper: https://arxiv.org/abs/2110.11309, makes the following claim at the end of page 3: The gradient of loss $L$ with respect to weights $W_l$ of an MLP is a rank-1 matrix for each of B batch ...
29 views

### What is the time complexity of DDPG algorithm?

Suppose we have a DDPG algorithm. The actor has N input nodes, two hidden layers with J nodes, and S output nodes. The critic has N+S input nodes, two hidden layers with C nodes, and one output node. ...
51 views

### Why is there tanh(x)*sigmoid(x) in a LSTM cell?

CONTEXT I was wondering why there are sigmoid and tanh activation functions in an LSTM cell. My intuition was based on the flow of tanh(x)*sigmoid(x) and the ...
25 views

### Why am I getting a very small number as CNN prediction?

I created a CNN using Tensorflow to identify pneumonia and sometimes it returns a very small number as a prediction. why is this happening? I have attached the link for the dataset Here I how I ...
21 views

### Using NLP embeddings in trajectory or motion planning of autonomous system

I am planning to use textual rules like traffic rules in motion planning of autonomous car. I can think of using BERT like models to generate embeddings and then use these embeddings for motion or ...
28 views

### How much labelling is required for NER with SpaCy?

I have transaction data and I would like to extract the merchant from the transaction description. I am new to this but I just came across Named Entity Recognition and SpaCy. I have hundreds of ...
20 views

### What does it mean to apply decomposition at inference-time in a machine translation system?

I'm reading this paper for sub-character decomposition for logographic languages and the authors mention decomposition at inference-time. They're using Transformer architecture. More specifically, the ...
31 views

### Classification Error Rate (CER) and Frame Error Rate (FER) calculation [closed]

I'm running speaker recognition experiment with Librispeech dataset I've trained the model but unfortunately I didn't know how to calculate the Classification Error Rate (CER) and Frame Error Rate (...
93 views

### Do we use validation and test sets for training a reinforcement learning agent?

I am pretty new to reinforcement learning and was working with some code for the PPO and DQN algorithms. After looking at the code, I noticed that the authors did not include any code to setup a ...
36 views

### Which algorithms are used to locate objects in a 3d space?

I can see mobile apps that can locate a 3D object on a surface with a mobile camera and you can turn around that object. What is the name of the algorithm(s) that is used for that purpose? Or, is ...
34 views

### Use soft-max post-training for a ReLU trained network?

For a project, I've trained multiple networks for multiclass classification all ending with a ReLU activation at the output. Now the output logits are not probabilities. Is it valid to get the ...
24 views

### How to build an expert system similar to ES-Builder Web

I made a simple expert system using ES-Builder. Please click the link to view it. ES-Builder is a web-based expert system shell. There is a tree-based knowledge representation. In ES builder, User ...
25 views

### Test accuracy decreases during my train process

I want to train a neural network model with the arcface loss function and try to combine it with domain adaption. But when the training process continues, I find the test accuracy first increases and ...
34 views

### General approaches in text encoding and labelling for NLP [closed]

What are the approaches of encoding text data? I would be glad to hear some summarization from experienced persons. And are there any solutions accepting words outside the vocabulary and including ...
37 views

### Predicting height of a person using one image [closed]

I need help with trying to find why this algorithm is not working I am trying to predict the height of a person from a single picture this will be able to help us predict the height without multiple ...
39 views

### Is it a bad practice to use cumulative rewards in reinforcement learning

I am using a DDPG agent for doing prediction on the position on an asset in a stock trading-like environment. I am using the cumulative reward as the reward for each timestep. Since it is trained over ...
27 views

### Feature Extraction for printer classification

I need some advice. I am currently trying to do a printer classification with ML/DL. What do I have? 11 colored-images with high resolution from 8 different inkjet-printers (in total 88 images) I have ...
73 views

### What is the "temperature" in the GPT models?

What does the temperature parameter mean when talking about the GPT models? I know that a higher temperature value means more randomness, but I want to know how randomness is introduced. Does ...
27 views

### Why would this classifier overfit the data?

Suppose we have a boosted decision tree (let's say tree depth is 1) and we have mislabeled data in our training set. Why would the classifier overfit the data? My intuition is that after each ...

15 30 50 per page