All Questions

Filter by
Sorted by
Tagged with
1
vote
0answers
9 views

Reduction of state space of the game Connect Four to apply RL algorithms SARSA and Q-Learning

I would like to implement the reinforcement learning algorithms SARSA and Q-Learning for the board game Connect Four. I am familiar with the algorithms and know about their limitations regarding large ...
0
votes
0answers
4 views

What is remembering in Hopfield network?

Hopfield is a simple and traditional network. We feed into the network some patterns (Learning/Training). Actually there is no training in Hopfield as the weight calculation is just adding up all the ...
1
vote
1answer
15 views

How do I use machine learning to create an optimization algorithm?

Let's say that I want to create an optimization algorithm, which is supposed to find an optimum value for a given objective function. Creating an optimization algorithm to explore through the search ...
0
votes
0answers
9 views

Is there a way to adapt Particle Swarm Optimization to an incremental/online learning setting?

As stated in the title, is there a way to adapt PSO to an online scenario where new data samples arrive continuously? In more detail: suppose that I have a classifier with several parameters for which ...
0
votes
0answers
9 views

Picking Order with expert knowledge: Modeling issues

I want to guess the optimal picking order. The orders have 10-50 positions and the optimal picking order not available. (The picking order depends on several things: (not every box is stackable; some ...
0
votes
0answers
7 views

Which software or app using IBM Watson or LUIS as voice assistant to chat and answer question?

Which software or app using IBM Watson or Microsoft LUIS or open-ai as voice assistant to chat and answer question? Is there a list of these product names? How can they have basic chat knowledge like ...
0
votes
0answers
18 views

How many epochs should I iterate for tuning an ANN?

I have been using Keras-Tuner for tuning my ANN before going into training. The tuner seems to be iterating forever even though I set a limit of 1000 epochs. After that, I have decided to terminate ...
0
votes
0answers
14 views

Encoding Image Priors into CNN

There's a core problem with all of ML which I haven't really seen made explicit: the issue is every model needs to have an assumption on the structure of the data you learn and this assumption needs ...
0
votes
0answers
13 views

[SOLVED]Backward pass with a layer of neurons and a batch of samples - I don't understand the example in the book - Need help understanding

Two great guys on reddit explained this problem to me. I'm leaving link to reddit post incase someone in the future will have the same problem :) [SOLVED] https://www.reddit.com/r/neuralnetworks/...
0
votes
0answers
12 views

What are some applications of virtual try-on other than in the fashion industry?

I've been considering doing research in virtual try-on technology. There are various computer vision techniques that go into this, but I was wondering if there is any potential application of virtual ...
-2
votes
0answers
23 views

Does anti-time prove simulation theory? [closed]

Anti-time is analogous to anti-matter. Postulate the concept of anti-time. How would anti-time effect space time? If anti-time was possible and that proves that the universe doesn’t exist, then wouldn’...
0
votes
0answers
43 views

Why is val accuracy 100% within 2 epochs and incorrectly predicting new images? (1,000 images per class when training)

My CNN tensorflow model reports 100% validation accuracy within 2 epochs. But it incorrectly predicts on single new images. (It is multiclass problem. I have 3 classes). How to resolve this? Can you ...
0
votes
0answers
18 views

How to predict using softmax having separate inputs and outputs?

I am new to Deep Learning. Having completed the coursera courses and read something from Deep Learning with Python, I am trying to implement one idea using DL. There is a number of user equipment (UE) ...
0
votes
0answers
9 views

Why batch normalization before upsampling is giving worse results?

I am training a model to generate images. I am applying the batch normalization layers just before upsampling and I am not getting the results that are at least comparable to the results by the model ...
-1
votes
0answers
15 views

320 x 200 Pixelfield as ScreenView for optical recognition - with rotation in SBCL LISP? [closed]

Hello LISP users / programmers, How could it be see/work about the question topic ? How could I compare two black white pictures with forms or lines ? A picture is available as 2D-Array - each Byte a ...
0
votes
0answers
28 views

OpenAI Gym changes: Where is "PongNoFrameskip-v4" now? [closed]

Pong is one of the Reinforcement Learning environments that demonstrated the ability of deep RL methods to solve control problems in really massive state spaces. Hence there are probably 20-30 ...
2
votes
0answers
31 views

How do I calculate the number of trainable parameters of an LSTM model?

I am currently learning about LSTMs, and I was working through this tutorial. I created a network with an LSTM layer just as described in the tutorial: ...
0
votes
0answers
13 views

How to find the accuracy of LDA model?

I am working on topic modeling using the latent Dirichlet allocation model. I have a dataset that contains tweets and topics corresponding to these tweets. In total, there are 65 different topics. I ...
2
votes
1answer
24 views

What is the stride information of an image referring here?

In convolutional neural networks, the convolution and pooling operations have a parameter known as stride, which decides the jump the kernel needs to do on the input image. You can get more ...
0
votes
0answers
29 views

What are the approaches towards developing self-aware programs? [closed]

Thanks for giving comment. I want to ask that whether a program that is executing can be able to adapt to the external environment it operates? Also can this program be also aware of its internal ...
2
votes
1answer
36 views

Why do Transformers have a sequence limit at inference time?

As far as I understand, Transformer's time complexity increases quadratically with respect to the sequence length. As a result, during training to make training feasible, a maximum sequence limit is ...
0
votes
1answer
26 views

Are derived or computed inputs bad for CNNs?

I am building a CNN and am wondering if inputting derived or computed inputs are generally bad for the effectiveness of CNNs? Or just NNs in general? By derived or computed values I mean data that is ...
0
votes
0answers
16 views

What loss function should be used for negative log likelihood labels

I am trying to build a ranking CNN model for document - query pairs using MS Marco dataset and python pytorch. My supervisor suggested to use the same CNN to extract feature vector for document and ...
0
votes
0answers
11 views

tfp.Distributions.Categorical.sample() is picking the same action everytime after certain iterations

I have written a code for an RL agent such that at each state the model calculates the probabilities of all possible actions and samples one action randomly to proceed further. To acheive this, I have ...
0
votes
0answers
14 views

Custom LRscheduler and val loss logging in detectron2 [closed]

I want to add validation loss logging in the training process of detectron2 MRCNN. I also want to add a LR scheduler in the process as the inbuilt one is multiplier. I have configured the code for ...
0
votes
0answers
19 views

FrozenLake-v0 not training using REINFORCE

I am implementing a simple REINFORCE (policy gradient) algorithm for openAI's FrozenLake-v0 environment. However, it does not seem to learn anything at all. I have used the same neural architecture ...
3
votes
0answers
37 views

Are there neural networks with (hard) constraints on the weights?

I don't know too much about Deep Learning, so my question might be silly. However, I was wondering whether there are NN architectures with some hard constraints on the weights of some layers. For ...
2
votes
1answer
55 views

Are Genetic Algorithms suitable for a problem with a non-unique optimal solution?

I was wondering if a genetic algorithm is useful if the optimization problem has several optimal solutions. My thought was that I should not use it since when combining two members of a population who ...
0
votes
0answers
20 views

dDQN converges, but makes suboptimal decisions that are mainly focused on retrieving short-term reward

I use a dDQN to dispatch drivers in a ride-hailing environment. The action space has size (#drivers + 1), which means we can choose one of the drivers or choose to refuse an order (and wait for the ...
0
votes
0answers
20 views

How to properly evaluate RL agents while varying evaluation environments?

I am using Stable-Baselines and my goal is to have agents rank a list of items (or rather, put the relevant items on top), similarly to what learning to rank algorithms (e.g. lambdarank) do as part of ...
0
votes
0answers
18 views

How can I initialize KerasTuner with a specific setting? [closed]

My situation is like this: I have started ten Keras-Tuner jobs in a machine 'A' that doesn't have a GPU and has a lesser number of CPU cores. These jobs are still running. How my P.I. tells me to ...
0
votes
0answers
17 views

Rank of gradient-of-loss with respect to layer weights in an MLP

The paper: https://arxiv.org/abs/2110.11309, makes the following claim at the end of page 3: The gradient of loss $L$ with respect to weights $W_l$ of an MLP is a rank-1 matrix for each of B batch ...
0
votes
0answers
29 views

What is the time complexity of DDPG algorithm?

Suppose we have a DDPG algorithm. The actor has N input nodes, two hidden layers with J nodes, and S output nodes. The critic has N+S input nodes, two hidden layers with C nodes, and one output node. ...
2
votes
1answer
51 views

Why is there tanh(x)*sigmoid(x) in a LSTM cell?

CONTEXT I was wondering why there are sigmoid and tanh activation functions in an LSTM cell. My intuition was based on the flow of tanh(x)*sigmoid(x) and the ...
0
votes
0answers
25 views

Why am I getting a very small number as CNN prediction?

I created a CNN using Tensorflow to identify pneumonia and sometimes it returns a very small number as a prediction. why is this happening? I have attached the link for the dataset Here I how I ...
0
votes
0answers
21 views

Using NLP embeddings in trajectory or motion planning of autonomous system

I am planning to use textual rules like traffic rules in motion planning of autonomous car. I can think of using BERT like models to generate embeddings and then use these embeddings for motion or ...
0
votes
0answers
28 views

How much labelling is required for NER with SpaCy?

I have transaction data and I would like to extract the merchant from the transaction description. I am new to this but I just came across Named Entity Recognition and SpaCy. I have hundreds of ...
0
votes
1answer
20 views

What does it mean to apply decomposition at inference-time in a machine translation system?

I'm reading this paper for sub-character decomposition for logographic languages and the authors mention decomposition at inference-time. They're using Transformer architecture. More specifically, the ...
-2
votes
0answers
31 views

Classification Error Rate (CER) and Frame Error Rate (FER) calculation [closed]

I'm running speaker recognition experiment with Librispeech dataset I've trained the model but unfortunately I didn't know how to calculate the Classification Error Rate (CER) and Frame Error Rate (...
4
votes
1answer
93 views

Do we use validation and test sets for training a reinforcement learning agent?

I am pretty new to reinforcement learning and was working with some code for the PPO and DQN algorithms. After looking at the code, I noticed that the authors did not include any code to setup a ...
4
votes
0answers
36 views

Which algorithms are used to locate objects in a 3d space?

I can see mobile apps that can locate a 3D object on a surface with a mobile camera and you can turn around that object. What is the name of the algorithm(s) that is used for that purpose? Or, is ...
2
votes
0answers
34 views

Use soft-max post-training for a ReLU trained network?

For a project, I've trained multiple networks for multiclass classification all ending with a ReLU activation at the output. Now the output logits are not probabilities. Is it valid to get the ...
2
votes
0answers
24 views

How to build an expert system similar to ES-Builder Web

I made a simple expert system using ES-Builder. Please click the link to view it. ES-Builder is a web-based expert system shell. There is a tree-based knowledge representation. In ES builder, User ...
2
votes
1answer
25 views

Test accuracy decreases during my train process

I want to train a neural network model with the arcface loss function and try to combine it with domain adaption. But when the training process continues, I find the test accuracy first increases and ...
2
votes
1answer
34 views

General approaches in text encoding and labelling for NLP [closed]

What are the approaches of encoding text data? I would be glad to hear some summarization from experienced persons. And are there any solutions accepting words outside the vocabulary and including ...
0
votes
0answers
37 views

Predicting height of a person using one image [closed]

I need help with trying to find why this algorithm is not working I am trying to predict the height of a person from a single picture this will be able to help us predict the height without multiple ...
0
votes
1answer
39 views

Is it a bad practice to use cumulative rewards in reinforcement learning

I am using a DDPG agent for doing prediction on the position on an asset in a stock trading-like environment. I am using the cumulative reward as the reward for each timestep. Since it is trained over ...
2
votes
1answer
27 views

Feature Extraction for printer classification

I need some advice. I am currently trying to do a printer classification with ML/DL. What do I have? 11 colored-images with high resolution from 8 different inkjet-printers (in total 88 images) I have ...
4
votes
1answer
73 views

What is the "temperature" in the GPT models?

What does the temperature parameter mean when talking about the GPT models? I know that a higher temperature value means more randomness, but I want to know how randomness is introduced. Does ...
0
votes
0answers
27 views

Why would this classifier overfit the data?

Suppose we have a boosted decision tree (let's say tree depth is 1) and we have mislabeled data in our training set. Why would the classifier overfit the data? My intuition is that after each ...

15 30 50 per page
1
2 3 4 5
197