Questions tagged [long-short-term-memory]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
2
votes
0answers
30 views

Why experience reply memory in DQN instead of a RNN memory?

I was trying to implement a DQN without experience reply memory, and the agent is not learning anything at all. I know from readings that experience reply is used for stabilizing gradients. But how ...
1
vote
1answer
38 views

Neurological interpretation of LSTMs

I am searching for an Interpretation of LSTMs and recurrent neural Networks within Cognitive Neuroscience. Is there a mechanism in the human brain, that works analog to LSTMs? How does Long-term ...
1
vote
2answers
185 views

What should I do when I have a variable-length sequence when instantiating an LSTM in Keras?

In keras, when we use an LSTM/RNN model, we need to specify the node [i.e., LSTM(128)]. I have a doubt regarding how it actually works. From the LSTM/RNN unfolding image or description, I found that ...
1
vote
2answers
118 views

Are artificial networks based on the perceptron design inherently limiting?

At the time when the basic building blocks of machine learning (the perceptron layer and the convolution kernel) were invented, the model of the neuron in the brain taught at the university level was ...
1
vote
0answers
25 views

Has anyone investigated iteration awareness beyond RNN and LSTM?

This question considers the convergence of an artificial networks (MLPs, RNNs, LSTM nets, CNNs) over time or over the course of epochs made up of iterations through training examples. In this ...
4
votes
1answer
533 views

Will attention based networks prevail over RNN and LSTM?

There is no point in picking one of the growing number of articles that come up in a web search for, "Deep learning attention networks," however the bold claims in Attention Is All You Need, Ashish ...