Questions tagged [neural-turing-machine]
For questions related to the neural Turing machine model, proposed in "Neural Turing Machines" (2014) by Alex Graves et al.
4
questions
0
votes
1answer
48 views
Reasoning behind performance improvement with hopfield networks
In the paper Hopfield networks is all you need, the authors mention that their modern Hopfield network layers are a good replacement for pooling, GRU, LSTM, and attention layers, and tend to ...
12
votes
1answer
2k views
How would DeepMind's new differentiable neural computer scale?
DeepMind just published a paper about a differentiable neural computer, which basically combines a neural network with a memory.
The idea is to teach the neural network to create and recall useful ...
3
votes
0answers
46 views
How does the memory mechanism (reading and writing) work in a neural Turing machine?
In neural Turing machine (NTM), reading memory is represented as
\begin{align}
r_t \leftarrow \sum\limits_i^R w_t(i) \mathcal{M}_t(i) \tag{2}
\end{align}
and writing to memory is represented as
...
2
votes
0answers
131 views
What is a location-based addressing in a neural Turing machine?
In the neural Turing machine (NTM), the content-based addressing and location-based addressing is used for memory addressing. Content-based addressing is similar to the attention-based model, ...
