Questions tagged [neural-turing-machine]
For questions related to the neural Turing machine model, proposed in "Neural Turing Machines" (2014) by Alex Graves et al.
5
questions
0
votes
1
answer
260
views
Reasoning behind performance improvement with hopfield networks
In the paper Hopfield networks is all you need, the authors mention that their modern Hopfield network layers are a good replacement for pooling, GRU, LSTM, and attention layers, and tend to ...
- 109
3
votes
0
answers
78
views
How does the memory mechanism (reading and writing) work in a neural Turing machine?
In neural Turing machine (NTM), reading memory is represented as
\begin{align}
r_t \leftarrow \sum\limits_i^R w_t(i) \mathcal{M}_t(i) \tag{2}
\end{align}
and writing to memory is represented as
...
- 1,036
2
votes
0
answers
275
views
What is a location-based addressing in a neural Turing machine?
In the neural Turing machine (NTM), the content-based addressing and location-based addressing is used for memory addressing. Content-based addressing is similar to the attention-based model, ...
- 21
13
votes
1
answer
2k
views
How would DeepMind's new differentiable neural computer scale?
DeepMind just published a paper about a differentiable neural computer, which basically combines a neural network with a memory.
The idea is to teach the neural network to create and recall useful ...
- 4,205
12
votes
2
answers
1k
views
How much of Deep Mind's work is actually reproducible?
DeepMind has published a lot of works on deep learning in the last years, most of them are state-of-the-art on their respective tasks. But how much of this work has actually been reproduced by the AI ...
- 2,099