Questions tagged [neural-turing-machine]
For questions related to the neural Turing machine model, proposed in "Neural Turing Machines" (2014) by Alex Graves et al.
5
questions
0
votes
1answer
66 views
Reasoning behind performance improvement with hopfield networks
In the paper Hopfield networks is all you need, the authors mention that their modern Hopfield network layers are a good replacement for pooling, GRU, LSTM, and attention layers, and tend to ...
3
votes
0answers
47 views
How does the memory mechanism (reading and writing) work in a neural Turing machine?
In neural Turing machine (NTM), reading memory is represented as
\begin{align}
r_t \leftarrow \sum\limits_i^R w_t(i) \mathcal{M}_t(i) \tag{2}
\end{align}
and writing to memory is represented as
...
2
votes
0answers
166 views
What is a location-based addressing in a neural Turing machine?
In the neural Turing machine (NTM), the content-based addressing and location-based addressing is used for memory addressing. Content-based addressing is similar to the attention-based model, ...
12
votes
1answer
2k views
How would DeepMind's new differentiable neural computer scale?
DeepMind just published a paper about a differentiable neural computer, which basically combines a neural network with a memory.
The idea is to teach the neural network to create and recall useful ...
11
votes
2answers
927 views
How much of Deep Mind's work is actually reproducible?
DeepMind has published a lot of works on deep learning in the last years, most of them are state-of-the-art on their respective tasks. But how much of this work has actually been reproduced by the AI ...
