Questions tagged [neural-turing-machine]

For questions related to the neural Turing machine model, proposed in "Neural Turing Machines" (2014) by Alex Graves et al.

Filter by
Sorted by
Tagged with
0 votes
1 answer
260 views

Reasoning behind performance improvement with hopfield networks

In the paper Hopfield networks is all you need, the authors mention that their modern Hopfield network layers are a good replacement for pooling, GRU, LSTM, and attention layers, and tend to ...
Rijul Gupta's user avatar
3 votes
0 answers
78 views

How does the memory mechanism (reading and writing) work in a neural Turing machine?

In neural Turing machine (NTM), reading memory is represented as \begin{align} r_t \leftarrow \sum\limits_i^R w_t(i) \mathcal{M}_t(i) \tag{2} \end{align} and writing to memory is represented as ...
Eka's user avatar
  • 1,036
2 votes
0 answers
275 views

What is a location-based addressing in a neural Turing machine?

In the neural Turing machine (NTM), the content-based addressing and location-based addressing is used for memory addressing. Content-based addressing is similar to the attention-based model, ...
eno's user avatar
  • 21
13 votes
1 answer
2k views

How would DeepMind's new differentiable neural computer scale?

DeepMind just published a paper about a differentiable neural computer, which basically combines a neural network with a memory. The idea is to teach the neural network to create and recall useful ...
BlindKungFuMaster's user avatar
12 votes
2 answers
1k views

How much of Deep Mind's work is actually reproducible?

DeepMind has published a lot of works on deep learning in the last years, most of them are state-of-the-art on their respective tasks. But how much of this work has actually been reproduced by the AI ...
rcpinto's user avatar
  • 2,099