Questions tagged [memory]
The memory tag has no usage guidance.
6
questions
3
votes
0answers
46 views
How does the memory mechanism (reading and writing) work in a neural Turing machine?
In neural Turing machine (NTM), reading memory is represented as
\begin{align}
r_t \leftarrow \sum\limits_i^R w_t(i) \mathcal{M}_t(i) \tag{2}
\end{align}
and writing to memory is represented as
...
2
votes
0answers
30 views
How much Physical memory does Alpha Zero's Neural Net require?
I appreciate that there are many ways to arrange the memory in a NN, and that the numerical representations may be with bytes to floats depending on an implementation. What is typical amount of ...
1
vote
1answer
71 views
Does a data structure that models the encoding specificity principle in memory exist?
I find myself wondering if there exists a data structure with the following properties:
Stores information
Conforms to the encoding specificity principle
1
vote
1answer
67 views
How can a specific connectivity pattern be stored in an optimally compact representation?
I am interested in optimizing the memory capacity of an AGI. Given a specific complex input an AI can create a simplified model. This is a problem that can be solved using sparse coding [1]. However, ...
1
vote
2answers
101 views
How to calculate the GPU memory need to run a deep learning network?
In general, how do I calculate the GPU memory need to run a deep learning network?
I'm asking this question because my training for some network configuration is getting out of memory.
If the ...
1
vote
2answers
105 views
How to manage large amounts of image data for training?
Right now, I am trying to synthesize training images for a CNN and due to the nature of the application, there is a finite number of sample images to learn from.
From other research, I expect to be ...
