Questions tagged [memory]

The tag has no usage guidance.

4 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
45 views

How does the memory mechanism (reading and writing) work in a neural Turing machine?

In neural Turing machine (NTM), reading memory is represented as \begin{align} r_t \leftarrow \sum\limits_i^R w_t(i) \mathcal{M}_t(i) \tag{2} \end{align} and writing to memory is represented as ...
2
votes
0answers
30 views

How much Physical memory does Alpha Zero's Neural Net require?

I appreciate that there are many ways to arrange the memory in a NN, and that the numerical representations may be with bytes to floats depending on an implementation. What is typical amount of ...
1
vote
2answers
93 views

How to calculate the GPU memory need to run a deep learning network?

In general, how do I calculate the GPU memory need to run a deep learning network? I'm asking this question because my training for some network configuration is getting out of memory. If the ...
1
vote
2answers
105 views

How to manage large amounts of image data for training?

Right now, I am trying to synthesize training images for a CNN and due to the nature of the application, there is a finite number of sample images to learn from. From other research, I expect to be ...