All Questions
Tagged with gpu hardware-evaluation
2 questions
5
votes
3
answers
6k
views
For an LLM model, how can I estimate its memory requirements based on storage usage?
It is easy to see the amount of disk space consumed by an LLM model (downloaded from huggingface, for instance). Just go in the relevant directory and check the file sizes.
How can I estimate the ...
- 191
1
vote
2
answers
6k
views
Does fp32 & fp64 performance of GPU affect deep learning model training? [closed]
I am purchasing Titan RTX GPU. Everything seems fine with that except float32 & float64 performance which seems lower vis-a-vis some of its counter parts. I wanted to understand if single ...
- 325