All Questions
1 question
5
votes
3
answers
6k
views
For an LLM model, how can I estimate its memory requirements based on storage usage?
It is easy to see the amount of disk space consumed by an LLM model (downloaded from huggingface, for instance). Just go in the relevant directory and check the file sizes.
How can I estimate the ...
- 191