Questions tagged [hardware-evaluation]

Use for objective evaluations and assessments of computing devices and components, including CPUs, GPUs, etc., based on architecture and performance statistics. Opinions may be suitable for comments, but not for formal answers.

Filter by
Sorted by
Tagged with
4 votes
2 answers
2k views

For an LLM model, how can I estimate its memory requirements based on storage usage?

It is easy to see the amount of disk space consumed by an LLM model (downloaded from huggingface, for instance). Just go in the relevant directory and check the file sizes. How can I estimate the ...
ahron's user avatar
  • 171
-1 votes
1 answer
66 views

What amount of ressources is involved in building an image recognition system? [closed]

I would like to have an order of magnitude of ressources required to build an image recognition system. Let say you want to build a startup company which main product will have to distinguish 20 ...
bokan's user avatar
  • 389
11 votes
1 answer
9k views

What is the reason AMD Radeon is not widely used for machine learning and deep learning? [closed]

What is the reason AMD Radeon is not widely used for machine learning and deep learning? Is it mainly an issue of lack of software? Or is Radeon's GPU not as good as NVIDIA's?
noviceFedora's user avatar
1 vote
2 answers
5k views

Does fp32 & fp64 performance of GPU affect deep learning model training? [closed]

I am purchasing Titan RTX GPU. Everything seems fine with that except float32 & float64 performance which seems lower vis-a-vis some of its counter parts. I wanted to understand if single ...
Ruchit Dalwadi's user avatar
4 votes
1 answer
1k views

What are the minimum computing resources needed to train a machine learning algorithm?

For a school project, I would like to investigate a paper on either reinforcement learning or computer vision. I am particularly interested in DQN, RNNs, CNNs or LSTMs. I would eventually like to ...
Wizard's user avatar
  • 303
5 votes
3 answers
14k views

Can I do deep learning with the 1060 or the 1070 ti? [closed]

Before I start, I want to let you know that I am completely new to the field of deep learning! Since I need a new graphics card either way (gaming you know) I am thinking about buying the GTX 1060 ...
S.Matthias's user avatar
11 votes
3 answers
2k views

What size of neural networks can be trained on current consumer grade GPUs? (1060,1070,1080)

Is it possible to give a rule of thumb estimate about the size of neural networks that are trainable on common consumer-grade GPUs? For example, the Emergence of Locomotion (Reinforcement) paper ...
pascalwhoop's user avatar
3 votes
2 answers
295 views

What is the difference between a normal processor and a processor designed for AI?

What is the difference between a normal processor and a processor designed for AI?
user avatar
3 votes
1 answer
258 views

What type of reinforcement learning can I do restricted to ~200MB on an average smartphone?

This concerns a set of finite, non-trivial, combinatorial games [M] in the form of an app. A sample game can be found here. Because this is a mass market product, we can't take up too much space, ...
DukeZhou's user avatar
  • 6,237
6 votes
2 answers
954 views

In 2016, can $1000.00 buy enough operations per second to be approximately equal to the computational power of a human brain?

In The Age of Spiritual Machines (1999), Ray Kurzweil predicted that in 2009, a \$1000 computing device would be able to perform a trillion operations per second. Additionally, he claimed that in 2019,...
DJG's user avatar
  • 173