Questions tagged [hardware]
For questions involving, but not exclusively about, hardware. (Please use the "hardware-evaluation" for questions exclusively about analysis of hardware components.)
28
questions
1
vote
0
answers
64
views
Inference process and flow, and role of GPU, CPU, and RAM [closed]
This is a noob question.
I load a HuggingFace transformer model into GPU and create a HuggingFace pipeline using that model. Then I run inference on the model using the pipeline.
I would be glad to ...
- 151
0
votes
2
answers
257
views
LUT-Based Sigmoid and Tanh Activation-Functions in Integer Quantized Networks
I want to understand how activation functions, specifically tanh and sigmoid, are used in int8 quantized neural networks. Even more specific, I want to understand a Look-up-Table based approach.
My ...
- 3
0
votes
0
answers
70
views
Choosing the most appropriate neural network type
I want to use deep learning to improve cache hit rate. Let me explain a few basic principles of the cache.
Each cache entry can have one of two different priorities. The priorities decide when that ...
- 1
3
votes
2
answers
2k
views
For an LLM model, how can I estimate its memory requirements based on storage usage?
It is easy to see the amount of disk space consumed by an LLM model (downloaded from huggingface, for instance). Just go in the relevant directory and check the file sizes.
How can I estimate the ...
- 151
0
votes
0
answers
578
views
Do tensor cores provide advantages for running Stable Diffusion or only for training?
If I am only interested in running Stable Diffusion, using pre-trained weights, to generate images, are there any advantages to using a GPU with more Tensor cores? Or will any CUDA-compatible GPU ...
- 101
1
vote
1
answer
60
views
Why training the same model on the same data can be slower on better card?
Can someone explain why training CNN model (in my case DenseNet201) on the same data, and the same data processing pipeline can be slower on better GPU (RTX3090) than worse one (RTX3060), with the ...
- 1,240
1
vote
1
answer
27
views
What kind of NN I need to find ideal ranges and correlation between them?
I’m new to NN and I’m trying to collect material and study. I’m getting through a general high level book, but I’m still struggling understanding what kind of NN I should go ‘deeper into’ for what is ...
- 113
1
vote
0
answers
221
views
Difference between TPU and VPU
There are these two concepts of ASICs for the usage for neural networks.
The one is called Tensor Processing Unit (TPU) and the other one is called a Vision Processing Unit (VPU). How do they differ ...
- 11
3
votes
1
answer
1k
views
What exactly is an XPU?
I know about CPU, GPU and TPU. But, it is the first time for me to read about XPU from PyTorch documentation about MODULE.
...
- 3,612
1
vote
0
answers
32
views
How does optical computing work and deal with nonlinearity?
This article states that:
One of the algorithms that photonics is very good at implementing is matrix multiplication
But how are parameters stored and updated(in backpropagation)?
One more ...
- 897
7
votes
1
answer
183
views
How do neural network topologies affect GPU/TPU acceleration?
I was thinking about different neural network topologies for some applications. However, I am not sure how this would affect the efficiency of hardware acceleration using GPU/TPU/some other chip.
If, ...
- 173
1
vote
2
answers
1k
views
How long it takes to train face recognition deep neural network? (rough estimation)
If I use a desktop PC with a GPU, how long it might take to train face recognition deep neural network on let's say dataset of 2.6 million images and 2600 identities? I guess it should depend on ...
- 113
1
vote
2
answers
5k
views
Does fp32 & fp64 performance of GPU affect deep learning model training? [closed]
I am purchasing Titan RTX GPU. Everything seems fine with that except float32 & float64 performance which seems lower vis-a-vis some of its counter parts. I wanted to understand if single ...
- 325
3
votes
1
answer
252
views
What are the aspects that most impact on the inference time for neural networks in embedded systems?
I work with neural networks for real-time image processing on embedded softwares and I tested different architectures (Googlenet, Mobilenet, Resnet, custom networks...) and different hardware ...
- 269
0
votes
2
answers
127
views
Tips for keeping the distribution of weights normal
I am working on a project where the Neural Network weights must be quantized on 8 or 16 bits for an embedded platform, thus I will lose some precision.
Since our platform does not have floating point ...
-1
votes
1
answer
55
views
Does software remain even when hardware is demolished?
For example, if I constructed a neural network and the computer running it where to be demolished, is the information/program of the neural network still an existent entity within or outside the ...
5
votes
1
answer
118
views
Which artificial intelligence algorithms could use tensor specific hardware?
AI algorithms involving neural networks can use tensor specific hardware. Are there any other artificial intelligence algorithms that could benefit from many tensor calculations in parallel? Are ...
- 51
2
votes
2
answers
188
views
Are artificial networks based on the perceptron design inherently limiting?
At the time when the basic building blocks of machine learning (the perceptron layer and the convolution kernel) were invented, the model of the neuron in the brain taught at the university level was ...
- 7,443
2
votes
3
answers
177
views
Could a large number of interconnected tiny turing-complete computer chips be patterned across a wafer to simulate a programmable neural network?
The Intel 8080 had 4500 transistors and ran at 2-3.125 MHz. By comparison, the 18-core Xeon Haswell-E5 han 5,560,000,000 transistors and can run at 2 GHz. Would it be possible or prudent to simulate a ...
3
votes
2
answers
295
views
What is the difference between a normal processor and a processor designed for AI?
What is the difference between a normal processor and a processor designed for AI?
user9947
7
votes
1
answer
3k
views
Who manufactures Google's Tensor Processing Units? [closed]
Does google manufacture TPUs? I know that google engineers are the ones responsible for the design, and that google is the one using them, but which company is responsible for the actual manufacturing ...
7
votes
1
answer
1k
views
Are more than 8 high performance Nvidia GPUs practical for deep learning applications? [closed]
I was prompted towards this question while trying to find server racks and motherboards which are specialized towards artificial intelligence. Naturally I went to the SuperMicro website. There the ...
- 139
9
votes
1
answer
308
views
How powerful is the machine that beat the poker professional players recently?
How powerful is the machine that beat the poker professional players recently (DeepStack)?
- 99
2
votes
1
answer
74
views
If we achieve sentience using mutable hardware, will it be possible to make a copy of that "brain" and its active state?
Hardware comes in two forms, basically: immutable, such as RAM, and mutable, such as FPGAs.
In animals, neurological connections gain in strength by changing the physical structure of the brain. This ...
- 125
10
votes
4
answers
937
views
Are we technically able to make, in hardware, arbitrarily large neural networks with current technology?
If neurons and synapses can be implemented using transistors, what prevents us from creating arbitrarily large neural networks using the same methods with which GPUs are made?
In essence, we have ...
- 203
10
votes
4
answers
4k
views
How does using ASIC for the acceleration of AI work?
We can read on Wikipedia page that Google built a custom ASIC chip for machine learning and tailored for TensorFlow which helps to accelerate AI.
Since ASIC chips are specially customized for one ...
- 10.4k
10
votes
3
answers
6k
views
How powerful a computer is required to simulate the human brain?
How much processing power is needed to emulate the human brain? More specifically, the neural simulation, such as communication between the neurons and processing certain data in real-time.
I ...
- 10.4k
5
votes
1
answer
237
views
Are there any microchips specifically designed to run ANNs?
I'm interested in hardware implementation of ANNs (artificial neural networks). Are there any popular existing technology implementations in form of microchips which are purpose designed to run ...
- 10.4k