Questions tagged [gpu]
Graphics processing units or GPUs are specialized hardware for the manipulation of images and calculation of local image properties.
25
questions
3
votes
0answers
37 views
How to train neural networks with multiprocessing?
I am trying to figure out how multiprocessing works in neural networks.
In the example I've seen, the database is split into $x$ parts (depending on how many workers you have) and each worker is ...
1
vote
0answers
18 views
Non-determinism with mixed precision?
Currently, we're trying to improve failure analysis capability when using neural nets. One thing we want to resolve is output variation between batched runs and non-batched runs.
For example, we wrote ...
1
vote
1answer
291 views
Does use of GPU reduces time of execution of .predict() method in Keras/TF model? [closed]
Does using GPU instead of CPU with tensorflow and keras model reduces the time of .predict() method on a trained network or maybe it only reduces time of training of the network?
1
vote
0answers
20 views
How can traditional edge detection algorithms be implemented on a GPU?
How can edge detection algorithms, which are not based on deep learning, such as the canny edge detector, be implemented on a GPU? For example, how are non-edge pixels removed from an image once it ...
2
votes
2answers
2k views
How much computing power does it cost to run GPT-3? [closed]
I know it cost around $4.3 million dollars to train, but how much computing power does it cost to run the finished program? IBM Watson chatbot AI only costs a few cents per chat message to use, ...
2
votes
1answer
72 views
How do GPUs faciliate the training of a Deep Learning Architecture?
I would love to know in detail, how exactly GPUs help, in technical terms, in training the deep learning models.
To my understanding, GPUs help in performing independent tasks simultaneously to ...
1
vote
0answers
82 views
Why would my neural network run faster on my laptop than on my university's supercomputer?
I am trying to get my neural network running on my university's supercomputer in order to decrease its runtime (not for training, for testing - feedforward runs only).
However, the Matlab function I ...
2
votes
0answers
74 views
External GPU for Mac
I'd like to buy an eGPU for my MaxBook Pro to use for simple deep learning tasks. My setup is:
...
2
votes
1answer
4k views
Tensorflow-gpu cannot use Nvidia GPU with CUDA [closed]
I'm working on a Python Keras/Tensorflow image recognition script (on Ubuntu 18.04) which works ok, but it will only train on CPU (which is slow) and I want to be using my GPU (i have a Nvidia Geforce ...
1
vote
1answer
46 views
Multiple GPUs one expensive GPU, which gpu to buy for real time processing (not training) [closed]
I am trying to decide what GPU or GPUs to buy to run tf-pose pose detection and yolo3 object detection on several cameras. I need to keep an acceptable frame rate too.
what kind of GPU configuration ...
8
votes
2answers
2k views
Effect of batch size and number of GPUs on model accuracy
I have a data set which was split using a fixed random seed and I am going to use 80% of data for training and rest on validation. Here are my GPU and batch size configurations
use ...
1
vote
0answers
23 views
What are the properties of a model that is well suited for for high performance real-time inference
What are general best practices or considerations in designing a model that is optimized for real-time inference?
3
votes
0answers
23 views
Good model and training algorithm to store texture data for fast gpu inference
Now, the following may sound silly, but I want to do it for my better understanding of performance and implementation of GPU inference for a set of deep learning problems.
What I want to do is to ...
4
votes
2answers
236 views
How does a transformer leverage the GPU to be trained faster than RNNs?
How does a transformer leverage the GPU to be trained faster than RNNs?
I understand the parameter space of the transformer might be significantly larger than that of the RNN. But why does the ...
3
votes
1answer
108 views
Training network with 4 GPUs performance is not exactly 4 times over one GPU why? [closed]
Training neural network with 4 GPUs using pyTorch, performance is not even 2 times (btw 1 & 2 times) compare to using one GPU. From Nvidia-smi we see GPU usage is for few milliseconds and next 5-...
3
votes
1answer
821 views
How can I reduce the GPU memory usage with large images?
I am trying to train a CNN-LSTM model. The size of my images is 640x640. I have a GTX 1080 ti 11GB. I am using Keras with the TensorFlow backend.
Here is the model.
...
7
votes
3answers
4k views
Is a GPU always faster than a CPU for training neural networks?
Currently, I am working on a few projects that use feedforward neural networks for regression and classification of simple tabular data. I have noticed that training a neural network using TensorFlow-...
2
votes
0answers
18 views
In addition to matrix algebra, can GPU's also handle the various Kernel functions for Neural Networks?
I've read a number of articles on how GPUs can speed up matrix algebra calculations, but I'm wondering how calculations are performed when one uses various kernel functions in a neural network.
If ...
1
vote
0answers
35 views
Any good resources for learning programming GPU level operations?
I want to be able to improve my lower level device specific programming abilities to assist in future endeavors. Examples would be learning to write custom tensorflow operations in C++ optimized to ...
1
vote
2answers
4k views
How fast is a GPU compared to a CPU for training deep learning models, and which GPU should I buy? [closed]
First of all, I don't play games at all, and I am still quite new to deep learning. I was using AlexNet (transfer learning, actually) in MATLAB to classify images in my current laptop (i5-3230, ...
2
votes
0answers
16 views
Cluster 2 AWS instances for deep learning model training
I am working on a CNN model for image classification. Currently a single AWS instance (p2xlarge) used for model training.
I would like to have one more AWS instance and distribute the load across ...
2
votes
1answer
221 views
Can I calculate the training performance of GPUs by comparing their specification?
I am currently using Nvidia GTX1050 with 640 CUDA cores and 2GB GDDR5 for Deep Neural Network training. I want to buy a new GPU for training, but I am not sure how much performance improvement I can ...
0
votes
1answer
42 views
Why is a Nvidia Single Board computer less than ideal for AI model training?
Conventional NVIDIA GPUs, such as the Titan and or GT1080, are used to train AI models. Why would a Jetson Nano board be less than ideal as a substitute for a conventional GPU?
CONTEXT
I would like ...
2
votes
2answers
3k views
Does fp32 & fp64 performance of GPU affect deep learning model training? [closed]
I am purchasing Titan RTX GPU. Everything seems fine with that except float32 & float64 performance which seems lower vis-a-vis some of its counter parts. I wanted to understand if single ...
3
votes
1answer
130 views
At what point are AWS GPU instances worth it compared to CPU, price-wise? [closed]
Let's say for:
Image tasks
Deep RL in high dimensional state space
