Questions tagged [gpu]
The gpu tag has no usage guidance.
12
questions
3
votes
1answer
34 views
Training network with 4 GPUs performance is not exactly 4 times over one GPU why?
Training neural network with 4 GPUs using pyTorch, performance is not even 2 times (btw 1 & 2 times) compare to using one GPU. From Nvidia-smi we see GPU usage is for few milliseconds and next 5-...
3
votes
1answer
43 views
CNN how can i reduce gpu memory usage with large image sizes?
I am trying to train a cnn-lstm model, my sample image sizes are 640x640.
I have a GTX 1080 ti 11GB.
I am using Keras with tensorflow backend.
Here is the model.
...
0
votes
0answers
16 views
Mapping model types to GPU Requirements
GPU are available in 6,8,&11 Gigabyte increments. I would like to understand the thought process and questions should be asked when deciding which of the 3 memory sizes is to be chosen. The ...
4
votes
3answers
383 views
Is a GPU always faster than a CPU for training neural networks?
Currently, I am working on a few projects that use feedforward neural networks for regression and classification of simple tabular data. I have noticed that training a neural network using TensorFlow-...
2
votes
0answers
16 views
In addition to matrix algebra, can GPU's also handle the various Kernel functions for Neural Networks?
I've read a number of articles on how GPUs can speed up matrix algebra calculations, but I'm wondering how calculations are performed when one uses various kernel functions in a neural network.
If ...
1
vote
0answers
33 views
Any good resources for learning programming GPU level operations?
I want to be able to improve my lower level device specific programming abilities to assist in future endeavors. Examples would be learning to write custom tensorflow operations in C++ optimized to ...
1
vote
2answers
1k views
RTX 2060 vs GTX 1060 6GB for deep learning
First of all I don't play games at all and I still quite new to deep learning.I was using Alex-net(transfer learning actually) in MATLAB to classify images in my current laptop(i5-3230,without any GPU)...
0
votes
0answers
34 views
Do GPUs help with 'depth' of a network?
GPUs are known to help with when the input is 'wider' i.e. images that have hundreds of thousands of parameters. But what if we have a less than 1000 parameter state space input that is very deep - ...
2
votes
0answers
12 views
Cluster 2 AWS instances for deep learning model training
I am working on a CNN model for image classification. Currently a single AWS instance (p2xlarge) used for model training.
I would like to have one more AWS instance and distribute the load across ...
2
votes
1answer
74 views
Can I calculate the training performance of GPUs by comparing their specification?
I am currently using Nvidia GTX1050 with 640 CUDA cores and 2GB GDDR5 for Deep Neural Network training. I want to buy a new GPU for training, but I am not sure how much performance improvement I can ...
0
votes
1answer
24 views
Why is a Nvidia Single Board computer less than ideal for AI model training?
Conventional NVIDIA GPUs, such as the Titan and or GT1080, are used to train AI models. Why would a Jetson Nano board be less than ideal as a substitute for a conventional GPU?
CONTEXT
I would like ...
2
votes
2answers
869 views
Does fp32 & fp64 performance of GPU affect deep learning model training?
I am purchasing Titan RTX GPU. Everything seems fine with that except float32 & float64 performance which seems lower vis-a-vis some of its counter parts. I wanted to understand if single ...
