Questions tagged [gpu]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
3
votes
1answer
34 views

Training network with 4 GPUs performance is not exactly 4 times over one GPU why?

Training neural network with 4 GPUs using pyTorch, performance is not even 2 times (btw 1 & 2 times) compare to using one GPU. From Nvidia-smi we see GPU usage is for few milliseconds and next 5-...
3
votes
1answer
43 views

CNN how can i reduce gpu memory usage with large image sizes?

I am trying to train a cnn-lstm model, my sample image sizes are 640x640. I have a GTX 1080 ti 11GB. I am using Keras with tensorflow backend. Here is the model. ...
0
votes
0answers
16 views

Mapping model types to GPU Requirements

GPU are available in 6,8,&11 Gigabyte increments. I would like to understand the thought process and questions should be asked when deciding which of the 3 memory sizes is to be chosen. The ...
4
votes
3answers
383 views

Is a GPU always faster than a CPU for training neural networks?

Currently, I am working on a few projects that use feedforward neural networks for regression and classification of simple tabular data. I have noticed that training a neural network using TensorFlow-...
2
votes
0answers
16 views

In addition to matrix algebra, can GPU's also handle the various Kernel functions for Neural Networks?

I've read a number of articles on how GPUs can speed up matrix algebra calculations, but I'm wondering how calculations are performed when one uses various kernel functions in a neural network. If ...
1
vote
0answers
33 views

Any good resources for learning programming GPU level operations?

I want to be able to improve my lower level device specific programming abilities to assist in future endeavors. Examples would be learning to write custom tensorflow operations in C++ optimized to ...
1
vote
2answers
1k views

RTX 2060 vs GTX 1060 6GB for deep learning

First of all I don't play games at all and I still quite new to deep learning.I was using Alex-net(transfer learning actually) in MATLAB to classify images in my current laptop(i5-3230,without any GPU)...
0
votes
0answers
34 views

Do GPUs help with 'depth' of a network?

GPUs are known to help with when the input is 'wider' i.e. images that have hundreds of thousands of parameters. But what if we have a less than 1000 parameter state space input that is very deep - ...
2
votes
0answers
12 views

Cluster 2 AWS instances for deep learning model training

I am working on a CNN model for image classification. Currently a single AWS instance (p2xlarge) used for model training. I would like to have one more AWS instance and distribute the load across ...
2
votes
1answer
74 views

Can I calculate the training performance of GPUs by comparing their specification?

I am currently using Nvidia GTX1050 with 640 CUDA cores and 2GB GDDR5 for Deep Neural Network training. I want to buy a new GPU for training, but I am not sure how much performance improvement I can ...
0
votes
1answer
24 views

Why is a Nvidia Single Board computer less than ideal for AI model training?

Conventional NVIDIA GPUs, such as the Titan and or GT1080, are used to train AI models. Why would a Jetson Nano board be less than ideal as a substitute for a conventional GPU? CONTEXT I would like ...
2
votes
2answers
869 views

Does fp32 & fp64 performance of GPU affect deep learning model training?

I am purchasing Titan RTX GPU. Everything seems fine with that except float32 & float64 performance which seems lower vis-a-vis some of its counter parts. I wanted to understand if single ...