Questions tagged [gpu]

Graphics processing units or GPUs are specialized hardware for the manipulation of images and calculation of local image properties.

Filter by
Sorted by
Tagged with
0
votes
0answers
23 views

Why would my neural network run faster on my laptop than on my university's supercomputer?

I am trying to get my neural network running on my university's supercomputer in order to decrease its runtime (not for training, for testing - feedforward runs only). However, the Matlab function I ...
2
votes
0answers
39 views

External GPU for Mac

I'd like to buy an eGPU for my MaxBook Pro to use for simple deep learning tasks. My setup is: ...
2
votes
1answer
107 views

Tensorflow-gpu cannot use Nvidia GPU with CUDA

I'm working on a Python Keras/Tensorflow image recognition script (on Ubuntu 18.04) which works ok, but it will only train on CPU (which is slow) and I want to be using my GPU (i have a Nvidia Geforce ...
1
vote
1answer
35 views

Multiple GPUs one expensive GPU, which gpu to buy for real time processing (not training)

I am trying to decide what GPU or GPUs to buy to run tf-pose pose detection and yolo3 object detection on several cameras. I need to keep an acceptable frame rate too. what kind of GPU configuration ...
4
votes
2answers
471 views

Effect of batch size and number of GPUs on model accuracy

I have a data set which was split using a fixed random seed and I am going to use 80% of data for training and rest on validation. Here are my GPU and batch size configurations use ...
0
votes
0answers
16 views

What are the properties of a model that is well suited for for high performance real-time inference

What are general best practices or considerations in designing a model that is optimized for real-time inference?
3
votes
0answers
14 views

Good model and training algorithm to store texture data for fast gpu inference

Now, the following may sound silly, but I want to do it for my better understanding of performance and implementation of GPU inference for a set of deep learning problems. What I want to do is to ...
3
votes
1answer
36 views

Training network with 4 GPUs performance is not exactly 4 times over one GPU why?

Training neural network with 4 GPUs using pyTorch, performance is not even 2 times (btw 1 & 2 times) compare to using one GPU. From Nvidia-smi we see GPU usage is for few milliseconds and next 5-...
3
votes
1answer
88 views

CNN how can i reduce gpu memory usage with large image sizes?

I am trying to train a cnn-lstm model, my sample image sizes are 640x640. I have a GTX 1080 ti 11GB. I am using Keras with tensorflow backend. Here is the model. ...
0
votes
0answers
16 views

Mapping model types to GPU Requirements

GPU are available in 6,8,&11 Gigabyte increments. I would like to understand the thought process and questions should be asked when deciding which of the 3 memory sizes is to be chosen. The ...
5
votes
3answers
841 views

Is a GPU always faster than a CPU for training neural networks?

Currently, I am working on a few projects that use feedforward neural networks for regression and classification of simple tabular data. I have noticed that training a neural network using TensorFlow-...
2
votes
0answers
16 views

In addition to matrix algebra, can GPU's also handle the various Kernel functions for Neural Networks?

I've read a number of articles on how GPUs can speed up matrix algebra calculations, but I'm wondering how calculations are performed when one uses various kernel functions in a neural network. If ...
1
vote
0answers
34 views

Any good resources for learning programming GPU level operations?

I want to be able to improve my lower level device specific programming abilities to assist in future endeavors. Examples would be learning to write custom tensorflow operations in C++ optimized to ...
1
vote
2answers
2k views

RTX 2060 vs GTX 1060 6GB for deep learning

First of all I don't play games at all and I still quite new to deep learning.I was using Alex-net(transfer learning actually) in MATLAB to classify images in my current laptop(i5-3230,without any GPU)...
0
votes
0answers
34 views

Do GPUs help with 'depth' of a network?

GPUs are known to help with when the input is 'wider' i.e. images that have hundreds of thousands of parameters. But what if we have a less than 1000 parameter state space input that is very deep - ...
2
votes
0answers
12 views

Cluster 2 AWS instances for deep learning model training

I am working on a CNN model for image classification. Currently a single AWS instance (p2xlarge) used for model training. I would like to have one more AWS instance and distribute the load across ...
2
votes
1answer
80 views

Can I calculate the training performance of GPUs by comparing their specification?

I am currently using Nvidia GTX1050 with 640 CUDA cores and 2GB GDDR5 for Deep Neural Network training. I want to buy a new GPU for training, but I am not sure how much performance improvement I can ...
0
votes
1answer
25 views

Why is a Nvidia Single Board computer less than ideal for AI model training?

Conventional NVIDIA GPUs, such as the Titan and or GT1080, are used to train AI models. Why would a Jetson Nano board be less than ideal as a substitute for a conventional GPU? CONTEXT I would like ...
2
votes
2answers
1k views

Does fp32 & fp64 performance of GPU affect deep learning model training?

I am purchasing Titan RTX GPU. Everything seems fine with that except float32 & float64 performance which seems lower vis-a-vis some of its counter parts. I wanted to understand if single ...