Questions tagged [gpu]
Graphics processing units or GPUs are specialized hardware for the manipulation of images and calculation of local image properties.
19
questions
0
votes
0answers
23 views
Why would my neural network run faster on my laptop than on my university's supercomputer?
I am trying to get my neural network running on my university's supercomputer in order to decrease its runtime (not for training, for testing - feedforward runs only).
However, the Matlab function I ...
2
votes
0answers
39 views
External GPU for Mac
I'd like to buy an eGPU for my MaxBook Pro to use for simple deep learning tasks. My setup is:
...
2
votes
1answer
107 views
Tensorflow-gpu cannot use Nvidia GPU with CUDA
I'm working on a Python Keras/Tensorflow image recognition script (on Ubuntu 18.04) which works ok, but it will only train on CPU (which is slow) and I want to be using my GPU (i have a Nvidia Geforce ...
1
vote
1answer
35 views
Multiple GPUs one expensive GPU, which gpu to buy for real time processing (not training)
I am trying to decide what GPU or GPUs to buy to run tf-pose pose detection and yolo3 object detection on several cameras. I need to keep an acceptable frame rate too.
what kind of GPU configuration ...
4
votes
2answers
471 views
Effect of batch size and number of GPUs on model accuracy
I have a data set which was split using a fixed random seed and I am going to use 80% of data for training and rest on validation. Here are my GPU and batch size configurations
use ...
0
votes
0answers
16 views
What are the properties of a model that is well suited for for high performance real-time inference
What are general best practices or considerations in designing a model that is optimized for real-time inference?
3
votes
0answers
14 views
Good model and training algorithm to store texture data for fast gpu inference
Now, the following may sound silly, but I want to do it for my better understanding of performance and implementation of GPU inference for a set of deep learning problems.
What I want to do is to ...
3
votes
1answer
36 views
Training network with 4 GPUs performance is not exactly 4 times over one GPU why?
Training neural network with 4 GPUs using pyTorch, performance is not even 2 times (btw 1 & 2 times) compare to using one GPU. From Nvidia-smi we see GPU usage is for few milliseconds and next 5-...
3
votes
1answer
88 views
CNN how can i reduce gpu memory usage with large image sizes?
I am trying to train a cnn-lstm model, my sample image sizes are 640x640.
I have a GTX 1080 ti 11GB.
I am using Keras with tensorflow backend.
Here is the model.
...
0
votes
0answers
16 views
Mapping model types to GPU Requirements
GPU are available in 6,8,&11 Gigabyte increments. I would like to understand the thought process and questions should be asked when deciding which of the 3 memory sizes is to be chosen. The ...
5
votes
3answers
841 views
Is a GPU always faster than a CPU for training neural networks?
Currently, I am working on a few projects that use feedforward neural networks for regression and classification of simple tabular data. I have noticed that training a neural network using TensorFlow-...
2
votes
0answers
16 views
In addition to matrix algebra, can GPU's also handle the various Kernel functions for Neural Networks?
I've read a number of articles on how GPUs can speed up matrix algebra calculations, but I'm wondering how calculations are performed when one uses various kernel functions in a neural network.
If ...
1
vote
0answers
34 views
Any good resources for learning programming GPU level operations?
I want to be able to improve my lower level device specific programming abilities to assist in future endeavors. Examples would be learning to write custom tensorflow operations in C++ optimized to ...
1
vote
2answers
2k views
RTX 2060 vs GTX 1060 6GB for deep learning
First of all I don't play games at all and I still quite new to deep learning.I was using Alex-net(transfer learning actually) in MATLAB to classify images in my current laptop(i5-3230,without any GPU)...
0
votes
0answers
34 views
Do GPUs help with 'depth' of a network?
GPUs are known to help with when the input is 'wider' i.e. images that have hundreds of thousands of parameters. But what if we have a less than 1000 parameter state space input that is very deep - ...
2
votes
0answers
12 views
Cluster 2 AWS instances for deep learning model training
I am working on a CNN model for image classification. Currently a single AWS instance (p2xlarge) used for model training.
I would like to have one more AWS instance and distribute the load across ...
2
votes
1answer
80 views
Can I calculate the training performance of GPUs by comparing their specification?
I am currently using Nvidia GTX1050 with 640 CUDA cores and 2GB GDDR5 for Deep Neural Network training. I want to buy a new GPU for training, but I am not sure how much performance improvement I can ...
0
votes
1answer
25 views
Why is a Nvidia Single Board computer less than ideal for AI model training?
Conventional NVIDIA GPUs, such as the Titan and or GT1080, are used to train AI models. Why would a Jetson Nano board be less than ideal as a substitute for a conventional GPU?
CONTEXT
I would like ...
2
votes
2answers
1k views
Does fp32 & fp64 performance of GPU affect deep learning model training?
I am purchasing Titan RTX GPU. Everything seems fine with that except float32 & float64 performance which seems lower vis-a-vis some of its counter parts. I wanted to understand if single ...
