Newest 'gpu' Questions

1

vote

1answer

89 views

Does use of GPU reduces time of execution of .predict() method in Keras/TF model? [closed]

Does using GPU instead of CPU with tensorflow and keras model reduces the time of .predict() method on a trained network or maybe it only reduces time of training of the network?

asked Mar 12 at 13:14

Makintosz

9755 silver badges16 bronze badges

0

votes

0answers

12 views

What Deep Learning Applications Might Require Super-Computers or “SuperPODs”

With the release of NVIDIA's DGX SuperPOD of A100 GPUs, supercomputers will/are becoming more and more common-place. What potential deep learning tasks/applications might become more accessible with ...

deep-learning natural-language-processing gpu gpt neural-architecture-search

asked Nov 18 '20 at 14:46

Darien Schettler

1114 bronze badges

1

vote

0answers

19 views

How can traditional edge detection algorithms be implemented on a GPU?

How can edge detection algorithms, which are not based on deep learning, such as the canny edge detector, be implemented on a GPU? For example, how are non-edge pixels removed from an image once it ...

computer-vision image-processing gpu edge-detection canny-edge-detector

asked Aug 24 '20 at 19:33

user11937382

1111 bronze badge

2

votes

2answers

1k views

How much computing power does it cost to run GPT-3? [closed]

I know it cost around $4.3 million dollars to train, but how much computing power does it cost to run the finished program? IBM Watson chatbot AI only costs a few cents per chat message to use, ...

gpu gpt

asked Aug 5 '20 at 17:35

Simon Suh

1234 bronze badges

0

votes

0answers

92 views

GPU-training on Google Cloud Platform slower than CPU-training

I recently trained Kaggles "Advanced Housing Prices"-Competition using Catboost. For training i used a compute-instance on Google Cloud Platform (GCP) (CPU: Xeon Quad-Core, RAM: 15GB, GPU: ...

regression gpu google-cloud gradient-boosting

asked Jul 15 '20 at 19:25

Tim Hilt

1091 bronze badge

2

votes

1answer

69 views

How do GPUs faciliate the training of a Deep Learning Architecture?

I would love to know in detail, how exactly GPUs help, in technical terms, in training the deep learning models. To my understanding, GPUs help in performing independent tasks simultaneously to ...

neural-networks deep-learning convolutional-neural-networks long-short-term-memory gpu

asked Jun 16 '20 at 12:47

Anubhav Sachan

437 bronze badges

1

vote

0answers

73 views

Why would my neural network run faster on my laptop than on my university's supercomputer?

I am trying to get my neural network running on my university's supercomputer in order to decrease its runtime (not for training, for testing - feedforward runs only). However, the Matlab function I ...

convolutional-neural-networks feedforward-neural-network matlab gpu computational-complexity

asked Feb 12 '20 at 15:52

The Impossible Squish

1135 bronze badges

2

votes

0answers

72 views

External GPU for Mac

I'd like to buy an eGPU for my MaxBook Pro to use for simple deep learning tasks. My setup is: ...

deep-learning tensorflow gpu

asked Feb 10 '20 at 9:37

pymat

1212 bronze badges

2

votes

1answer

4k views

Tensorflow-gpu cannot use Nvidia GPU with CUDA [closed]

I'm working on a Python Keras/Tensorflow image recognition script (on Ubuntu 18.04) which works ok, but it will only train on CPU (which is slow) and I want to be using my GPU (i have a Nvidia Geforce ...

tensorflow image-recognition keras gpu

asked Jan 23 '20 at 16:59

David B

211 silver badge2 bronze badges

1

vote

1answer

45 views

Multiple GPUs one expensive GPU, which gpu to buy for real time processing (not training) [closed]

I am trying to decide what GPU or GPUs to buy to run tf-pose pose detection and yolo3 object detection on several cameras. I need to keep an acceptable frame rate too. what kind of GPU configuration ...

tensorflow deep-neural-networks gpu yolo

asked Jan 17 '20 at 6:18

Eshaka

1112 bronze badges

8

votes

2answers

2k views

Effect of batch size and number of GPUs on model accuracy

I have a data set which was split using a fixed random seed and I am going to use 80% of data for training and rest on validation. Here are my GPU and batch size configurations use ...

deep-learning tensorflow keras gpu accuracy

asked Jan 9 '20 at 6:08

bit_scientist

2192 silver badges12 bronze badges

1

vote

0answers

23 views

What are the properties of a model that is well suited for for high performance real-time inference

What are general best practices or considerations in designing a model that is optimized for real-time inference?

ai-design models performance gpu real-time

asked Dec 17 '19 at 11:10

matthias_buehlmann

2511 silver badge6 bronze badges

3

votes

0answers

22 views

Good model and training algorithm to store texture data for fast gpu inference

Now, the following may sound silly, but I want to do it for my better understanding of performance and implementation of GPU inference for a set of deep learning problems. What I want to do is to ...

gpu

asked Dec 16 '19 at 11:51

matthias_buehlmann

2511 silver badge6 bronze badges

3

votes

1answer

94 views

Training network with 4 GPUs performance is not exactly 4 times over one GPU why?

Training neural network with 4 GPUs using pyTorch, performance is not even 2 times (btw 1 & 2 times) compare to using one GPU. From Nvidia-smi we see GPU usage is for few milliseconds and next 5-...

training pytorch gpu

asked Oct 30 '19 at 14:29

Troy

833 bronze badges

3

votes

1answer

745 views

How can I reduce the GPU memory usage with large images?

I am trying to train a CNN-LSTM model. The size of my images is 640x640. I have a GTX 1080 ti 11GB. I am using Keras with the TensorFlow backend. Here is the model. ...

convolutional-neural-networks tensorflow training keras gpu

asked Sep 26 '19 at 23:49

Thiedent

332 bronze badges

7

votes

3answers

3k views

Is a GPU always faster than a CPU for training neural networks?

Currently, I am working on a few projects that use feedforward neural networks for regression and classification of simple tabular data. I have noticed that training a neural network using TensorFlow-...

tensorflow gpu

asked Aug 24 '19 at 13:28

Makintosz

9755 silver badges16 bronze badges

2

votes

0answers

17 views

In addition to matrix algebra, can GPU's also handle the various Kernel functions for Neural Networks?

I've read a number of articles on how GPUs can speed up matrix algebra calculations, but I'm wondering how calculations are performed when one uses various kernel functions in a neural network. If ...

neural-networks tensorflow keras performance gpu

asked Jun 7 '19 at 19:32

Greg Thatcher

1315 bronze badges

1

vote

0answers

35 views

Any good resources for learning programming GPU level operations?

I want to be able to improve my lower level device specific programming abilities to assist in future endeavors. Examples would be learning to write custom tensorflow operations in C++ optimized to ...

c++ gpu

asked May 24 '19 at 15:27

mshlis

2,2045 silver badges21 bronze badges

1

vote

2answers

4k views

How fast is a GPU compared to a CPU for training deep learning models, and which GPU should I buy? [closed]

First of all, I don't play games at all, and I am still quite new to deep learning. I was using AlexNet (transfer learning, actually) in MATLAB to classify images in my current laptop (i5-3230, ...

deep-learning convolutional-neural-networks matlab hardware-evaluation gpu

asked May 20 '19 at 21:34

Fazla Rabbi Mashrur

1111 silver badge4 bronze badges

2

votes

0answers

16 views

Cluster 2 AWS instances for deep learning model training

I am working on a CNN model for image classification. Currently a single AWS instance (p2xlarge) used for model training. I would like to have one more AWS instance and distribute the load across ...

deep-learning gpu

asked Apr 21 '19 at 14:24

KK2491

1212 bronze badges

2

votes

1answer

201 views

Can I calculate the training performance of GPUs by comparing their specification?

I am currently using Nvidia GTX1050 with 640 CUDA cores and 2GB GDDR5 for Deep Neural Network training. I want to buy a new GPU for training, but I am not sure how much performance improvement I can ...

training gpu

asked Apr 8 '19 at 13:09

Lei Xun

456 bronze badges

0

votes

1answer

41 views

Why is a Nvidia Single Board computer less than ideal for AI model training?

Conventional NVIDIA GPUs, such as the Titan and or GT1080, are used to train AI models. Why would a Jetson Nano board be less than ideal as a substitute for a conventional GPU? CONTEXT I would like ...

training gpu

asked Apr 5 '19 at 10:06

gatorback

2261 silver badge7 bronze badges

2

votes

2answers

3k views

Does fp32 & fp64 performance of GPU affect deep learning model training? [closed]

I am purchasing Titan RTX GPU. Everything seems fine with that except float32 & float64 performance which seems lower vis-a-vis some of its counter parts. I wanted to understand if single ...

deep-learning hardware hardware-evaluation gpu

asked Feb 13 '19 at 7:30

Ruchit Dalwadi

3073 silver badges11 bronze badges

3

votes

1answer

92 views

At what point are AWS GPU instances worth it compared to CPU, price-wise? [closed]

Let's say for: Image tasks Deep RL in high dimensional state space

reinforcement-learning deep-learning image-recognition gpu hardware-evaluation

asked Jan 12 '19 at 14:24

user3180

5002 silver badges10 bronze badges

Stack Exchange Network

current community

your communities

more stack exchange communities

Questions tagged [gpu]

Does use of GPU reduces time of execution of .predict() method in Keras/TF model? [closed]

What Deep Learning Applications Might Require Super-Computers or “SuperPODs”

How can traditional edge detection algorithms be implemented on a GPU?

How much computing power does it cost to run GPT-3? [closed]

GPU-training on Google Cloud Platform slower than CPU-training

How do GPUs faciliate the training of a Deep Learning Architecture?

Why would my neural network run faster on my laptop than on my university's supercomputer?

External GPU for Mac

Tensorflow-gpu cannot use Nvidia GPU with CUDA [closed]

Multiple GPUs one expensive GPU, which gpu to buy for real time processing (not training) [closed]

Effect of batch size and number of GPUs on model accuracy

What are the properties of a model that is well suited for for high performance real-time inference

Good model and training algorithm to store texture data for fast gpu inference

Training network with 4 GPUs performance is not exactly 4 times over one GPU why?

How can I reduce the GPU memory usage with large images?

Is a GPU always faster than a CPU for training neural networks?

In addition to matrix algebra, can GPU's also handle the various Kernel functions for Neural Networks?

Any good resources for learning programming GPU level operations?

How fast is a GPU compared to a CPU for training deep learning models, and which GPU should I buy? [closed]

Cluster 2 AWS instances for deep learning model training

Can I calculate the training performance of GPUs by comparing their specification?

Why is a Nvidia Single Board computer less than ideal for AI model training?

Does fp32 & fp64 performance of GPU affect deep learning model training? [closed]

At what point are AWS GPU instances worth it compared to CPU, price-wise? [closed]

Hot Network Questions

Questions tagged [gpu]

Related Tags