Currently, I am working on a few projects that use feedforward neural networks for regression and classification of simple tabular data. I have noticed that training a neural network using TensorFlow-GPU is often slower than training the same network usingusing TensorFlow-CPU.
Could something be wrong with my setup/code or is it possible that sometimes GPU is slower than CPU?