I am training LSTM Nets with Keras on a small mobile GPU. The speed on GPU is slower then on CPU. I found some articles that say that it is hard to train LSTMs (RNNs) on GPUs because the training cannot be parallelized.
What is your experience? Is LSTM training on large GPUs like 1080 Ti faster then on CPU?