The answer is it depends.
Are you referring to GPU vs CPU when training, or running inference?
When you say CPU is it an x86 CPU or ARM CPU?
What algorithms are running?
Let's look at image classification. Suppose you select a Convolutional Neural Network(CNN) as your algorithm. CNN's were created in the 1980s, but only really saw use when GPU's were used. ...