Can the decoder in a transformer model be parallelized like the encoder?
The correct answer is: computation in a Transformer decoder can be parallelized during training, but not during actual translation.
What exactly is parallelized?
Also, it's worth mentioning that "parallelization" in this case means to compute encoder or decoder states in paralllel ...
(Old question, I know...)
It is not that we need both an encoder and decoder for sequence-to-sequence models - this decoupling of "reading" and "generating" just works better very often.
Example for Sequence-to-sequence without two RNNs
To prove my point above, here is an example from machine translation. Current machine translation systems are sequence-...