What is the reason behind the name "Transformers", for Multi Head Self-Attention-based neural networks from Attention is All You Need?

I have been googling this question for a long time, and nowhere I can find any explanation.

  • $\begingroup$ Comments are not for extended discussion; this conversation has been moved to chat. $\endgroup$
    – nbro
    Mar 16, 2021 at 17:50

1 Answer 1


The authors of the original paper don't provide an explanation, but I suspect it's a combination of:


You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .