What is the reason behind the name "Transformers", for Multi Head Self-Attention-based neural networks from Attention is All You Need?
I have been googling this question for a long time, and nowhere I can find any explanation.
2
-
$\begingroup$ Comments are not for extended discussion; this conversation has been moved to chat. $\endgroup$– nbroCommented Mar 16, 2021 at 17:50
-
$\begingroup$ @nbro: Would you mind asking the authors why they have chosen the name "Transformer"? I am curious, too. $\endgroup$– Hans-Peter StrickerCommented May 14, 2023 at 10:25
Add a comment
|
1 Answer
$\begingroup$
$\endgroup$
The authors of the original paper don't provide an explanation, but I suspect it's a combination of:
- popular recognizable branding (cf. BERT, DALL-E, Watson etc)
- similarity to [sequence] transduction / translation / transformations generally
