For questions about the concept of attention in artificial intelligence and machine learning. Attention-like mechanisms were successfully used in natural language processing and computer vision tasks, such as machine translation. For a review of attention-based mechanism used in NLP, take a look at "Attention in Natural Language Processing" by Andrea Galassi et al.
About
Stats
|
created |
5 years, 3 months ago |
|
viewed |
11 times |
|
editors |
0 |
Top Answerers
more »
Recent Hot Answers
What is the intuition behind the dot product attention?What exactly are the "parameters" in GPT-3's 175 billion parameters and how are they chosen/generated?
How does the (decoder-only) transformer architecture work?
Why does GPT-2 Exclude the Transformer Encoder?
What kind of word embedding is used in the original transformer?
more »