Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options not deleted user 79362

For questions about embeddings (not necessarily just word embeddings, for which there is a specific tag) in the context of machine learning.

1 vote
Accepted

How to convert a positionally encoded predicted embedding from a decoder to its matching token?

In most Transformer architectures, positional encodings are added to token embeddings to provide the model with information about the order of the sequence, as the Transformer encoder/decoder block does … Once position encodings are added to token embeddings, they become part of the model's learned representation, which the decoder uses to generate the output. …
Kulin Patel's user avatar