Explore our questions

0 votes
1 answer
59 views

NLP: What is expected from the output of a perfect coreference system?

1 vote
1 answer
127 views

CAPTCHA based on text comprehension and random tokens

0 votes
1 answer
154 views

Why would adding all the possible embeddings be "worse" than using 1D-convolutions?

1 vote
1 answer
183 views

Masking in Decoder of Transformer

0 votes
0 answers
17 views

Self-Attention. Q, K, V and Word Embedding spaces

1 vote
1 answer
33 views

why we use learnable positional encoding instead of Sinusoidal positional encoding

2 votes
3 answers
377 views

How do LSTM and GRU avoid to overcome the vanishing gradient problem?

0 votes
1 answer
154 views

Fine-Tune Llama on main and auxiliary task

0 votes
1 answer
397 views

Building an AI that predicts the pronunciation of words

6 votes
2 answers
550 views

How does GPT-based language model like ChatGPT determine the n-th letter of a word?

0 votes
0 answers
27 views

Attention Mechanism: Why don't we just use a simple dot product instead of the Q, K, V matrices?

0 votes
0 answers
36 views

Train my own LLM on a smaller corpus of text?

0 votes
2 answers
72 views

How the Q,K,V be calculated in multi-head attention

4 votes
2 answers
843 views

Are there strictly deterministic LLMs?

Browse more Questions