New answers tagged

0 votes

How does GPT-based language model like ChatGPT determine the n-th letter of a word?

LLMs like GPT family use tokenizing to transform text into numbers. GPT models offered by OpenAI don't use separate tokens for each letter. Instead, they split the words into commonly occurring, short ...
Jakub Podolak's user avatar
1 vote

what are the applications scenarios for prefix decoder LMs

Large-scale language models can be classified into three main types: encoder-decoder, causal decoder and prefix decoder. Each has its advantages and is used in different LLMs for specific purposes. ...
Revolucion for Monica's user avatar
0 votes

Is the Mask Needed for Masked Self-Attention During Inference with GPT-2

Yes, it is still needed. In fact, @mshlis has given a clear reason in the Answer to Q1. As I am new to the community and have no reputation to directly comment, let me supply his/her answer by opening ...
Zhifeng Jiang's user avatar

Top 50 recent answers are included