GPT-3 has a prompt limit of about ~2048 "tokens", which corresponds to about 4 characters in text. If my understanding is correct, a deep neural network is not learning after it is trained and is used to produce an output, and, as such, this limitation comes from amount of the input neurons. My question is: what is stopping us from using the same algorithm we use for training, when using the network? That would allow it to adjust its weights and, in a way, provide a form of long-term memory which could let it handle prompts with arbitrarily long limits. Is my line of thinking worng?
In theory, there is nothing stopping you from updating the weights of a neural network whenever you like. You run an example through the network, calculate the difference between the network's output and the answer you expected, and run back propagation, exactly the same as you do when you initially train the network. Of course, usually networks are trained with large batches of data instead of single examples at a time, so if you wanted to do a weight update you should save up a bunch of data and pass through a batch (ideally the same batch size that you used during training, though there's nothing stopping you from passing in different batch sizes).
Keep in mind this is all theoretical. In practice, adjusting the weights on a deployed network will probably be very difficult because the models weights have been exported in a format optimized for inference. And it's better to have distinct releases with sets of weights that do not change rather than continuously updating the same model.
Either way, changing the weights continuously would not affect the "memory" of the network in any way. The lengths of sequences that sequence-to-sequence models like transformers or RNNs can accept is an entirely separate parameter.
With $175$ Billion parameters,
GPT-3 is remarkably large and powerful, but it has several limitations and risks associated with its usage. The biggest issue is that GPT-3
can't continuously learn once trained?. It has been pre-trained(as the name ~ Generative Pre-trained Transformer), which means that it doesn't have an ongoing long-term memory that learns from each interaction.
GPT-3 suffers from the same problems as all
Neural Networks: their lack of ability to explain and interpret why certain inputs result in specific outputs.
Another reason could be that the model has reached a point of diminishing returns, meaning that any additional training is unlikely to result in significant improvements.
"A significant concern when building AI models like these is diminishing returns—that is, you cannot simply scale the model up forever. At some point, some factor(s) of the model will plateau, whether it’s the information generated, the dataset size, the training regime, etc".
However, at the level of
GPT-2, there was no indication that this plateau had been reached. Thus, the “bigger and better” tactic continued, bringing us
GPT-3". So, it may also be possible that the model has simply reached a plateau in its learning and is unable to make any further progress.