Hot answers tagged

13 votes
Accepted

What language is the GPT-3 engine written in?

The GPT-3 source code hasn’t been released but the creators say it uses the “same model and architecture as GPT-2” (source) with some exceptions. The GPT-2 source code is written in 100% Python. The ...
user avatar
  • 470
8 votes
Accepted

What is the "temperature" in the GPT models?

In sequence generating models, for vocabulary of size $N$ (number of words, parts of words, any other kind of token), one predicts the next token from distribution of the form: $$ \mathrm{softmax} (...
user avatar
2 votes
Accepted

How can GPT-3 be used for designing electronic circuits from text descriptions?

This is rather something for V&L Models, training on associated texts with circuit images. Data which should be hard to come by. I doubt these models are yet capable of catching enough detail in ...
user avatar
2 votes
Accepted

How to get GPT-3 to translate a specific word in a sentence?

GPT-3 obviously knows this GPT-3 doesn't "know" things in the sense that it has learned specific translations, maths or science etc. GPT-3 is not a knowledge database or question answering ...
user avatar
  • 23.8k
1 vote
Accepted

Are there any other language models besides GPT-3 that can be used to create chatbots with a specific identity and environment?

You may want to look at Chirpy Cardinal from Stanford. It doesn't provide mannerisms out of the box but the response generators can be configured to give each instance its own character. https://...
user avatar
  • 166

Only top scored, non community-wiki answers of a minimum length are eligible