Questions tagged [gpt-3]

Generative Pre-trained Transformer 3 (GPT-3) is an autoregressive language model that uses deep learning to produce human-like text. Introduced in May 2020, by Open-AI, with a massive 175 billion parameters.

Filter by
Sorted by
Tagged with
1 vote
0 answers
12 views

How do I preload a conversational AI assistant like GPT-3 with complex relational data to draw on?

I'm exploring options to build a virtual assistant type of product. Creating good dialog is mostly solved with GPT-3 or even DialoGPT. My main question is how do I add larger amounts of relational ...
user avatar
  • 111
1 vote
0 answers
44 views

Can you train GPT-J to use a specific list of words and prioritise them?

Can you train GPT-J to use a specific list of words and prioritise them? If so, please could you share how I would go about this? Say you're using GPT-J to write a story, you might wish to mention ...
user avatar
0 votes
0 answers
59 views

Which deep learning architecture for NLP is most accurate (and at the same time easy to implement)?

I have created a data set with 30.000 text documents (each text file is rather small with respect to its length), which are labelled with 0 and 1. Using this data set, I want to train a deep learning ...
user avatar
3 votes
1 answer
98 views

How to get GPT-3 to translate a specific word in a sentence?

I just gave GPT-3 the following prompt (in the playground, using text-davinci-001 with default settings): ...
user avatar
  • 133
1 vote
1 answer
44 views

Are there any other language models besides GPT-3 that can be used to create chatbots with a specific identity and environment?

I've recently been looking into language models but ran into a small question out of curiosity. For some language models like GPT-3, it is possible to generate dialogue, with the model basing its ...
user avatar
  • 113
4 votes
1 answer
1k views

What is the "temperature" in the GPT models?

What does the temperature parameter mean when talking about the GPT models? I know that a higher temperature value means more randomness, but I want to know how randomness is introduced. Does ...
user avatar
  • 163
3 votes
2 answers
89 views

How can GPT-3 be used for designing electronic circuits from text descriptions?

I was wondering if it is possible to use GPT-3 to translate text description of a circuit to any circuit design language program, which in turn can be used to make the circuit. If it is possible, what ...
user avatar
  • 235
7 votes
1 answer
3k views

What language is the GPT-3 engine written in?

I know that the API is python based, but what's the gpt-3 engine written in mostly? C? C++? I'm having some trouble finding this info.
user avatar
  • 195
2 votes
1 answer
78 views

How do transformers understand data and answer custom questions?

I recently heard of GPT-3 and I don't understand how the attention models and transformers encoders and decoders work. I heard that GPT-3 can make a website from a description and write perfectly ...
user avatar
1 vote
0 answers
26 views

What is the meaning of "Our current objective weights every token equally and lacks a notion of what is most important to predict" in the GPT-3 paper?

On page 34 of OpenAI's GPT-3, there is a sentence demonstrating the limitation of objective function: Our current objective weights every token equally and lacks a notion of what is most important to ...
user avatar
  • 111