Questions tagged [chatgpt]

For questions related to the OpenAI ChatGPT model/chatbot, which was trained by Reinforcement Learning from Human Feedback (RLHF).

Filter by
Sorted by
Tagged with
29 votes
4 answers
36k views

Why is ChatGPT bad at math?

As opposed to How does ChatGPT know math?, I've been seeing some things floating around the Twitterverse about how ChatGPT can actually be very bad at math. For instance, I asked it "If it takes ...
Mithical's user avatar
  • 2,905
16 votes
2 answers
7k views

Why does ChatGPT not give the answer text all at once?

When ChatGPT is generating an answer to my question, it generates it word by word. So I actually have to wait until I get the final answer. Is this just for show? Or is it really real-time generating ...
Sander van den Oord's user avatar
10 votes
2 answers
3k views

Are GPT-3.5 series models based on GPT-3?

In the official blog post about ChatGPT from OpenAI, there is this paragraph explaining how ChatGPT model was trained: We trained this model using Reinforcement Learning from Human Feedback (RLHF), ...
iMad's user avatar
  • 203
6 votes
1 answer
2k views

How was ChatGPT trained?

I know that large language models like GPT-3 are trained simply to continue pieces of text that have been scraped from the web. But how was ChatGPT trained, which, while also having a good ...
HelloGoodbye's user avatar
54 votes
2 answers
46k views

How does ChatGPT retain the context of previous questions?

One of the innovations with OpenAI's ChatGPT is how natural it is for users to interact with it. What is the technical enabler for ChatGPT to maintain the context of previous questions in its answers? ...
milez's user avatar
  • 981
41 votes
2 answers
30k views

How is ChatGPT aware of today's date?

I asked ChatGPT (3.5 and 4) about current date and (s)he answered correctly. In subsequent conversation (s)he was not able to explain how (s)he has this knowledge. I always thought that the model only ...
Peter Franek's user avatar
24 votes
5 answers
12k views

Why does ChatGPT fail in playing "20 questions"?

IBM Watson's success in playing "Jeopardy!" was a landmark in the history of artificial intelligence. In the seemingly simpler game of "Twenty questions" where player B has to ...
Hans-Peter Stricker's user avatar
24 votes
4 answers
12k views

How does ChatGPT know math?

ChatGPT is a language model. As far as I know and If I'm not wrong, it gets text as tokens and word embeddings. So, how can it do math? For example, I asked: ME: Which one is bigger 5 or 9. ChatGPT: ...
Peyman's user avatar
  • 564
9 votes
1 answer
1k views

What causes ChatGPT to generate responses that refer to itself as a bot or LM?

ChatGPT occasionally generates responses to prompts that refer to itself as a "bot" or "language model." For instance, when given a certain input (the first paragraph of this ...
Obie 2.0's user avatar
  • 192
6 votes
3 answers
3k views

How is ChatGPT able to repeat random numbers?

From what I understand, ChatGPT is just a fancy neural network, operating like a sophisticated Markov Chain generator. As such, it should only be able to generate tokens that are in its training ...
yters's user avatar
  • 387
39 votes
7 answers
16k views

Is the "Chinese room" an explanation of how ChatGPT works?

Sorry if this question makes no sense. I'm a software developer but know very little about AI. Quite a while ago, I read about the Chinese room, and the person inside who has had a lot of training/...
Guntram Blohm's user avatar
4 votes
4 answers
4k views

How does ChatGPT respond to novel prompts and commands?

So I understand how a language model could scan a large data set like the internet and produce text that mimicked the statistical properties of the input data, eg completing a sentence like "eggs ...
ak0000's user avatar
  • 205
3 votes
1 answer
11k views

Does chatGPT learn or remember from (public) user input? Will it 'fess up to it? I could not get it to reveal [closed]

It started with a question inspired by this video: New Research Suggests to Put AI to Sleep https://youtu.be/0yuQlbCkTJ0 She says: "In this video I discuss a new research paper which suggest a ...
Ectosoprophilous's user avatar
1 vote
1 answer
2k views

How does exactly censorship work in chat GPT?

My assumption is that after the transformer is trained, some other software analyzes the answer for anti-wokeness and modifies it accordingly, rather than being trained using woke material. I don't ...
Wolphram jonny's user avatar
1 vote
1 answer
472 views

How does chatGPT know it's an AI?

I've tried several prompts to understand how does it "know" that it's an AI, but it's answers are inconclusive for me. It says that it was hard-coded to recognize keywords in this regard, ...
Jose Miguel Cruz y Celis's user avatar
0 votes
1 answer
1k views

How to assess if OpenAI's ChatGPT chatbot has a human in the loop? [closed]

I've asked a question and given a couple answers that propose the OpenAI ChatGPT chatbot has humans in the loop (HITL), and that explains the chatbot's extraordinary abilities. I've been repeatedly ...
yters's user avatar
  • 387