Skip to main content

Questions tagged [chat-bots]

For questions about chat-bots. NOT for questions about how to program a chat-bot, as those kinds of questions are off-topic.

Filter by
Sorted by
Tagged with
29 votes
4 answers
36k views

Why is ChatGPT bad at math?

As opposed to How does ChatGPT know math?, I've been seeing some things floating around the Twitterverse about how ChatGPT can actually be very bad at math. For instance, I asked it "If it takes ...
Mithical's user avatar
  • 2,915
6 votes
1 answer
2k views

How was ChatGPT trained?

I know that large language models like GPT-3 are trained simply to continue pieces of text that have been scraped from the web. But how was ChatGPT trained, which, while also having a good ...
HelloGoodbye's user avatar
54 votes
2 answers
48k views

How does ChatGPT retain the context of previous questions?

One of the innovations with OpenAI's ChatGPT is how natural it is for users to interact with it. What is the technical enabler for ChatGPT to maintain the context of previous questions in its answers? ...
milez's user avatar
  • 981
24 votes
4 answers
12k views

How does ChatGPT know math?

ChatGPT is a language model. As far as I know and If I'm not wrong, it gets text as tokens and word embeddings. So, how can it do math? For example, I asked: ME: Which one is bigger 5 or 9. ChatGPT: ...
Peyman's user avatar
  • 574
9 votes
1 answer
1k views

What causes ChatGPT to generate responses that refer to itself as a bot or LM?

ChatGPT occasionally generates responses to prompts that refer to itself as a "bot" or "language model." For instance, when given a certain input (the first paragraph of this ...
Obie 2.0's user avatar
  • 192
6 votes
3 answers
3k views

How is ChatGPT able to repeat random numbers?

From what I understand, ChatGPT is just a fancy neural network, operating like a sophisticated Markov Chain generator. As such, it should only be able to generate tokens that are in its training ...
yters's user avatar
  • 387
13 votes
2 answers
499 views

Are there any AI that have passed the MIST test so far?

MIST is a quantiative test of humanness, consisting of ~80k propositions such as: Is Earth a planet? Is the sun bigger than my foot? Do people sometimes lie? etc. Have any AI attempted and passed ...
kenorb's user avatar
  • 10.5k
4 votes
4 answers
4k views

How does ChatGPT respond to novel prompts and commands?

So I understand how a language model could scan a large data set like the internet and produce text that mimicked the statistical properties of the input data, eg completing a sentence like "eggs ...
ak0000's user avatar
  • 205
1 vote
1 answer
511 views

Where is memory stored in a chatbot like LaMDA?

I have a basic understanding of how neural networks work, and I have always thought that those chatbots work in a similar way (but I might be wrong): they take an input, shape it in a way that can be ...
Giorgio Tempesta's user avatar