Skip to main content

Questions tagged [chat-bots]

For questions about chat-bots. NOT for questions about how to program a chat-bot, as those kinds of questions are off-topic.

Filter by
Sorted by
Tagged with
29 votes
4 answers

Why is ChatGPT bad at math?

As opposed to How does ChatGPT know math?, I've been seeing some things floating around the Twitterverse about how ChatGPT can actually be very bad at math. For instance, I asked it "If it takes ...
Mithical's user avatar
  • 2,915
6 votes
1 answer

How was ChatGPT trained?

I know that large language models like GPT-3 are trained simply to continue pieces of text that have been scraped from the web. But how was ChatGPT trained, which, while also having a good ...
HelloGoodbye's user avatar
54 votes
2 answers

How does ChatGPT retain the context of previous questions?

One of the innovations with OpenAI's ChatGPT is how natural it is for users to interact with it. What is the technical enabler for ChatGPT to maintain the context of previous questions in its answers? ...
milez's user avatar
  • 981
24 votes
4 answers

How does ChatGPT know math?

ChatGPT is a language model. As far as I know and If I'm not wrong, it gets text as tokens and word embeddings. So, how can it do math? For example, I asked: ME: Which one is bigger 5 or 9. ChatGPT: ...
Peyman's user avatar
  • 574
9 votes
1 answer

What causes ChatGPT to generate responses that refer to itself as a bot or LM?

ChatGPT occasionally generates responses to prompts that refer to itself as a "bot" or "language model." For instance, when given a certain input (the first paragraph of this ...
Obie 2.0's user avatar
  • 192
6 votes
3 answers

How is ChatGPT able to repeat random numbers?

From what I understand, ChatGPT is just a fancy neural network, operating like a sophisticated Markov Chain generator. As such, it should only be able to generate tokens that are in its training ...
yters's user avatar
  • 387
13 votes
2 answers

Are there any AI that have passed the MIST test so far?

MIST is a quantiative test of humanness, consisting of ~80k propositions such as: Is Earth a planet? Is the sun bigger than my foot? Do people sometimes lie? etc. Have any AI attempted and passed ...
kenorb's user avatar
  • 10.5k
4 votes
4 answers

How does ChatGPT respond to novel prompts and commands?

So I understand how a language model could scan a large data set like the internet and produce text that mimicked the statistical properties of the input data, eg completing a sentence like "eggs ...
ak0000's user avatar
  • 205
1 vote
1 answer

Where is memory stored in a chatbot like LaMDA?

I have a basic understanding of how neural networks work, and I have always thought that those chatbots work in a similar way (but I might be wrong): they take an input, shape it in a way that can be ...
Giorgio Tempesta's user avatar