Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [chatgpt]

For questions related to the OpenAI ChatGPT model/chatbot, which was trained by Reinforcement Learning from Human Feedback (RLHF).

Filter by
Sorted by
Tagged with
-1 votes
0 answers
8 views

Data presentation graduality and presentation graduality (pages) speed of depth (how fast the data in pages is presented) [closed]

I would like to ask, how does artificial intelligence navigate knowledge, to determine the most suitable, presentation, and presentation gradualità, of data. In books, normally, diagram present a ...
-2 votes
0 answers
12 views

Eliminating images from AI responses in ChatGPT

I am using chatgpt to reason and memorize. However, as of lately it seems to be forcing me to use a chat with images. However, images, means I must immerse myself in the symbolic content of the image, ...
3 votes
1 answer
2k views

Is it possible to train an AI to bring a picture story in the correct order (correct story flow)?

I want to know if it is possible to train a neural network (or some other kind of an AI) to bring a simple picture story in the correct order, if it is in random order, so that the story has the ...
0 votes
0 answers
10 views

Best Searchbots that explain code

Of all the LLM based available searchbots which ones are best at explaining code from Java, Python, Golang or Javascript? ChatGPT, Bing Copilot, Claude, Groq or Le Mistral?
0 votes
2 answers
112 views

What is an "inference kernel"?

In the recent event where ChatGPT "went crazy", this term was used in the official post-mortem to describe what happened: In this case, the bug was in the step where the model chooses these ...
0 votes
1 answer
43 views

How does ChatGPT assign confidence level?

How does ChatGPT assign confidence level to its answer? What is the mathematical description of it? Here is my guess. It produces many answers from auto-regression. It already has a probability ...
6 votes
2 answers
574 views

How does GPT-based language model like ChatGPT determine the n-th letter of a word?

I understand that GPT models process input text by converting words into tokens and then embedding vectors and do not process them letter by letter. Given this approach, I am curious to know how a ...
1 vote
1 answer
31 views

publically available language models that can be used to train arbitrary language data?

I have sentence data in a language that is not widely in use and as such popular LLMs do not support the language. I want to train some language model such that given some question, it is able to ...
0 votes
0 answers
13 views

Unable to Save Generated Data to JSONL File - Always Resulting in "Wrote 0 examples to finetuning_events.jsonl" Message

Issue Description When attempting to generate JSONL data using Llama Index, the process works well until the final step where the results are saved to a JSONL file. However, every time I try to save ...
1 vote
1 answer
387 views

Why is ChatGPT fast on some questions and slow on others?

When using ChatGPT i have noticed it is fast on some questions and slow on others. Why is that? Based on my understanding of the transformers architecture, the user prompt is tokenized and the vector ...
21 votes
6 answers
21k views

How much energy consumption is involved in Chat GPT responses being generated?

I note this question was deemed off-topic, so I'm trying to clearly frame this question in terms of scope of response I'm interested in, namely ethics and sustainability issues associated with the ...
1 vote
2 answers
107 views

Is it possible to have a ChatGPT bot that can answer questions about sensitive information without using external servers?

We have a lot of internal documentation that contains sensitive information. Is it possible to have a ChatGPT bot that can answer questions about this information, to my used by users with clearance ...
2 votes
1 answer
67 views

What are these special "AI chips" actually used for?

To make an AI / LLM, like ChatGPT, you need two things: To create the LLM. This includes training it, etc. Very expensive from computation perspective. Run the LLM to answer user queries. For ...
1 vote
1 answer
2k views

How does exactly censorship work in chat GPT?

My assumption is that after the transformer is trained, some other software analyzes the answer for anti-wokeness and modifies it accordingly, rather than being trained using woke material. I don't ...
1 vote
1 answer
26 views

Discrepancies in the Exclusion of Elements in Image vs. Text Generation

(The following comments concern DALLE, I have not tested it with other image generating tools, but would be curious to hear if the same happens) When generating images, it seems that ChatGPT (i.e. ...
1 vote
2 answers
110 views

How are sentences turned into a vector in LLM

My understanding of Large Language Models like GPT is that they are special kinds of deep neural networks specifically trained to predict the next word, given the beginning of a sentence. I understand ...
4 votes
1 answer
784 views

How can Transformers handle random sequences?

I have asked ChatGPT the following: Can you concatenate jfef9230rj2mreg90r23ewfrn02eqwdk and 32ir20r3i2ofg90r32kee? And without any error the model produces: ...
1 vote
1 answer
106 views

Why do current language models no longer generate to long or short texts?

One of the biggest strengths of ChatGPT is that it generates fitting text with respect to the input query. It usually stays on topic, anwers the question completely and especially does not start ...
1 vote
3 answers
355 views

How to force LLM (like OpenAI ChatGPT) to output a variable list of values? [closed]

What prompt (or other technique) should I use with an LLM so that The result is guaranteed to be reliably parseable as a list of values (e.g. a Python list of strings) LLM would understand that a ...
1 vote
0 answers
2k views

Tool for detecting AI Generated code?

Can you recommend any tools for detecting AI generated code? I am aware of AI-generated text detectors such as ZeroGPT and OpenAI-Classifier, but I am specifically interested in detecting AI-generated ...
0 votes
2 answers
891 views

is it possible to make the chatgpt only contains result content without intro or summary [closed]

I need to generate some job description, now I trying to use chatGPT to generate it, this is the prompt looks like: ...
0 votes
1 answer
81 views

Why is generative QA + RAG so popular when extractive QA models exist that can provide factual information?

If the concern with using generative models for question answering is that these models aren't always producing factual information, why is it that people are using these models with Retrieval ...
24 votes
5 answers
12k views

Why does ChatGPT fail in playing "20 questions"?

IBM Watson's success in playing "Jeopardy!" was a landmark in the history of artificial intelligence. In the seemingly simpler game of "Twenty questions" where player B has to ...
0 votes
1 answer
120 views

Does Chat-GPT learn from interactions? [closed]

Does Chat-GPT accumulate knowledge through interactions with users in real time? I know it's trained on a massive dataset but does it do online learning?
-3 votes
1 answer
108 views

ChatGPT epic creativity fail [duplicate]

My question to ChatGPT, after reading about a vole (as a German I had to look it up) and immediately associating "mole": "Here are pairs of animal names which differ only in the first ...
6 votes
1 answer
2k views

Why does ChatGPT create fake code?

ChatGPT has been a big thing lately. It also makes a lot of mistakes. For example, it creates fake functions of a package and tells it as it works for real. I was wondering how that works. Why is it ...
3 votes
3 answers
3k views

Do AI-based code-generators guarantee correct output?

I haven't spent much time looking at AI-based code-generators. What mechanism is used to generate code and how is it different than standard NLP?
0 votes
1 answer
93 views

How does chatgpt interpret prompts? [closed]

First of all, my English isn't very good, please bear with me. I've heard that chatgpt is a decoder-only model, which doesn't use any encoder model. How does it interpret our prompts if it doesn't use ...
1 vote
1 answer
407 views

What is accelerated years in describing the amount of the training time?

As described in this article, it was written that GPT-3 took 405 V100 years to train in 2020. I'm a bit confused about this definition, does that mean the process was accelerated like using a V100 GPU ...
0 votes
1 answer
509 views

How does Chat GPT encode a question?

Chat GPT is based on a decoder-only Transformer so it does not have an encoder. Given that, how is a user's question passed as input to Chat GPT's decoder? In a regular encoder-decoder architecture, ...
27 votes
4 answers
15k views

Why do ChatGPT “jailbreaks” work?

Do developers not genuinely want to prevent them? It seems like if they are able to develop such impressive AI models then it wouldn’t be that difficult to create catch-all/wildcard mitigations to the ...
0 votes
0 answers
102 views

Intentionally corrupting LLM weights (lobotomy)

It is largely unknown how LLMs work inside. Has anyone scientifically tried to corrupt (open source) model's weights in an organized manner to maybe detect which parts of the model are doing what or ...
54 votes
2 answers
47k views

How does ChatGPT retain the context of previous questions?

One of the innovations with OpenAI's ChatGPT is how natural it is for users to interact with it. What is the technical enabler for ChatGPT to maintain the context of previous questions in its answers? ...
0 votes
0 answers
82 views

Why is chatGPT 4 unable to correct a program given its output?

Recently I used chatGPT 4 to write a small project in Perl which involved reading of an exam file (multiple choice), comparing it to a master exam file, and scoring the student exam including fraud ...
1 vote
1 answer
800 views

How LLM keeps the context of a chat/thread

How an LLM keeps the context (what has already been entered by the user) of a chat/thread? For reference, in chat.openai.com, for each chat we create (or a Thread according to their API), the LLM ...
0 votes
0 answers
18 views

Could an analysis of GPT4's WAIS score be published?

Similar to this: https://www.scientificamerican.com/article/i-gave-chatgpt-an-iq-test-heres-what-i-discovered/ But more detailed and in depth (subtest breakdown, including image analysis, etc.), WAIS-...
1 vote
3 answers
72 views

Would maximizing (instead of minimizing) error of an LLM/HMM lead to complex behavior?

Imagine we have some sort of "next token predictor," either with transformer architecture, LSTM, or just a HMM (though the terminology I use here will be less aligned to HMMs, I believe the ...
4 votes
2 answers
1k views

ChatGPT claims that it doesn't get information from anywhere, so can't say why it gave a blatantly false statement. How is that possible?

I asked ChatGPT a question, and its response included this statement: In "The Ruling Class" film, which was released in 1972, Patrick McGoohan played the role of Bishop Lampton. Unlike ...
0 votes
0 answers
42 views

When using Reinforcement Learning with Human Feedback to train a transformer, how do I propagate the feedback through the transformer?

I'm basically trying to replicate the processed used to create Chat GPT: Am I supposed to backpropagate? How can I do that when these aren't really errors, but rather ranking several response? Can I ...
41 votes
2 answers
30k views

How is ChatGPT aware of today's date?

I asked ChatGPT (3.5 and 4) about current date and (s)he answered correctly. In subsequent conversation (s)he was not able to explain how (s)he has this knowledge. I always thought that the model only ...
1 vote
0 answers
194 views

What is 'system card'?

What is 'system card' in these context: https://ai.meta.com/blog/system-cards-a-new-resource-for-understanding-how-ai-systems-work/ Additionally, individual model developers may provide ...
4 votes
4 answers
4k views

How does ChatGPT respond to novel prompts and commands?

So I understand how a language model could scan a large data set like the internet and produce text that mimicked the statistical properties of the input data, eg completing a sentence like "eggs ...
0 votes
0 answers
79 views

Are "Custom Instructions" injected into the context window repeatedly?

ChatGPT (the conversational front-end to GPT 3.5 and GPT 4) includes user configurable custom instructions. They allocate 1500 characters to "what you would like chatGPT to know about you" ...
0 votes
0 answers
70 views

claude 2 doesn't know basic math? [duplicate]

Sometimes, when I see answers like this from large language models, it makes me feel disgusted: Me: Does Voyager 1 have enough velocity to escape the solar system without using Jupiter's gravity ...
0 votes
0 answers
45 views

What is the reason that OpenAI implements complex context management in ChatGPT but does not use it for their API?

According to this discussion How does ChatGPT retain the context of previous questions? it is clear that OpenAI already has implemented some serious engineer to ensure that the ChatGPT experience is a ...
-2 votes
1 answer
31 views

Dynamic text completion [closed]

I am using the get_completion function to generate response to a question. Since generating response takes a long time (~5 seconds) I would like to display the response text as it's generated (...
1 vote
2 answers
450 views

Tips and tricks when training a very large language model?

Have never trained a (very) large language model, so I am wondering if the process is the same as training a (regular) language model, i.e. you prepare the data, set up the architecture, ...
0 votes
0 answers
55 views

How to get GPT to complete all tasks before ending its turn?

I'm trying to figure out how ChatGPT and Code Interpreter (or anything else) gets GPT to complete an arbitrary number of actions before it ends its turn and hands it back to the user. I'm using a ...
0 votes
0 answers
74 views

How does query of LLM/GPT models work?

Training of LLM aka GPT models is clear on how is trained but can't find any info how is "mapped" query to internal tokens and generates response tokens more precise inference phase which ...
6 votes
5 answers
12k views

How is GPT 4 able to solve math?

How can GPT 4 solve complex calculus and other math problems. I believe these problems require analytical reasoning and ability to compute numbers. Does it still use a LLM to complete this process or ...