Questions tagged [chatgpt]
For questions related to the OpenAI ChatGPT model/chatbot, which was trained by Reinforcement Learning from Human Feedback (RLHF).
112
questions
0
votes
0
answers
29
views
Intentionally corrupting LLM weights (lobotomy)
It is largely unknown how LLMs work inside. Has anyone scientifically tried to corrupt (open source) model's weights in an organized manner to maybe detect which parts of the model are doing what or ...
- 271
0
votes
0
answers
64
views
Why is chatGPT 4 unable to correct a program given its output?
Recently I used chatGPT 4 to write a small project in Perl which involved reading of an exam file (multiple choice), comparing it to a master exam file, and scoring the student exam including fraud ...
- 109
0
votes
0
answers
11
views
Could an analysis of GPT4's WAIS score be published?
Similar to this: https://www.scientificamerican.com/article/i-gave-chatgpt-an-iq-test-heres-what-i-discovered/
But more detailed and in depth (subtest breakdown, including image analysis, etc.), WAIS-...
- 113
0
votes
1
answer
39
views
How LLM keeps the context of a chat/thread
How an LLM keeps the context (what has already been entered by the user) of a chat/thread?
For reference, in chat.openai.com, for each chat we create (or a Thread according to their API), the LLM ...
- 103
0
votes
0
answers
4
views
Querying Table Formatting in ChatGPT: How to Achieve Microsoft Word-Like Presentation? [migrated]
In my interactions with ChatGPT, I encountered a challenge in displaying tables in a format similar to Microsoft Word's ordinary table format. I've successfully generated a table in the Microsoft Word ...
1
vote
3
answers
63
views
Would maximizing (instead of minimizing) error of an LLM/HMM lead to complex behavior?
Imagine we have some sort of "next token predictor," either with transformer architecture, LSTM, or just a HMM (though the terminology I use here will be less aligned to HMMs, I believe the ...
- 113
0
votes
0
answers
11
views
When using Reinforcement Learning with Human Feedback to train a transformer, how do I propagate the feedback through the transformer?
I'm basically trying to replicate the processed used to create Chat GPT:
Am I supposed to backpropagate? How can I do that when these aren't really errors, but rather ranking several response? Can I ...
0
votes
0
answers
52
views
What is 'system card'?
What is 'system card' in these context:
https://ai.meta.com/blog/system-cards-a-new-resource-for-understanding-how-ai-systems-work/
Additionally, individual model developers may provide ...
- 99
26
votes
4
answers
14k
views
Why do ChatGPT “jailbreaks” work?
Do developers not genuinely want to prevent them? It seems like if they are able to develop such impressive AI models then it wouldn’t be that difficult to create catch-all/wildcard mitigations to the ...
- 379
0
votes
0
answers
68
views
Are "Custom Instructions" injected into the context window repeatedly?
ChatGPT (the conversational front-end to GPT 3.5 and GPT 4) includes user configurable custom instructions. They allocate 1500 characters to "what you would like chatGPT to know about you" ...
0
votes
0
answers
65
views
claude 2 doesn't know basic math? [duplicate]
Sometimes, when I see answers like this from large language models, it makes me feel disgusted:
Me: Does Voyager 1 have enough velocity to escape the solar system without using Jupiter's gravity ...
- 1
0
votes
0
answers
33
views
What is the reason that OpenAI implements complex context management in ChatGPT but does not use it for their API?
According to this discussion
How does ChatGPT retain the context of previous questions?
it is clear that OpenAI already has implemented some serious engineer to ensure that the ChatGPT experience is a ...
- 101
-2
votes
1
answer
27
views
Dynamic text completion [closed]
I am using the get_completion function to generate response to a question. Since generating response takes a long time (~5 seconds) I would like to display the response text as it's generated (...
- 97
0
votes
1
answer
51
views
Why do current language models no longer generate to long or short texts?
One of the biggest strengths of ChatGPT is that it generates fitting text with respect to the input query. It usually stays on topic, anwers the question completely and especially does not start ...
- 1
1
vote
2
answers
97
views
Tips and tricks when training a very large language model?
Have never trained a (very) large language model, so I am wondering if the process is the same as training a (regular) language model, i.e. you prepare the data, set up the architecture, ...
0
votes
0
answers
35
views
How to get GPT to complete all tasks before ending its turn?
I'm trying to figure out how ChatGPT and Code Interpreter (or anything else) gets GPT to complete an arbitrary number of actions before it ends its turn and hands it back to the user. I'm using a ...
- 101
0
votes
0
answers
61
views
How does query of LLM/GPT models work?
Training of LLM aka GPT models is clear on how is trained but can't find any info how is "mapped" query to internal tokens and generates response tokens more precise inference phase which ...
- 101
3
votes
0
answers
149
views
What strategy does ChatGPT use to manage its context in very lengthy conversations?
I'm asking specifically about ChatGPT4, but the question could apply to either that or 3.5.
When you use the ChatGPT API, it's of course up to you to manage conversation history and include that in ...
- 131
15
votes
6
answers
7k
views
Why do many AI bots feel the need to be know-it-alls?
Having used various AI bots often over recent months, I noticed that often it will claim to know something, even if it doesn't.
It would then either explain something which is clearly nonsense, or by ...
- 344
0
votes
1
answer
57
views
Noob crafting a simple "Zero-Shot Classifier" Using an API . How can I avoid passing the categories every single request? [closed]
I have a collection of 700 categories, all potential classifications for articles. My current need is to create a system that can dynamically categorize short texts or articles according to these 700 ...
- 109
0
votes
1
answer
78
views
Randomness in Google Bard answers [closed]
I tried Google Bard now recently for the first time after we got into here in Finland too. And to my surprise it gives different answer each time I ask the same question. Is this a feature of LLM or ...
- 125
2
votes
2
answers
213
views
Are LLM hallucination necessarily a bad thing?
I've been pondering over this for a while now: is the so-called hallucinating necessarily a problem in LLM or in AI in general? What it stands for anyway, maybe the model is trying to crunch so much ...
- 125
2
votes
1
answer
92
views
Could hallucinations be the demise of the AI hype? [closed]
For quite some time now, I have been evaluating ChatGPT's capability to deliver accurate and helpful responses. While its performance is undeniably impressive, the issue of hallucinations poses a ...
- 133
1
vote
2
answers
137
views
How is LLM generated content moderated?
I'm looking for references (articles) about how LLM generated content is moderated. From a technical point of view, what makes the difference between a so-called "uncensored" LLM such as ...
- 11
3
votes
2
answers
2k
views
How to Formulate a realiable ChatGPT Prompt for Sentiment Analysis of a Text, and show that it is reliable?
I have a dataset which consists of like.. 400000 sentences and I want give each sentence to ChatGPT so it classifies each sentence as positive or ...
- 131
0
votes
1
answer
95
views
Does the output of LLM's affect their neural weights?
When an LLM creates an output, it seemingly has no way to check if its output was valid. Therefore it wouldn't be able to back-propagate any changes to the weights is used to create that output.
...
- 103
1
vote
1
answer
78
views
Is it possible to have a ChatGPT bot that can answer questions about sensitive information without using external servers?
We have a lot of internal documentation that contains sensitive information.
Is it possible to have a ChatGPT bot that can answer questions about this information, to my used by users with clearance ...
- 111
0
votes
0
answers
148
views
ChatGPT request/prompt structure: Put Persona into the "system" field. Add or replace?
On playground.openapi.com
we see a more advanced view of the chat window that chat.openai.com offers (that's the more well-known GUI shown in countlerss screenshots and tutorial videos).
On the ...
- 165
0
votes
0
answers
197
views
Extract multiple records from raw text using open AI API function calls
Trying to extract records from pdf. The plan was to convert pdf data to raw text and use open AI api calls to extract the data in a desired format (csv). This is because the pdf data is very ...
1
vote
1
answer
56
views
What is an appropriate tool to use that takes in a large knowledge base in string form and can answer questions based on the knowledge base?
I have an issue where I'm trying to use the openAI API to input a very large custom knowledge base (exceeding 1GB) that allows the user to ask questions based on that base to receive intelligent ...
- 11
0
votes
0
answers
25
views
Does ChatGPT have access to real-time data? [duplicate]
I wanted to see if ChatGPT knows the current time or not, and it persisted that it does not have access to any real-time data and its knowledge is limited to the year 2021 and before. But how does it ...
- 101
0
votes
1
answer
160
views
Why is ChatGPT fast on some questions and slow on others?
When using ChatGPT i have noticed it is fast on some questions and slow on others. Why is that?
Based on my understanding of the transformers architecture, the user prompt is tokenized and the vector ...
- 254
0
votes
1
answer
564
views
ChatGPT $20/month vs. ChatGPT API [closed]
I am curious if there is any difference between (A) accessing ChatGPT4 via their web page and \$20/month subscription on the one hand, or (B) via an application like MacGPT with their paid API key.
I'...
- 115
1
vote
1
answer
76
views
Keeping my prompt content private [closed]
I am using ChatGPT and friends a lot for work and professional info. They work amazingly well. However I have an application in mind where I can't upload my prompt content to the cloud because it is ...
- 115
1
vote
0
answers
43
views
Does (English) ChatGPT-generated content have statistically significantly different character frequency than human-generated content?
Detecting ChatGPT-generated content is a contentious topic at the moment. E.g., I've been on Reddit r/ChatGPT, and there's a constant stream of users claiming they've been unfairly accused of ...
0
votes
0
answers
446
views
ChatGPT4all to create chatbot to answer questions on your own docs without external calls
So, I came across this Tutorial (Apologies, if you cannot access it, it is a member's only story) and I gave it a shot. Technically, it "works". However, it seems to be a bit poor in the ...
- 109
1
vote
2
answers
252
views
How do language models know what they don't know - and report it?
Again and again I ask myself what goes on in a pre-trained transformer-based language model (like ChatGPT9) when it comes to "know" that it cannot give an appropriate answer and either
...
0
votes
2
answers
500
views
is it possible to make the chatgpt only contains result content without intro or summary [closed]
I need to generate some job description, now I trying to use chatGPT to generate it, this is the prompt looks like:
...
- 109
0
votes
0
answers
47
views
What is actually tuned during prompt engineering of autoregressive LLMs like GPT?
There are a lot of sites going over prompt engineering, but I don't see them explaining what is actually being changed. Is it hidden activation layers being tuned?
- 121
23
votes
4
answers
11k
views
Why does ChatGPT fail in playing "20 questions"?
IBM Watson's success in playing "Jeopardy!" was a landmark in the history of artificial intelligence. In the seemingly simpler game of "Twenty questions" where player B has to ...
1
vote
1
answer
409
views
Is it possible to create a multiple-choice question from Youtube video using Chatgpt? [closed]
Is it possible to create a multiple-choice question about a Youtube video using Chatgpt (or others)?
- 11
3
votes
1
answer
989
views
Does ChatGPT use different transformers for different downstream tasks?
What I find hard to figure out is whether ChatGPT guesses from the prompt the downstream NLP task to be performed - text summary, text generation, question-answering, doing logic or arithmetic, ...
-1
votes
1
answer
130
views
What is a neuron in large language models? [closed]
I'm reading OpenAI's new paper "Language models can explain neurons in language models" And I can't fully understand the concept of neurons here.
Can you please explain it? Is it related to ...
- 554
3
votes
0
answers
277
views
How is ChatGPT able to perform part-of-speech tagging?
ChatGPT seems to be able of part-of-speech tagging:
How can its – possibly emergent – ability to perform part-of-speech tagging be understood?
0
votes
1
answer
519
views
How can ChatGPT get simple two-statement logic wrong?
(The example here isn't meant to offend or to take a political position, I simply needed two recent consecutive former presidents.)
I realize that ChatGPT can make mistakes and can lie.
But I thought ...
- 238
3
votes
1
answer
626
views
Process 2TB worth of conversational data hoarded over 40 years. How can I pass this into GPT to ask questions about it?
I'm still very new to this stuff. I have close to 2TB worth of data hoarded from IRC chats to everyday chats with friends and family.
But is there a way to pass in this much data into GPT to ask ...
- 139
6
votes
2
answers
398
views
How does GPT-based language model like ChatGPT determine the n-th letter of a word?
I understand that GPT models process input text by converting words into tokens and then embedding vectors and do not process them letter by letter. Given this approach, I am curious to know how a ...
- 554
0
votes
1
answer
563
views
How to guide the interaction between two ChatGPT conversational agents? [closed]
I wrote a code for a conversation between 2 ChatGPTs (which I call them agent 1 and agent 2) using poe.com and its reversed engineered API:
...
3
votes
1
answer
7k
views
OpenAI: What is the difference between model "gpt-3.5-turbo" and "gpt-3.5-turbo-0301"?
I have performed an API call to OpenAI's endpoint https://api.openai.com/v1/models .
The endpoint lists the currently available engines, and provides basic information about each one such as the owner ...
- 165
1
vote
0
answers
495
views
Why doesn't ChatGPT ask questions?
As far as I understand ChatGPT has been trained on a vast array of data, and it does understand questions; but it seems to never ask. Even if a person would ask clarifying questions (that I assume are ...
- 207