Questions tagged [chatgpt]

For questions related to the OpenAI ChatGPT model/chatbot, which was trained by Reinforcement Learning from Human Feedback (RLHF).

37 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
5 votes
0 answers
634 views

Are "prompt engineering" and "prompt design" used as synonymous?

Are "prompt engineering" and "prompt design" used as synonymous / equivalent terms on the day to day communications (not research papers) in Artificial Intelligence community ? Do ...
Rubén's user avatar
  • 159
4 votes
0 answers
3k views

How is ChatGPT maintaining context?

It has been suggested in the answer to this earlier question that it is just remembering a certain amount of recent information. The reference used is this post by OpenAI which says that ChatGPT ...
Kay999's user avatar
  • 41
3 votes
0 answers
255 views

What strategy does ChatGPT use to manage its context in very lengthy conversations?

I'm asking specifically about ChatGPT4, but the question could apply to either that or 3.5. When you use the ChatGPT API, it's of course up to you to manage conversation history and include that in ...
Ascendant's user avatar
  • 131
3 votes
0 answers
348 views

How is ChatGPT able to perform part-of-speech tagging?

ChatGPT seems to be able of part-of-speech tagging: How can its – possibly emergent – ability to perform part-of-speech tagging be understood?
Hans-Peter Stricker's user avatar
2 votes
0 answers
30 views

Combining GANs and NLP for AI-Based Programming: Generating Input-Output Templates for Computer Functions

I would like to combine GANs and NLP to create a system that can take an input and generate an appropriate output. For example, ...
Doğuş Deniz's user avatar
2 votes
0 answers
446 views

What is the accuracy rate of ChatGPT for simple coding questions?

ChatGPT was banned from StackOverflow with the following justification: Overall, because the average rate of getting correct answers from ChatGPT is too low, ... The primary problem is that while the ...
JonathanReez's user avatar
2 votes
0 answers
7k views

Is there a way to determine if code has been autogenerated by an AI source?

Lately, our Junior developer has been producing code fixes very quickly. At first, I was excited for him as I thought he was starting to retain information and proving he was able to research and fix ...
FreddyNoNose's user avatar
2 votes
0 answers
2k views

How compressed is Chat GPT data?

I originally thought the Chat GPT was a neural network model in which the input data was highly compressed such that the input data could not be got out again. But then I asked Chat GPT "Write ...
zooby's user avatar
  • 2,206
1 vote
1 answer
29 views

publically available language models that can be used to train arbitrary language data?

I have sentence data in a language that is not widely in use and as such popular LLMs do not support the language. I want to train some language model such that given some question, it is able to ...
Neijal Kanderbalt's user avatar
1 vote
0 answers
166 views

What is 'system card'?

What is 'system card' in these context: https://ai.meta.com/blog/system-cards-a-new-resource-for-understanding-how-ai-systems-work/ Additionally, individual model developers may provide ...
Vy Do's user avatar
  • 111
1 vote
1 answer
95 views

Why do current language models no longer generate to long or short texts?

One of the biggest strengths of ChatGPT is that it generates fitting text with respect to the input query. It usually stays on topic, anwers the question completely and especially does not start ...
Ricu's user avatar
  • 11
1 vote
1 answer
299 views

Why is ChatGPT fast on some questions and slow on others?

When using ChatGPT i have noticed it is fast on some questions and slow on others. Why is that? Based on my understanding of the transformers architecture, the user prompt is tokenized and the vector ...
morpheus's user avatar
  • 284
1 vote
0 answers
44 views

Does (English) ChatGPT-generated content have statistically significantly different character frequency than human-generated content?

Detecting ChatGPT-generated content is a contentious topic at the moment. E.g., I've been on Reddit r/ChatGPT, and there's a constant stream of users claiming they've been unfairly accused of ...
Rebecca J. Stones's user avatar
1 vote
0 answers
668 views

Why doesn't ChatGPT ask questions?

As far as I understand ChatGPT has been trained on a vast array of data, and it does understand questions; but it seems to never ask. Even if a person would ask clarifying questions (that I assume are ...
EmmanuelMess's user avatar
1 vote
0 answers
43 views

Can I reduce computation by only predicting response tokens in a transformer and still get the same gradients?

I have been looking at the source code of the Stanford Alpaca model and I believe that during inference, the whole instruction + response data is fed into the model normally. Then the instruction part ...
Tianchen Zheng's user avatar
1 vote
0 answers
196 views

How code analysis part of ChatGPT works and trained

ChatGPT can explain given code snippet we also ask question like "What does this variable do" , "Why this is used" and all. I gave C++ function snippet from an popular Open Source ...
BRUCE's user avatar
  • 111
1 vote
0 answers
2k views

Tool for detecting AI Generated code?

Can you recommend any tools for detecting AI generated code? I am aware of AI-generated text detectors such as ZeroGPT and OpenAI-Classifier, but I am specifically interested in detecting AI-generated ...
HeavenHM's user avatar
  • 111
1 vote
1 answer
2k views

How does exactly censorship work in chat GPT?

My assumption is that after the transformer is trained, some other software analyzes the answer for anti-wokeness and modifies it accordingly, rather than being trained using woke material. I don't ...
Wolphram jonny's user avatar
1 vote
0 answers
737 views

What subjects was ChatGPT trained on the most? Science/history/movies/reddit posts/wikipedia/books/news?

What subjects was ChatGPT trained on the most quantatively? It was trained on fiction and non-fiction books, wiki, and general web crawling. A bit of detective work tells me that compared to physics, ...
bandybabboon's user avatar
1 vote
0 answers
270 views

Why does ChatGPT call itself Assistant when asked?

ChatGPT tells me it isn't called chatgpt?! Instead it's insisting that it's "Assistant". Did OpenAI have different thoughts or what's the problem?
Aly Mobarak's user avatar
0 votes
0 answers
25 views

Chat Completion vs Assistant

Can some human kindly explain to me the difference between Chat Completion and Assistant? They look pretty much the same to me. ...
Sandeep's user avatar
  • 109
0 votes
0 answers
9 views

Unable to Save Generated Data to JSONL File - Always Resulting in "Wrote 0 examples to finetuning_events.jsonl" Message

Issue Description When attempting to generate JSONL data using Llama Index, the process works well until the final step where the results are saved to a JSONL file. However, every time I try to save ...
gluck0101's user avatar
  • 101
0 votes
0 answers
92 views

Intentionally corrupting LLM weights (lobotomy)

It is largely unknown how LLMs work inside. Has anyone scientifically tried to corrupt (open source) model's weights in an organized manner to maybe detect which parts of the model are doing what or ...
Kozuch's user avatar
  • 281
0 votes
0 answers
82 views

Why is chatGPT 4 unable to correct a program given its output?

Recently I used chatGPT 4 to write a small project in Perl which involved reading of an exam file (multiple choice), comparing it to a master exam file, and scoring the student exam including fraud ...
CuriousIndeed's user avatar
0 votes
0 answers
17 views

Could an analysis of GPT4's WAIS score be published?

Similar to this: https://www.scientificamerican.com/article/i-gave-chatgpt-an-iq-test-heres-what-i-discovered/ But more detailed and in depth (subtest breakdown, including image analysis, etc.), WAIS-...
BigMistake's user avatar
0 votes
0 answers
37 views

When using Reinforcement Learning with Human Feedback to train a transformer, how do I propagate the feedback through the transformer?

I'm basically trying to replicate the processed used to create Chat GPT: Am I supposed to backpropagate? How can I do that when these aren't really errors, but rather ranking several response? Can I ...
Austin Capobianco's user avatar
0 votes
0 answers
77 views

Are "Custom Instructions" injected into the context window repeatedly?

ChatGPT (the conversational front-end to GPT 3.5 and GPT 4) includes user configurable custom instructions. They allocate 1500 characters to "what you would like chatGPT to know about you" ...
Althea Delwiche's user avatar
0 votes
0 answers
45 views

What is the reason that OpenAI implements complex context management in ChatGPT but does not use it for their API?

According to this discussion How does ChatGPT retain the context of previous questions? it is clear that OpenAI already has implemented some serious engineer to ensure that the ChatGPT experience is a ...
erotsppa's user avatar
  • 101
0 votes
0 answers
54 views

How to get GPT to complete all tasks before ending its turn?

I'm trying to figure out how ChatGPT and Code Interpreter (or anything else) gets GPT to complete an arbitrary number of actions before it ends its turn and hands it back to the user. I'm using a ...
coinmaster's user avatar
0 votes
0 answers
72 views

How does query of LLM/GPT models work?

Training of LLM aka GPT models is clear on how is trained but can't find any info how is "mapped" query to internal tokens and generates response tokens more precise inference phase which ...
n1tk's user avatar
  • 101
0 votes
0 answers
192 views

ChatGPT request/prompt structure: Put Persona into the "system" field. Add or replace?

On  playground.openapi.com   we see a more advanced view of the chat window that chat.openai.com offers (that's the more well-known GUI shown in countlerss screenshots and tutorial videos). On the ...
knb's user avatar
  • 165
0 votes
0 answers
263 views

Extract multiple records from raw text using open AI API function calls

Trying to extract records from pdf. The plan was to convert pdf data to raw text and use open AI api calls to extract the data in a desired format (csv). This is because the pdf data is very ...
viraj jadhav's user avatar
0 votes
0 answers
553 views

ChatGPT4all to create chatbot to answer questions on your own docs without external calls

So, I came across this Tutorial (Apologies, if you cannot access it, it is a member's only story) and I gave it a shot. Technically, it "works". However, it seems to be a bit poor in the ...
Abhishek Rai's user avatar
0 votes
0 answers
56 views

What is actually tuned during prompt engineering of autoregressive LLMs like GPT?

There are a lot of sites going over prompt engineering, but I don't see them explaining what is actually being changed. Is it hidden activation layers being tuned?
user14094230's user avatar
0 votes
0 answers
1k views

What are the similarities and differences between ChatGPT and YouChat?

I have recently tried the both, and it looks to me that the both have similar capabilities. YouChat says ChatGPT is more advanced. YouChat has connection to the Internet, and according to it, ...
Anixx's user avatar
  • 331
0 votes
0 answers
182 views

Does ChatGPT's limited understanding of novel inputs reveal limitations in language's ability to convey meaning?

As a language model, ChatGPT generate responses based on patterns they have learned from the data they were trained on. However, it may not always provide a perfect or complete answer to novel or ...
Faizy's user avatar
  • 1,114
0 votes
1 answer
405 views

How does Chat GPT encode a question?

Chat GPT is based on a decoder-only Transformer so it does not have an encoder. Given that, how is a user's question passed as input to Chat GPT's decoder? In a regular encoder-decoder architecture, ...
joan's user avatar
  • 1