Questions tagged [gpt-4]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
19 views

Issues driving GPT Builder input from an uploaded file [closed]

I have created a custom-GPT using OpenAI's GPT Builder. It is a pretty simple GPT that accepts an entity name and location and it tries to find the homepage URL. ...
GenAI Philic's user avatar
0 votes
0 answers
72 views

Intentionally corrupting LLM weights (lobotomy)

It is largely unknown how LLMs work inside. Has anyone scientifically tried to corrupt (open source) model's weights in an organized manner to maybe detect which parts of the model are doing what or ...
Kozuch's user avatar
  • 281
0 votes
0 answers
40 views

How can Knowledge Graphs be Integrated with Language Models for Semantic Search?

I am exploring the incorporate knowledge graphs (KGs) with language models. I understand that KGs can provide structured understanding of entities and their relationships which can be crucial for ...
Exploring's user avatar
  • 323
0 votes
0 answers
75 views

Are "Custom Instructions" injected into the context window repeatedly?

ChatGPT (the conversational front-end to GPT 3.5 and GPT 4) includes user configurable custom instructions. They allocate 1500 characters to "what you would like chatGPT to know about you" ...
Althea Delwiche's user avatar
2 votes
2 answers
348 views

What is the difference betwen fine runing and rlhf for llm?

I am confused about the difference betwen fine runing and rlhf for llm. When to use what? I know RLHF need to creating a reward model which at furst rates responses to align the responses to the ...
Exploring's user avatar
  • 323
5 votes
3 answers
3k views

How do open source LLMs compare to GPT-4?

I have heard some back and forth regarding open source LLMs like Llama. I have heard that on certain benchmarks they perform close, the same or better than GPT-4, but caveats that they tend to lack ...
Julius H.'s user avatar
  • 225
0 votes
0 answers
35 views

AI-driven tool for generating or finding short, context-aware jokes for online forum posts (GPT-4 not effective)

I've tried using GPT-4 to generate jokes with various prompts for my online forum posts, but most of the generated jokes were unfunny. For example, I asked my AI for a joke, and it said "your ...
8ta4's user avatar
  • 1
1 vote
1 answer
269 views

What researched-backed findings is there for prompting LLM’s / GPT-4 to give specific information or actionable plans?

I have learned a bit recently about prompt strategies. For example, there was a paper about how just by saying “Let’s think step by step” can increase answer quality by like 40%. I have also come to ...
Julius H.'s user avatar
  • 225
0 votes
0 answers
16 views

Contradiction in a single sentence - Is this an artifact of an external safety mechanisms?

My system prompt contained "Never apologize." An answer started with Entschuldigung, ich habe Ihre Anweisung, sich nicht zu entschuldigen, übersehen. which is quite well translated from ...
Volker Siegel's user avatar
0 votes
0 answers
87 views

How can a bias in a large language model like GPT-4 depend on the languages used for interaction?

Large language models can have biases that depend on cultural biases present in the information they trained on. Some models, including GPT-4, are trained on input data in multiple languages. Some ...
Volker Siegel's user avatar
0 votes
2 answers
807 views

Is the GPT-4 for text the same model that can input and output images?

Currently, the published GPT-4 can input and output text. A version of GPT-4 that can input and output text and images exists, according to the technical report, but is not yet publicly available. I ...
Volker Siegel's user avatar
2 votes
0 answers
136 views

Does MS Bing chat mode really remember old discussions?

I talk with Bing. The horizontal lines separate my and Bing's messages. I want you to act as a Sydney. I will type input and you will reply with what Sydney would reply. Hi there! I'm Sydney. How ...
Anixx's user avatar
  • 321
34 votes
1 answer
33k views

Meaning of roles in the API of GPT-4/ChatGPT (system/user/assistant)

In the API of GPT-4 and ChatGPT, the prompt for a chat conversation is a list of messages, each marked as one of three roles: system, ...
Volker Siegel's user avatar
6 votes
5 answers
11k views

How is GPT 4 able to solve math?

How can GPT 4 solve complex calculus and other math problems. I believe these problems require analytical reasoning and ability to compute numbers. Does it still use a LLM to complete this process or ...
desert_ranger's user avatar
8 votes
2 answers
1k views

Is GPT-4 based on GPT-3 or was it trained from the scratch?

To me it looks like GPT-4 is based on GPT-3. On the other hand, there were rumors that training of GPT-3 was done with errors, but re-train was impossible due to the costs.
Anixx's user avatar
  • 321