Questions tagged [open-ai]
For questions related to the openAI, including the Gym toolkit.
114
questions
-2
votes
0
answers
14
views
how to address the rate limiting issue with ChatGPT-3.5? [closed]
ChatGPT has a rate limiting policy that restricts frequent access within a certain time period, resulting in denial of access. I would like to know how to overcome this issue and make multiple ...
- 1
0
votes
1
answer
35
views
How LLM keeps the context of a chat/thread
How an LLM keeps the context (what has already been entered by the user) of a chat/thread?
For reference, in chat.openai.com, for each chat we create (or a Thread according to their API), the LLM ...
- 103
0
votes
0
answers
49
views
What is 'system card'?
What is 'system card' in these context:
https://ai.meta.com/blog/system-cards-a-new-resource-for-understanding-how-ai-systems-work/
Additionally, individual model developers may provide ...
- 99
25
votes
3
answers
14k
views
Why do ChatGPT “jailbreaks” work?
Do developers not genuinely want to prevent them? It seems like if they are able to develop such impressive AI models then it wouldn’t be that difficult to create catch-all/wildcard mitigations to the ...
- 369
0
votes
1
answer
45
views
Does retriever-augmented generation enable the LLM to violate my data privacy?
I understand in RAG, documents are sent (perhaps in embedded form?) to an LLM.
Supposing one uses openAI as in this popular demo, would it send my data to them, thus with a potential data privacy risk?...
- 101
1
vote
0
answers
63
views
LLM for Postgres
I have a postgres database with 200+ Tables. Each table contains information about my supply inventory. It also contains columns which are JSON and there are nested JSON as well. There are ...
0
votes
0
answers
65
views
claude 2 doesn't know basic math? [duplicate]
Sometimes, when I see answers like this from large language models, it makes me feel disgusted:
Me: Does Voyager 1 have enough velocity to escape the solar system without using Jupiter's gravity ...
- 1
1
vote
1
answer
40
views
Help for my custom ENV with GYM, trying with DQN
I created a custom env to simulate a sort of blocks using gym enviroments.
My environment consists of an 8 x 8 observation space, which would be the stacks of blocks and the height of each stack.
<...
- 11
2
votes
0
answers
134
views
What type of fine-tuning does the OpenAI API use?
They have instructions on how to fine-tune. But I'm not clear on the type of fine-tuning that is done. Maybe this is mentioned somewhere. I would imagine it's some type of PEFT to avoid catastrophic ...
- 121
0
votes
0
answers
32
views
What is the reason that OpenAI implements complex context management in ChatGPT but does not use it for their API?
According to this discussion
How does ChatGPT retain the context of previous questions?
it is clear that OpenAI already has implemented some serious engineer to ensure that the ChatGPT experience is a ...
- 101
1
vote
1
answer
81
views
How to disapprove some who says that AI is capable of irrational thought and emotions
A teacher of mine said something of about AI being self sufficient and operating on experience. They backed this statement by this example-a car programmed to avoid ramming into apple, mango and banna ...
- 11
-2
votes
1
answer
27
views
Dynamic text completion [closed]
I am using the get_completion function to generate response to a question. Since generating response takes a long time (~5 seconds) I would like to display the response text as it's generated (...
- 97
0
votes
1
answer
36
views
How to prompt Open AI for a variable list length?
I struggle to get a variable list out of Open AIs GPT-3.5. Even with a prompt like
...
- 101
3
votes
2
answers
552
views
How do you deal with movement inertia in an environment after a step?
I was wondering how can we deal with movement inertia in an environment that is constantly changing?
Imagine that you make a step on an environment that moves a ball. When you make the step, you make ...
- 145
0
votes
1
answer
56
views
Noob crafting a simple "Zero-Shot Classifier" Using an API . How can I avoid passing the categories every single request? [closed]
I have a collection of 700 categories, all potential classifications for articles. My current need is to create a system that can dynamically categorize short texts or articles according to these 700 ...
- 109
3
votes
1
answer
145
views
Match two paragraphs of text
I'm building a friend finder app and I need to match people based on a paragraph of text. Here is an example of what I mean:
Person A:
I love walking and going to the beach, I also love reading and ...
- 31
0
votes
1
answer
573
views
Why does LLM inference cost scale in both input tokens and output tokens?
EDIT
This question was flawed. See my answer with help from commenters.
Original question
This question has been asked in other forums [1] [2] but I'm not sure I understand the claims, which are (...
- 146
2
votes
3
answers
2k
views
How do open source LLMs compare to GPT-4?
I have heard some back and forth regarding open source LLMs like Llama.
I have heard that on certain benchmarks they perform close, the same or better than GPT-4, but caveats that they tend to lack ...
- 133
0
votes
0
answers
11
views
Update OpenAI embedding based on own domain corpus
I have a large domain corpus. Is there anyway to update the word/sentence/document embedding obtained from OpenAI embedding API based on my own domain corpus? There may be some words in my corpus that ...
- 101
0
votes
0
answers
193
views
Extract multiple records from raw text using open AI API function calls
Trying to extract records from pdf. The plan was to convert pdf data to raw text and use open AI api calls to extract the data in a desired format (csv). This is because the pdf data is very ...
0
votes
0
answers
178
views
How is OpenAI embeddings obtained
There is OpenAI embedding API https://platform.openai.com/docs/guides/embeddings. How is this embedding related to the GPT3.5 transformer model architecture? Is it the vectors learned from the input ...
- 101
-1
votes
1
answer
77
views
Machine Learning Math Requirements [duplicate]
What area of math do i need for AI and ML? and some recommendations for YouTube math's playlist
I've just started to learn to code in python and i want to go to the path of AI/ML
0
votes
0
answers
12
views
Consider an AI Image generation system AI IMAGe. How hard is it to remove specific images from the training dataset and all traces of the images?
Consider an AI image generation system called AI IMAGE. Suppose someone wanted to remove 100 of their photos that had been used to train AI IMAGE for a year in generating images. Would it be easy to ...
0
votes
0
answers
26
views
Are the dimensions in embedding vectors ordered (similar to PCA)?
I am getting started with the vector embeddings. I have a general question about the embedding vectors generated by popular algorithms.
In PCA, usually, there is an implicit order of importance in the ...
- 101
0
votes
1
answer
87
views
How do you define an action space for a card game with an unlimited and variable hand size?
I'm new to the world of AI and have been primarily reading through the documentation for OpenAI's Gym/Gymnasium in hopes of training an AI to play a board game. One piece of information I haven't been ...
- 1
0
votes
1
answer
146
views
Can transformer models be used to convert code from one programming language to another?
There was a question like this in 2019. I hope things have changed since then.
Concretely, I am looking for a way to train a transformer model to convert code from SAS to Python. I guess the method ...
- 51
0
votes
0
answers
114
views
Improving embedding similarity search of aggregated embeddings
I am building an author suggestion tool that proposes authors writing about similar topics as a given input text. I want to use embeddings for this. The way I currently do it is to store embeddings of ...
- 1
0
votes
1
answer
2k
views
can GPU crypto mining rigs be converted to train or run AI? [closed]
SHORT VERSION:
"I've got a bunch of GPU mining rigs, surely I can do something useful with them like train my own AI or provide hashing power to astronomy or genome folding operations?"
TLDR:...
3
votes
1
answer
7k
views
OpenAI: What is the difference between model "gpt-3.5-turbo" and "gpt-3.5-turbo-0301"?
I have performed an API call to OpenAI's endpoint https://api.openai.com/v1/models .
The endpoint lists the currently available engines, and provides basic information about each one such as the owner ...
- 165
4
votes
1
answer
2k
views
What's the difference between GPT3.5 and InstructGPT?
I read about the different model series in GPT3.5 here - https://platform.openai.com/docs/models/gpt-3-5
At the beginning of the page, it mentions to look at https://platform.openai.com/docs/model-...
- 41
1
vote
1
answer
268
views
Summarizing articles with ChatGPT [closed]
You cannot upload files such as articles on ChatGPT. As an alternative I provided links to ChatGPT of the corresponding webpages but it is clear from its summaries that it is not able to open the link ...
- 119
-1
votes
1
answer
156
views
Could it be probable to quantify or measure the IQ of a super-intelligent machine like GPT? [closed]
In the age of artificial intelligence, super-intelligent machines like GPT have become a reality, leading to the question of how to quantify or measure their intelligence. While IQ tests are widely ...
- 137
8
votes
2
answers
878
views
Is GPT-4 based on GPT-3 or was it trained from the scratch?
To me it looks like GPT-4 is based on GPT-3.
On the other hand, there were rumors that training of GPT-3 was done with errors, but re-train was impossible due to the costs.
- 311
2
votes
1
answer
479
views
Creating a support chat bot for my business
I am trying to create a kind of Support Bot to answer my clients about specific technical details about WordPress plugins that I sell.
The goal is that the /completitions api would be feeded a prompt ...
0
votes
0
answers
284
views
When would you use prompting vs. fine tuning?
I would like to hear your thoughts on when is it appropriate to use prompting vs. fine-tuning.
Does one make more sense for specific tasks than the other.
Kindly elaborate.
5
votes
2
answers
1k
views
Would self-hosting ChatGPT be feasible, w.r.t. computation costs?
Suppose the pre-trained, current date (2023-02-04) ChatGPT model was released open source, would it be feasible for regular users to interact with the model on a self-hosted computer?
Assumptions
I ...
- 233
9
votes
2
answers
3k
views
Are GPT-3.5 series models based on GPT-3?
In the official blog post about ChatGPT from OpenAI, there is this paragraph explaining how ChatGPT model was trained:
We trained this model using Reinforcement Learning from Human Feedback
(RLHF), ...
- 193
0
votes
1
answer
954
views
How to assess if OpenAI's ChatGPT chatbot has a human in the loop? [closed]
I've asked a question and given a couple answers that propose the OpenAI ChatGPT chatbot has humans in the loop (HITL), and that explains the chatbot's extraordinary abilities.
I've been repeatedly ...
- 387
0
votes
0
answers
42
views
What is a good strategy for breaking up content into prompts and completions for OpenAI fine tuning?
I want to train a fine-tuned openai model to know more about specific Judo throws and training methodologies. I have a bunch of documents I have written on Judo throws that I would like to use for ...
- 101
5
votes
2
answers
1k
views
InstructGPT: What is the sigma in the loss function and why $\log(\cdot)$ is being used?
InstructGPT: What is the sigma in the loss function and why $\log(\cdot)$ is being used?
$$ \operatorname{loss}(\theta) = -\frac{1}{\binom{K}{2}}E_{(x,y_w,y_l)\sim D}[\log(\sigma(r_{\theta}(x, y_w) - ...
- 161
4
votes
0
answers
3k
views
How is ChatGPT maintaining context?
It has been suggested in the answer to this earlier question that it is just remembering a certain amount of recent information. The reference used is this post by OpenAI which says that ChatGPT ...
- 41
0
votes
0
answers
1k
views
What are the similarities and differences between ChatGPT and YouChat?
I have recently tried the both, and it looks to me that the both have similar capabilities.
YouChat says ChatGPT is more advanced.
YouChat has connection to the Internet, and according to it, ...
- 311
5
votes
1
answer
2k
views
Why does ChatGPT create fake code?
ChatGPT has been a big thing lately. It also makes a lot of mistakes. For example, it creates fake functions of a package and tells it as it works for real. I was wondering how that works. Why is it ...
- 165
2
votes
0
answers
5k
views
Is there a way to determine if code has been autogenerated by an AI source?
Lately, our Junior developer has been producing code fixes very quickly. At first, I was excited for him as I thought he was starting to retain information and proving he was able to research and fix ...
- 121
-1
votes
1
answer
61
views
What is the Need for AI Developers since we have AI APIs Now?
I am new to AI and passionate about it. I have a fair knowledge of deep learning and I am into computer vision. I am eyeing NLP as well.
I just want to know the need for an AI developer in computer ...
- 101
0
votes
0
answers
171
views
Does ChatGPT's limited understanding of novel inputs reveal limitations in language's ability to convey meaning?
As a language model, ChatGPT generate responses based on patterns they have learned from the data they were trained on. However, it may not always provide a perfect or complete answer to novel or ...
- 1,094
2
votes
1
answer
4k
views
How do ChatGPT content filters work? (If not chatGPT then in general) [closed]
I first tried ChatGPT few days ago. And every day that goes by it seems more and more content filters are introduced. I can still make it do stuff if I "jailbreak it" but I feel like the ...
- 121
4
votes
4
answers
4k
views
How does ChatGPT respond to novel prompts and commands?
So I understand how a language model could scan a large data set like the internet and produce text that mimicked the statistical properties of the input data, eg completing a sentence like "eggs ...
- 205
8
votes
4
answers
49k
views
OpenAI ChatGPT gives a network error at long responds. How can I fix it? [closed]
When OpenAI's ChatGPT replies with a very long answer, it will return a network error. When you check the network console, the POST request will fail with a ...
- 197
1
vote
1
answer
242
views
OpeanAI Gym. Train problem: invalid values [closed]
I have a problem with my reinforcement learning model.
I am trying to simulate an electric battery storage. To keep it as simple as possible, the efficiency of charge, storage and discharge are 100%. ...
- 13