Questions tagged [open-ai]

For questions related to the openAI, including the Gym toolkit.

Filter by
Sorted by
Tagged with
-2 votes
0 answers
14 views

how to address the rate limiting issue with ChatGPT-3.5? [closed]

ChatGPT has a rate limiting policy that restricts frequent access within a certain time period, resulting in denial of access. I would like to know how to overcome this issue and make multiple ...
limu593's user avatar
0 votes
1 answer
35 views

How LLM keeps the context of a chat/thread

How an LLM keeps the context (what has already been entered by the user) of a chat/thread? For reference, in chat.openai.com, for each chat we create (or a Thread according to their API), the LLM ...
Wenuka's user avatar
  • 103
0 votes
0 answers
49 views

What is 'system card'?

What is 'system card' in these context: https://ai.meta.com/blog/system-cards-a-new-resource-for-understanding-how-ai-systems-work/ Additionally, individual model developers may provide ...
Vy Do's user avatar
  • 99
25 votes
3 answers
14k views

Why do ChatGPT “jailbreaks” work?

Do developers not genuinely want to prevent them? It seems like if they are able to develop such impressive AI models then it wouldn’t be that difficult to create catch-all/wildcard mitigations to the ...
Seeking answers's user avatar
0 votes
1 answer
45 views

Does retriever-augmented generation enable the LLM to violate my data privacy?

I understand in RAG, documents are sent (perhaps in embedded form?) to an LLM. Supposing one uses openAI as in this popular demo, would it send my data to them, thus with a potential data privacy risk?...
PDiracDelta's user avatar
1 vote
0 answers
63 views

LLM for Postgres

I have a postgres database with 200+ Tables. Each table contains information about my supply inventory. It also contains columns which are JSON and there are nested JSON as well. There are ...
Shivkumar Mallesappa's user avatar
0 votes
0 answers
65 views

claude 2 doesn't know basic math? [duplicate]

Sometimes, when I see answers like this from large language models, it makes me feel disgusted: Me: Does Voyager 1 have enough velocity to escape the solar system without using Jupiter's gravity ...
Mr Saw's user avatar
  • 1
1 vote
1 answer
40 views

Help for my custom ENV with GYM, trying with DQN

I created a custom env to simulate a sort of blocks using gym enviroments. My environment consists of an 8 x 8 observation space, which would be the stacks of blocks and the height of each stack. <...
Betnem's user avatar
  • 11
2 votes
0 answers
134 views

What type of fine-tuning does the OpenAI API use?

They have instructions on how to fine-tune. But I'm not clear on the type of fine-tuning that is done. Maybe this is mentioned somewhere. I would imagine it's some type of PEFT to avoid catastrophic ...
user14094230's user avatar
0 votes
0 answers
32 views

What is the reason that OpenAI implements complex context management in ChatGPT but does not use it for their API?

According to this discussion How does ChatGPT retain the context of previous questions? it is clear that OpenAI already has implemented some serious engineer to ensure that the ChatGPT experience is a ...
erotsppa's user avatar
  • 101
1 vote
1 answer
81 views

How to disapprove some who says that AI is capable of irrational thought and emotions

A teacher of mine said something of about AI being self sufficient and operating on experience. They backed this statement by this example-a car programmed to avoid ramming into apple, mango and banna ...
MagiTech's user avatar
-2 votes
1 answer
27 views

Dynamic text completion [closed]

I am using the get_completion function to generate response to a question. Since generating response takes a long time (~5 seconds) I would like to display the response text as it's generated (...
afshi7n's user avatar
  • 97
0 votes
1 answer
36 views

How to prompt Open AI for a variable list length?

I struggle to get a variable list out of Open AIs GPT-3.5. Even with a prompt like ...
flori's user avatar
  • 101
3 votes
2 answers
552 views

How do you deal with movement inertia in an environment after a step?

I was wondering how can we deal with movement inertia in an environment that is constantly changing? Imagine that you make a step on an environment that moves a ball. When you make the step, you make ...
CyDevos's user avatar
  • 145
0 votes
1 answer
56 views

Noob crafting a simple "Zero-Shot Classifier" Using an API . How can I avoid passing the categories every single request? [closed]

I have a collection of 700 categories, all potential classifications for articles. My current need is to create a system that can dynamically categorize short texts or articles according to these 700 ...
Advanced's user avatar
  • 109
3 votes
1 answer
145 views

Match two paragraphs of text

I'm building a friend finder app and I need to match people based on a paragraph of text. Here is an example of what I mean: Person A: I love walking and going to the beach, I also love reading and ...
Dom's user avatar
  • 31
0 votes
1 answer
573 views

Why does LLM inference cost scale in both input tokens and output tokens?

EDIT This question was flawed. See my answer with help from commenters. Original question This question has been asked in other forums [1] [2] but I'm not sure I understand the claims, which are (...
llllvvuu's user avatar
  • 146
2 votes
3 answers
2k views

How do open source LLMs compare to GPT-4?

I have heard some back and forth regarding open source LLMs like Llama. I have heard that on certain benchmarks they perform close, the same or better than GPT-4, but caveats that they tend to lack ...
Julius H.'s user avatar
  • 133
0 votes
0 answers
11 views

Update OpenAI embedding based on own domain corpus

I have a large domain corpus. Is there anyway to update the word/sentence/document embedding obtained from OpenAI embedding API based on my own domain corpus? There may be some words in my corpus that ...
Salty Gold Fish's user avatar
0 votes
0 answers
193 views

Extract multiple records from raw text using open AI API function calls

Trying to extract records from pdf. The plan was to convert pdf data to raw text and use open AI api calls to extract the data in a desired format (csv). This is because the pdf data is very ...
viraj jadhav's user avatar
0 votes
0 answers
178 views

How is OpenAI embeddings obtained

There is OpenAI embedding API https://platform.openai.com/docs/guides/embeddings. How is this embedding related to the GPT3.5 transformer model architecture? Is it the vectors learned from the input ...
Salty Gold Fish's user avatar
-1 votes
1 answer
77 views

Machine Learning Math Requirements [duplicate]

What area of math do i need for AI and ML? and some recommendations for YouTube math's playlist I've just started to learn to code in python and i want to go to the path of AI/ML
Kenezzu Len's user avatar
0 votes
0 answers
12 views

Consider an AI Image generation system AI IMAGe. How hard is it to remove specific images from the training dataset and all traces of the images?

Consider an AI image generation system called AI IMAGE. Suppose someone wanted to remove 100 of their photos that had been used to train AI IMAGE for a year in generating images. Would it be easy to ...
gamedesigner's user avatar
0 votes
0 answers
26 views

Are the dimensions in embedding vectors ordered (similar to PCA)?

I am getting started with the vector embeddings. I have a general question about the embedding vectors generated by popular algorithms. In PCA, usually, there is an implicit order of importance in the ...
JackDaniels's user avatar
0 votes
1 answer
87 views

How do you define an action space for a card game with an unlimited and variable hand size?

I'm new to the world of AI and have been primarily reading through the documentation for OpenAI's Gym/Gymnasium in hopes of training an AI to play a board game. One piece of information I haven't been ...
haec0007's user avatar
0 votes
1 answer
146 views

Can transformer models be used to convert code from one programming language to another?

There was a question like this in 2019. I hope things have changed since then. Concretely, I am looking for a way to train a transformer model to convert code from SAS to Python. I guess the method ...
Vladimir's user avatar
0 votes
0 answers
114 views

Improving embedding similarity search of aggregated embeddings

I am building an author suggestion tool that proposes authors writing about similar topics as a given input text. I want to use embeddings for this. The way I currently do it is to store embeddings of ...
Stefan's user avatar
  • 1
0 votes
1 answer
2k views

can GPU crypto mining rigs be converted to train or run AI? [closed]

SHORT VERSION: "I've got a bunch of GPU mining rigs, surely I can do something useful with them like train my own AI or provide hashing power to astronomy or genome folding operations?" TLDR:...
Christian Žagarskas's user avatar
3 votes
1 answer
7k views

OpenAI: What is the difference between model "gpt-3.5-turbo" and "gpt-3.5-turbo-0301"?

I have performed an API call to OpenAI's endpoint https://api.openai.com/v1/models . The endpoint lists the currently available engines, and provides basic information about each one such as the owner ...
knb's user avatar
  • 165
4 votes
1 answer
2k views

What's the difference between GPT3.5 and InstructGPT?

I read about the different model series in GPT3.5 here - https://platform.openai.com/docs/models/gpt-3-5 At the beginning of the page, it mentions to look at https://platform.openai.com/docs/model-...
Arya's user avatar
  • 41
1 vote
1 answer
268 views

Summarizing articles with ChatGPT [closed]

You cannot upload files such as articles on ChatGPT. As an alternative I provided links to ChatGPT of the corresponding webpages but it is clear from its summaries that it is not able to open the link ...
Andrew's user avatar
  • 119
-1 votes
1 answer
156 views

Could it be probable to quantify or measure the IQ of a super-intelligent machine like GPT? [closed]

In the age of artificial intelligence, super-intelligent machines like GPT have become a reality, leading to the question of how to quantify or measure their intelligence. While IQ tests are widely ...
R1-'s user avatar
  • 137
8 votes
2 answers
878 views

Is GPT-4 based on GPT-3 or was it trained from the scratch?

To me it looks like GPT-4 is based on GPT-3. On the other hand, there were rumors that training of GPT-3 was done with errors, but re-train was impossible due to the costs.
Anixx's user avatar
  • 311
2 votes
1 answer
479 views

Creating a support chat bot for my business

I am trying to create a kind of Support Bot to answer my clients about specific technical details about WordPress plugins that I sell. The goal is that the /completitions api would be feeded a prompt ...
digitalzoomstudio's user avatar
0 votes
0 answers
284 views

When would you use prompting vs. fine tuning?

I would like to hear your thoughts on when is it appropriate to use prompting vs. fine-tuning. Does one make more sense for specific tasks than the other. Kindly elaborate.
Josiah Cheruiyot's user avatar
5 votes
2 answers
1k views

Would self-hosting ChatGPT be feasible, w.r.t. computation costs?

Suppose the pre-trained, current date (2023-02-04) ChatGPT model was released open source, would it be feasible for regular users to interact with the model on a self-hosted computer? Assumptions I ...
a.t.'s user avatar
  • 233
9 votes
2 answers
3k views

Are GPT-3.5 series models based on GPT-3?

In the official blog post about ChatGPT from OpenAI, there is this paragraph explaining how ChatGPT model was trained: We trained this model using Reinforcement Learning from Human Feedback (RLHF), ...
iMad's user avatar
  • 193
0 votes
1 answer
954 views

How to assess if OpenAI's ChatGPT chatbot has a human in the loop? [closed]

I've asked a question and given a couple answers that propose the OpenAI ChatGPT chatbot has humans in the loop (HITL), and that explains the chatbot's extraordinary abilities. I've been repeatedly ...
yters's user avatar
  • 387
0 votes
0 answers
42 views

What is a good strategy for breaking up content into prompts and completions for OpenAI fine tuning?

I want to train a fine-tuned openai model to know more about specific Judo throws and training methodologies. I have a bunch of documents I have written on Judo throws that I would like to use for ...
Casey Jordan's user avatar
5 votes
2 answers
1k views

InstructGPT: What is the sigma in the loss function and why $\log(\cdot)$ is being used?

InstructGPT: What is the sigma in the loss function and why $\log(\cdot)$ is being used? $$ \operatorname{loss}(\theta) = -\frac{1}{\binom{K}{2}}E_{(x,y_w,y_l)\sim D}[\log(\sigma(r_{\theta}(x, y_w) - ...
Nathan B's user avatar
  • 161
4 votes
0 answers
3k views

How is ChatGPT maintaining context?

It has been suggested in the answer to this earlier question that it is just remembering a certain amount of recent information. The reference used is this post by OpenAI which says that ChatGPT ...
Kay999's user avatar
  • 41
0 votes
0 answers
1k views

What are the similarities and differences between ChatGPT and YouChat?

I have recently tried the both, and it looks to me that the both have similar capabilities. YouChat says ChatGPT is more advanced. YouChat has connection to the Internet, and according to it, ...
Anixx's user avatar
  • 311
5 votes
1 answer
2k views

Why does ChatGPT create fake code?

ChatGPT has been a big thing lately. It also makes a lot of mistakes. For example, it creates fake functions of a package and tells it as it works for real. I was wondering how that works. Why is it ...
Quinten's user avatar
  • 165
2 votes
0 answers
5k views

Is there a way to determine if code has been autogenerated by an AI source?

Lately, our Junior developer has been producing code fixes very quickly. At first, I was excited for him as I thought he was starting to retain information and proving he was able to research and fix ...
FreddyNoNose's user avatar
-1 votes
1 answer
61 views

What is the Need for AI Developers since we have AI APIs Now?

I am new to AI and passionate about it. I have a fair knowledge of deep learning and I am into computer vision. I am eyeing NLP as well. I just want to know the need for an AI developer in computer ...
Mr Prof's user avatar
  • 101
0 votes
0 answers
171 views

Does ChatGPT's limited understanding of novel inputs reveal limitations in language's ability to convey meaning?

As a language model, ChatGPT generate responses based on patterns they have learned from the data they were trained on. However, it may not always provide a perfect or complete answer to novel or ...
Faizy's user avatar
  • 1,094
2 votes
1 answer
4k views

How do ChatGPT content filters work? (If not chatGPT then in general) [closed]

I first tried ChatGPT few days ago. And every day that goes by it seems more and more content filters are introduced. I can still make it do stuff if I "jailbreak it" but I feel like the ...
user3280964's user avatar
4 votes
4 answers
4k views

How does ChatGPT respond to novel prompts and commands?

So I understand how a language model could scan a large data set like the internet and produce text that mimicked the statistical properties of the input data, eg completing a sentence like "eggs ...
ak0000's user avatar
  • 205
8 votes
4 answers
49k views

OpenAI ChatGPT gives a network error at long responds. How can I fix it? [closed]

When OpenAI's ChatGPT replies with a very long answer, it will return a network error. When you check the network console, the POST request will fail with a ...
Lars Flieger's user avatar
1 vote
1 answer
242 views

OpeanAI Gym. Train problem: invalid values [closed]

I have a problem with my reinforcement learning model. I am trying to simulate an electric battery storage. To keep it as simple as possible, the efficiency of charge, storage and discharge are 100%. ...
MiPre's user avatar
  • 13