Skip to main content
Share Your Experience: Take the 2024 Developer Survey

Questions tagged [open-ai]

For questions related to the openAI, including the Gym toolkit.

Filter by
Sorted by
Tagged with
0 votes
0 answers
12 views

NLP based JSON generator - Part 3 [closed]

a newbie here. Here's the problem statement: Generate a JSON based rule for a given text. The JSON being generated is not a random JSON but based on a tool that accepts well defined JSON based grammar....
SQLProfiler's user avatar
0 votes
0 answers
29 views

Model for NLP based JSON generator

a newbie here. Here's the problem statement: Generate a JSON based rule for a given text. The JSON being generated is not a random JSON but based on a tool that accepts well defined JSON based grammar....
SQLProfiler's user avatar
-1 votes
0 answers
8 views

Data presentation graduality and presentation graduality (pages) speed of depth (how fast the data in pages is presented) [closed]

I would like to ask, how does artificial intelligence navigate knowledge, to determine the most suitable, presentation, and presentation gradualità, of data. In books, normally, diagram present a ...
Joselin Jocklingson's user avatar
0 votes
0 answers
15 views

How Does AI-Generated Content Differ From Human-Written Content?

How Can I Determine if a Piece of Content Has Been Generated by AI?
Micky E.'s user avatar
0 votes
0 answers
14 views

How to design a custom openai gym environment to carry out 5G resource slicing?

PROBLEM AT HAND: I have a resource (Bandwidth) of B Hz. I have to distribute the bandwidth B to users as per their requirements. For instance, voice calls would require some amount of bandwidth while ...
ANWESA ROY's user avatar
0 votes
0 answers
28 views

Clustering doubt : GPT-4 to name the clusters [closed]

In https://cookbook.openai.com/examples/clustering, under Part-2; it says "let's show random samples from each cluster. We'll use gpt-4 to name the clusters, based on a random sample of 5 reviews ...
Mrinmay's user avatar
0 votes
0 answers
25 views

Parametric noise over Input noise

I came across this research from 2017 that talked about using "Parametric noise" instead of input based noise. I have tried to have it in my PPO based Boid flocking custom environment but ...
Hamza's user avatar
  • 1
0 votes
0 answers
17 views

in the "reward to go" trick in policy gradient methods, I have a question about the proof?

I am specifically talking about this proof Why does the "reward to go" trick in policy gradient methods work? where Dennis says 'on ith iteration the outer sum of random variable and ...
abhilash sharma's user avatar
0 votes
1 answer
81 views

Train my own LLM on a smaller corpus of text?

Would it be possible to train my own LLM on a smaller corpus of text, lets say some coding documentation that I then want to ask questions about using the model? If so, are there any recommended ways ...
Dylan Dijk's user avatar
0 votes
0 answers
13 views

Unable to Save Generated Data to JSONL File - Always Resulting in "Wrote 0 examples to finetuning_events.jsonl" Message

Issue Description When attempting to generate JSONL data using Llama Index, the process works well until the final step where the results are saved to a JSONL file. However, every time I try to save ...
gluck0101's user avatar
  • 101
0 votes
0 answers
177 views

Where do you keep track of Chat History for an LLM Chat Application?

I am creating a LLM chat app with LangChain. I am keeping track of the chat history with a simple array that gets sent to the LLM with every prompt. I noticed LangChain also has classes that ...
Kokodoko's user avatar
  • 167
0 votes
0 answers
19 views

Do Poe AI, Open AI and Claude AI have the ability to retain information from previous queries or remember previous responses?

Do Poe AI, Open AI,and Claude AI have the ability to retain information from previous queries or remember previous responses?
Jimi A's user avatar
  • 1
0 votes
0 answers
21 views

Do Poe AI, Open AI, and Claude AI generate all answers from training data, including factual and logical answers or from personal information?

Do Poe AI, Open AI, and Claude AI generate all answers from training data, including factual and logical answers or from firsthand personal information?
Jimi A's user avatar
  • 1
0 votes
0 answers
30 views

DDPG input incompatible in OpenAI Gym custom environment

I have a custom OpenAI Gym Boid flocking environment using StableBAselines3 for DDPG. This error I encounter occurred previously due to wrong input size of actions. But my reset function is correct, ...
Hamza's user avatar
  • 1
0 votes
1 answer
93 views

How does chatgpt interpret prompts? [closed]

First of all, my English isn't very good, please bear with me. I've heard that chatgpt is a decoder-only model, which doesn't use any encoder model. How does it interpret our prompts if it doesn't use ...
duh's user avatar
  • 11
1 vote
1 answer
419 views

What is accelerated years in describing the amount of the training time?

As described in this article, it was written that GPT-3 took 405 V100 years to train in 2020. I'm a bit confused about this definition, does that mean the process was accelerated like using a V100 GPU ...
Marziye Hasanshahi's user avatar
1 vote
1 answer
839 views

How LLM keeps the context of a chat/thread

How an LLM keeps the context (what has already been entered by the user) of a chat/thread? For reference, in chat.openai.com, for each chat we create (or a Thread according to their API), the LLM ...
Wenuka's user avatar
  • 111
1 vote
0 answers
206 views

What is 'system card'?

What is 'system card' in these context: https://ai.meta.com/blog/system-cards-a-new-resource-for-understanding-how-ai-systems-work/ Additionally, individual model developers may provide ...
Vy Do's user avatar
  • 111
27 votes
4 answers
15k views

Why do ChatGPT “jailbreaks” work?

Do developers not genuinely want to prevent them? It seems like if they are able to develop such impressive AI models then it wouldn’t be that difficult to create catch-all/wildcard mitigations to the ...
TylerDurden's user avatar
0 votes
1 answer
83 views

Does retriever-augmented generation enable the LLM to violate my data privacy?

I understand in RAG, documents are sent (perhaps in embedded form?) to an LLM. Supposing one uses openAI as in this popular demo, would it send my data to them, thus with a potential data privacy risk?...
PDiracDelta's user avatar
1 vote
0 answers
163 views

LLM for Postgres

I have a postgres database with 200+ Tables. Each table contains information about my supply inventory. It also contains columns which are JSON and there are nested JSON as well. There are ...
Shivkumar Mallesappa's user avatar
0 votes
0 answers
70 views

claude 2 doesn't know basic math? [duplicate]

Sometimes, when I see answers like this from large language models, it makes me feel disgusted: Me: Does Voyager 1 have enough velocity to escape the solar system without using Jupiter's gravity ...
Mr Saw's user avatar
  • 1
1 vote
1 answer
51 views

Help for my custom ENV with GYM, trying with DQN

I created a custom env to simulate a sort of blocks using gym enviroments. My environment consists of an 8 x 8 observation space, which would be the stacks of blocks and the height of each stack. <...
Betnem's user avatar
  • 11
2 votes
0 answers
151 views

What type of fine-tuning does the OpenAI API use?

They have instructions on how to fine-tune. But I'm not clear on the type of fine-tuning that is done. Maybe this is mentioned somewhere. I would imagine it's some type of PEFT to avoid catastrophic ...
user14094230's user avatar
0 votes
0 answers
47 views

What is the reason that OpenAI implements complex context management in ChatGPT but does not use it for their API?

According to this discussion How does ChatGPT retain the context of previous questions? it is clear that OpenAI already has implemented some serious engineer to ensure that the ChatGPT experience is a ...
erotsppa's user avatar
  • 101
1 vote
1 answer
90 views

How to disapprove some who says that AI is capable of irrational thought and emotions

A teacher of mine said something of about AI being self sufficient and operating on experience. They backed this statement by this example-a car programmed to avoid ramming into apple, mango and banna ...
MagiTech's user avatar
-2 votes
1 answer
31 views

Dynamic text completion [closed]

I am using the get_completion function to generate response to a question. Since generating response takes a long time (~5 seconds) I would like to display the response text as it's generated (...
afshi7n's user avatar
  • 97
0 votes
1 answer
149 views

How to prompt an LLM for a real variable list length? [closed]

I struggle to get a variable list out of an LLM. Even with a prompt like ...
flori's user avatar
  • 109
3 votes
2 answers
571 views

How do you deal with movement inertia in an environment after a step?

I was wondering how can we deal with movement inertia in an environment that is constantly changing? Imagine that you make a step on an environment that moves a ball. When you make the step, you make ...
CyDevos's user avatar
  • 145
0 votes
1 answer
83 views

Noob crafting a simple "Zero-Shot Classifier" Using an API . How can I avoid passing the categories every single request? [closed]

I have a collection of 700 categories, all potential classifications for articles. My current need is to create a system that can dynamically categorize short texts or articles according to these 700 ...
Advanced's user avatar
  • 109
3 votes
1 answer
311 views

Match two paragraphs of text

I'm building a friend finder app and I need to match people based on a paragraph of text. Here is an example of what I mean: Person A: I love walking and going to the beach, I also love reading and ...
Dom's user avatar
  • 31
0 votes
1 answer
1k views

Why does LLM inference cost scale in both input tokens and output tokens?

EDIT This question was flawed. See my answer with help from commenters. Original question This question has been asked in other forums [1] [2] but I'm not sure I understand the claims, which are (...
llllvvuu's user avatar
  • 146
5 votes
3 answers
3k views

How do open source LLMs compare to GPT-4?

I have heard some back and forth regarding open source LLMs like Llama. I have heard that on certain benchmarks they perform close, the same or better than GPT-4, but caveats that they tend to lack ...
Julius Hamilton's user avatar
0 votes
0 answers
15 views

Update OpenAI embedding based on own domain corpus

I have a large domain corpus. Is there anyway to update the word/sentence/document embedding obtained from OpenAI embedding API based on my own domain corpus? There may be some words in my corpus that ...
Salty Gold Fish's user avatar
0 votes
0 answers
274 views

Extract multiple records from raw text using open AI API function calls

Trying to extract records from pdf. The plan was to convert pdf data to raw text and use open AI api calls to extract the data in a desired format (csv). This is because the pdf data is very ...
viraj jadhav's user avatar
1 vote
0 answers
283 views

How is OpenAI embeddings obtained

There is OpenAI embedding API https://platform.openai.com/docs/guides/embeddings. How is this embedding related to the GPT3.5 transformer model architecture? Is it the vectors learned from the input ...
Salty Gold Fish's user avatar
0 votes
1 answer
146 views

Machine Learning Math Requirements [duplicate]

What area of math do i need for AI and ML? and some recommendations for YouTube math's playlist I've just started to learn to code in python and i want to go to the path of AI/ML
Kenezzu Len's user avatar
0 votes
0 answers
14 views

Consider an AI Image generation system AI IMAGe. How hard is it to remove specific images from the training dataset and all traces of the images?

Consider an AI image generation system called AI IMAGE. Suppose someone wanted to remove 100 of their photos that had been used to train AI IMAGE for a year in generating images. Would it be easy to ...
gamedesigner's user avatar
0 votes
0 answers
31 views

Are the dimensions in embedding vectors ordered (similar to PCA)?

I am getting started with the vector embeddings. I have a general question about the embedding vectors generated by popular algorithms. In PCA, usually, there is an implicit order of importance in the ...
JackDaniels's user avatar
0 votes
1 answer
150 views

How do you define an action space for a card game with an unlimited and variable hand size?

I'm new to the world of AI and have been primarily reading through the documentation for OpenAI's Gym/Gymnasium in hopes of training an AI to play a board game. One piece of information I haven't been ...
haec0007's user avatar
0 votes
1 answer
212 views

Can transformer models be used to convert code from one programming language to another?

There was a question like this in 2019. I hope things have changed since then. Concretely, I am looking for a way to train a transformer model to convert code from SAS to Python. I guess the method ...
Vladimir's user avatar
0 votes
0 answers
126 views

Improving embedding similarity search of aggregated embeddings

I am building an author suggestion tool that proposes authors writing about similar topics as a given input text. I want to use embeddings for this. The way I currently do it is to store embeddings of ...
Stefan's user avatar
  • 1
0 votes
1 answer
4k views

can GPU crypto mining rigs be converted to train or run AI? [closed]

SHORT VERSION: "I've got a bunch of GPU mining rigs, surely I can do something useful with them like train my own AI or provide hashing power to astronomy or genome folding operations?" TLDR:...
Christian Žagarskas's user avatar
3 votes
1 answer
8k views

OpenAI: What is the difference between model "gpt-3.5-turbo" and "gpt-3.5-turbo-0301"?

I have performed an API call to OpenAI's endpoint https://api.openai.com/v1/models . The endpoint lists the currently available engines, and provides basic information about each one such as the owner ...
knb's user avatar
  • 165
4 votes
1 answer
2k views

What's the difference between GPT3.5 and InstructGPT?

I read about the different model series in GPT3.5 here - https://platform.openai.com/docs/models/gpt-3-5 At the beginning of the page, it mentions to look at https://platform.openai.com/docs/model-...
Arya's user avatar
  • 41
1 vote
1 answer
283 views

Summarizing articles with ChatGPT [closed]

You cannot upload files such as articles on ChatGPT. As an alternative I provided links to ChatGPT of the corresponding webpages but it is clear from its summaries that it is not able to open the link ...
Andrew's user avatar
  • 119
-1 votes
1 answer
163 views

Could it be probable to quantify or measure the IQ of a super-intelligent machine like GPT? [closed]

In the age of artificial intelligence, super-intelligent machines like GPT have become a reality, leading to the question of how to quantify or measure their intelligence. While IQ tests are widely ...
R1-'s user avatar
  • 137
8 votes
2 answers
1k views

Is GPT-4 based on GPT-3 or was it trained from the scratch?

To me it looks like GPT-4 is based on GPT-3. On the other hand, there were rumors that training of GPT-3 was done with errors, but re-train was impossible due to the costs.
Anixx's user avatar
  • 331
2 votes
1 answer
705 views

Creating a support chat bot for my business

I am trying to create a kind of support bot to answer questions from my clients about specific technical details about WordPress plugins that I sell. The goal is that the ...
digitalzoomstudio's user avatar
0 votes
0 answers
300 views

When would you use prompting vs. fine tuning?

I would like to hear your thoughts on when is it appropriate to use prompting vs. fine-tuning. Does one make more sense for specific tasks than the other. Kindly elaborate.
Josiah Cheruiyot's user avatar