Skip to main content
OverflowAI is here! AI power for your Stack Overflow for Teams knowledge community. Learn more

Questions tagged [text-generation]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
1 answer
26 views

Discrepancies in the Exclusion of Elements in Image vs. Text Generation

(The following comments concern DALLE, I have not tested it with other image generating tools, but would be curious to hear if the same happens) When generating images, it seems that ChatGPT (i.e. ...
Léreau's user avatar
  • 113
10 votes
3 answers
4k views

Why are LLMs able to reproduce bodies of known text exactly?

Mathematically, I wouldn't expect LLMs to be able to reproduce source texts exactly unless the source text was the probable outcome given some prompt. However, I have now tested HuggingFaceH4/zephyr-...
Grant Curell's user avatar
0 votes
0 answers
23 views

Is there anywhere online an AI in the mode of "text completion" besides the OpenAI playground?

By "Text completion" mode I mean that you can input there a full conversation as one single text and the AI thinks that the text you pasted is the past conversation, not a single message. ...
Anixx's user avatar
  • 331
-2 votes
1 answer
31 views

Dynamic text completion [closed]

I am using the get_completion function to generate response to a question. Since generating response takes a long time (~5 seconds) I would like to display the response text as it's generated (...
afshi7n's user avatar
  • 97
0 votes
0 answers
37 views

AI-driven tool for generating or finding short, context-aware jokes for online forum posts (GPT-4 not effective)

I've tried using GPT-4 to generate jokes with various prompts for my online forum posts, but most of the generated jokes were unfunny. For example, I asked my AI for a joke, and it said "your ...
8ta4's user avatar
  • 1
1 vote
2 answers
97 views

Can you automatically write a text summarizing a finance document using AI models?

I'm given pdf documents containing complex information about a financial product and my task is to write a disclaimer: a two page document with a very precise structure explaining this financial ...
Arthur Gere's user avatar
6 votes
1 answer
679 views

How much of the ChatGPT output is copied from its training set (vs. being abstractively generated)?

One of the main concerns of using ChatGPT answers on Stack Exchange is that it may copy verbatim or almost verbatim some text from its training set, which may infringe the source text's license. This ...
Franck Dernoncourt's user avatar
2 votes
1 answer
305 views

Clarification on GANs for text generation

A GAN-like architecture for text generation is proposed in 'Generative Adversarial Networks for Text Generation'. The setup is the following: The generator of the GAN is proposed to be a recurrent ...
Ramiro Hum-Sah's user avatar
0 votes
0 answers
57 views

What's the best way to feed stories to a neural network?

I'm trying to train a model that would generate stories. I have a dataset of 2000 stories prepared. They are tokenized and one-hot encoded. I can't load them all at once as a one big dataset, because ...
ymtyroni's user avatar
4 votes
3 answers
6k views

How can GPT-3 be used for designing electronic circuits from text descriptions?

I was wondering if it is possible to use GPT-3 to translate text description of a circuit to any circuit design language program, which in turn can be used to make the circuit. If it is possible, what ...
Aether's user avatar
  • 265
0 votes
1 answer
88 views

Semantic-based evaluation of translations instead of BLEU

I have a text generation model and I want to evaluate its output by comparing it to a set of gold human-annotated references. I went through machine-translation metrics and I found that BLEU is used ...
Minions's user avatar
  • 123
1 vote
0 answers
104 views

How to generate text descriptions from keywords?

I wonder how can I build a neural network which will generate text description from given tag/tags. Let's assume I have created such data structure: ...
Krzysztof Kaczyński's user avatar
1 vote
1 answer
68 views

What would be the state of the art image captioning deep learning model?

I saw a couple of architectures, like CNN-LSTM, with and without attention model, use of Glove vector, self-critical models, etc. I am overwhelmed looking at different notebooks and architectures, ...
Joe's user avatar
  • 113
3 votes
0 answers
468 views

T5 or BERT for sentence correction/generation task?

I have sentences with some grammatical errors , with no punctuations and digits written in words... something like below: As you can observe, a proper noun , winston isnt highlighted with capital in ...
Varun kadekar's user avatar
0 votes
1 answer
617 views

Are there any good alternatives to an LSTM language model for text generation?

I have a trained LSTM language model and want to use it to generate text. The standard approach for this seems to be: Apply softmax function Take a weighted random choice to determine the next word ...
Christian Doucette's user avatar
1 vote
2 answers
247 views

Making generated texts from "data-to-text" more variable

I am diving in data-to-text generation for long articles (> 1000 words). After creating a template and fill it with data I am currently going down on paragraph level and adding different paragraphs,...
Carol.Kar's user avatar
0 votes
1 answer
200 views

Transformer Language Model generating meaningless text

I currently learning on Transformers, so check my understanding I tried implementing a small transformer-based language model and compare it to RNN based language model. Here's the code for ...
Hari Krishnan's user avatar
3 votes
1 answer
125 views

Is there a complement to GPT/2/3 that can be trained using supervised learning methods?

This is a bit of a soft question, not sure if it's on topic, please let me know how I can improve it if it doesn't meet the criteria for the site. GPT models are unsupervised in nature and are (from ...
user6916458's user avatar
1 vote
0 answers
75 views

Is the number of bidirectional LSTMs in seq2seq model equal to the maximum length of input text/characters?

I'm confused about this aspect of RNNs while trying to learn how seq2seq encoder-decoder works at https://machinelearningmastery.com/configure-encoder-decoder-model-neural-machine-translation/. It ...
Joe Black's user avatar
  • 181
1 vote
0 answers
64 views

Importance sampling eq. 5 in paper "Residual Energy-based Models for Text Generation"

In the paper "Residual Energy-Based Models for Text Generation" (arXiv), on page 5, they write that equation 5 is an instance of importance sampling. Equation 5 is: $$ P(x_t \mid x_{<t}) = P_{LM}(...
rubencart's user avatar
1 vote
0 answers
240 views

How can I use GPT-2 to modify seed text of one form into a different form (LENGTH INVARIANT) whilst retaining meaning?

I am currently starting a research project whereby I am trying to convert text of one form into another. i.e. If I were to write a seed sentance of the form "Scientists have finally achieved the ...
Colleen Larsen's user avatar
2 votes
0 answers
81 views

How should I design a reward function for a NLP problem where two models interoperate?

I would like to design a reward function. I am training two models from the first model that classify set of texts (paragraphs and keywords) and I also got some hidden states. The second model is ...
No Na's user avatar
  • 21
2 votes
0 answers
339 views

Pretrained Models for Keyword-Based Text Generation

I'm looking for an implementation that allows me to generate text based on a pre-trained model (e.g. GPT-2). An example would be gpt-2-keyword-generation (click here for demo). As the author notes, ...
Comfort Eagle's user avatar
2 votes
0 answers
24 views

How to tell if two hotel reviews addressing the same thing

I am playing with a large dataset of hotel reviews, which contains both positive and negative reviews (the reviews are labeled). I want to use this dataset to perform textual style transfer - given a ...
Nadav Borenstein's user avatar
3 votes
2 answers
722 views

How to use LSTM to generate a paragraph

A LSTM model can be trained to generate text sequences by feeding the first word. After feeding the first word, the model will generate a sequence of words (a sentence). Feed the first word to get the ...
Dan D.'s user avatar
  • 1,283
10 votes
1 answer
8k views

How do I use GPT-2 to summarise text?

In section 3.6 of the OpenAI GPT-2 paper it mentions summarising text based relates to this, but the method is described in very high-level terms: To induce summarization behavior we add the text <...
Tom Hale's user avatar
  • 374
32 votes
3 answers
42k views

Can BERT be used for sentence generating tasks?

I am a new learner in NLP. I am interested in the sentence generating task. As far as I am concerned, one state-of-the-art method is the CharRNN, which uses RNN to generate a sequence of words. ...
ch271828n's user avatar
  • 423