Questions tagged [text-generation]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers

Recommendations for code documentation generation? [closed]

I just joined a team where our current assignment is to take a project that our company has just acquired and get it up to snuff with our internal standards. The project we acquired was a single ...
JamesK's user avatar
  • 1
0 votes
0 answers

Using AI to augment or retell my own stories [closed]

I'm a podcaster in the making, currently working on recording my third episode, which involves live reading comedic fantasy fiction short stories which we have written from scratch. The stories are ...
Prone2Failure's user avatar
10 votes
3 answers

Why are LLMs able to reproduce bodies of known text exactly?

Mathematically, I wouldn't expect LLMs to be able to reproduce source texts exactly unless the source text was the probable outcome given some prompt. However, I have now tested HuggingFaceH4/zephyr-...
Grant Curell's user avatar
0 votes
0 answers

Is there anywhere online an AI in the mode of "text completion" besides the OpenAI playground?

By "Text completion" mode I mean that you can input there a full conversation as one single text and the AI thinks that the text you pasted is the past conversation, not a single message. ...
Anixx's user avatar
  • 321
-2 votes
1 answer

Dynamic text completion [closed]

I am using the get_completion function to generate response to a question. Since generating response takes a long time (~5 seconds) I would like to display the response text as it's generated (...
afshi7n's user avatar
  • 97
0 votes
0 answers

AI-driven tool for generating or finding short, context-aware jokes for online forum posts (GPT-4 not effective)

I've tried using GPT-4 to generate jokes with various prompts for my online forum posts, but most of the generated jokes were unfunny. For example, I asked my AI for a joke, and it said "your ...
8ta4's user avatar
  • 1
1 vote
2 answers

Can you automatically write a text summarizing a finance document using AI models?

I'm given pdf documents containing complex information about a financial product and my task is to write a disclaimer: a two page document with a very precise structure explaining this financial ...
Arthur Gere's user avatar
0 votes
0 answers

Fine-tuned GPT-2 producing padding tokens and nonsense

I'm trying to fine-tune GPT-2 so that it can produce artificial data similar to this: ...
multiheadedattention's user avatar
6 votes
1 answer

How much of the ChatGPT output is copied from its training set (vs. being abstractively generated)?

One of the main concerns of using ChatGPT answers on Stack Exchange is that it may copy verbatim or almost verbatim some text from its training set, which may infringe the source text's license. This ...
Franck Dernoncourt's user avatar
2 votes
1 answer

Clarification on GANs for text generation

A GAN-like architecture for text generation is proposed in 'Generative Adversarial Networks for Text Generation'. The setup is the following: The generator of the GAN is proposed to be a recurrent ...
Ramiro Hum-Sah's user avatar
0 votes
0 answers

What's the best way to feed stories to a neural network?

I'm trying to train a model that would generate stories. I have a dataset of 2000 stories prepared. They are tokenized and one-hot encoded. I can't load them all at once as a one big dataset, because ...
ymtyroni's user avatar
4 votes
3 answers

How can GPT-3 be used for designing electronic circuits from text descriptions?

I was wondering if it is possible to use GPT-3 to translate text description of a circuit to any circuit design language program, which in turn can be used to make the circuit. If it is possible, what ...
Aether's user avatar
  • 265
0 votes
1 answer

Semantic-based evaluation of translations instead of BLEU

I have a text generation model and I want to evaluate its output by comparing it to a set of gold human-annotated references. I went through machine-translation metrics and I found that BLEU is used ...
Minions's user avatar
  • 123
1 vote
0 answers

How to generate text descriptions from keywords?

I wonder how can I build a neural network which will generate text description from given tag/tags. Let's assume I have created such data structure: ...
Krzysztof Kaczyński's user avatar
1 vote
1 answer

What would be the state of the art image captioning deep learning model?

I saw a couple of architectures, like CNN-LSTM, with and without attention model, use of Glove vector, self-critical models, etc. I am overwhelmed looking at different notebooks and architectures, ...
Joe's user avatar
  • 113
3 votes
0 answers

T5 or BERT for sentence correction/generation task?

I have sentences with some grammatical errors , with no punctuations and digits written in words... something like below: As you can observe, a proper noun , winston isnt highlighted with capital in ...
Varun kadekar's user avatar
0 votes
1 answer

Are there any good alternatives to an LSTM language model for text generation?

I have a trained LSTM language model and want to use it to generate text. The standard approach for this seems to be: Apply softmax function Take a weighted random choice to determine the next word ...
Christian Doucette's user avatar
1 vote
2 answers

Making generated texts from "data-to-text" more variable

I am diving in data-to-text generation for long articles (> 1000 words). After creating a template and fill it with data I am currently going down on paragraph level and adding different paragraphs,...
Carol.Kar's user avatar
0 votes
1 answer

Transformer Language Model generating meaningless text

I currently learning on Transformers, so check my understanding I tried implementing a small transformer-based language model and compare it to RNN based language model. Here's the code for ...
Hari Krishnan's user avatar
3 votes
1 answer

Is there a complement to GPT/2/3 that can be trained using supervised learning methods?

This is a bit of a soft question, not sure if it's on topic, please let me know how I can improve it if it doesn't meet the criteria for the site. GPT models are unsupervised in nature and are (from ...
user6916458's user avatar
1 vote
0 answers

Is the number of bidirectional LSTMs in seq2seq model equal to the maximum length of input text/characters?

I'm confused about this aspect of RNNs while trying to learn how seq2seq encoder-decoder works at It ...
Joe Black's user avatar
  • 181
1 vote
0 answers

Importance sampling eq. 5 in paper "Residual Energy-based Models for Text Generation"

In the paper "Residual Energy-Based Models for Text Generation" (arXiv), on page 5, they write that equation 5 is an instance of importance sampling. Equation 5 is: $$ P(x_t \mid x_{<t}) = P_{LM}(...
rubencart's user avatar
1 vote
0 answers

How can I use GPT-2 to modify seed text of one form into a different form (LENGTH INVARIANT) whilst retaining meaning?

I am currently starting a research project whereby I am trying to convert text of one form into another. i.e. If I were to write a seed sentance of the form "Scientists have finally achieved the ...
Colleen Larsen's user avatar
2 votes
0 answers

How should I design a reward function for a NLP problem where two models interoperate?

I would like to design a reward function. I am training two models from the first model that classify set of texts (paragraphs and keywords) and I also got some hidden states. The second model is ...
No Na's user avatar
  • 21
2 votes
0 answers

Pretrained Models for Keyword-Based Text Generation

I'm looking for an implementation that allows me to generate text based on a pre-trained model (e.g. GPT-2). An example would be gpt-2-keyword-generation (click here for demo). As the author notes, ...
Comfort Eagle's user avatar
2 votes
0 answers

How to tell if two hotel reviews addressing the same thing

I am playing with a large dataset of hotel reviews, which contains both positive and negative reviews (the reviews are labeled). I want to use this dataset to perform textual style transfer - given a ...
Nadav Borenstein's user avatar
3 votes
2 answers

How to use LSTM to generate a paragraph

A LSTM model can be trained to generate text sequences by feeding the first word. After feeding the first word, the model will generate a sequence of words (a sentence). Feed the first word to get the ...
Dan D.'s user avatar
  • 1,283
9 votes
1 answer

How do I use GPT-2 to summarise text?

In section 3.6 of the OpenAI GPT-2 paper it mentions summarising text based relates to this, but the method is described in very high-level terms: To induce summarization behavior we add the text <...
Tom Hale's user avatar
  • 364
31 votes
3 answers

Can BERT be used for sentence generating tasks?

I am a new learner in NLP. I am interested in the sentence generating task. As far as I am concerned, one state-of-the-art method is the CharRNN, which uses RNN to generate a sequence of words. ...
ch271828n's user avatar
  • 413