In this paper: Unsupervised Machine Translation Using Monolingual Corpora Only the authors proposed a novel method. Intuitively it is an autoencoder, but the Start Of Sentence token is set to be ...

I thought the answer might be no. In this 2020 ICLR paper: The Curious Case of Neural Text Degeneration, researchers found that beam search text is less surprising compared to human natural language....

I get an answer from this book: Machine Learning Design Patterns: Solutions to Common Challenges in Data Preparation, Model Building, and MLOps. If we’re in a hurry, one rule of thumb is to use the ...

Human evaluation is the gold standard as stated in this podcast by Asli Celikyilmaz, even if you only test a very small part of the generated text. You needed an automated method and this one: BLEURT ...

Source: https://blog.easysol.net/building-ai-applications/ When data is too big, complex and nonlinear it's time to try deep learning. It's always good to try to add some layers to see it can ...

It seems that Automated Knowledge Base Construction would be unfavorable. As Matt Gardner noted in NLP Highlights in 2019 that: Um, but I know that Google, for instance, canceled their knowledge base ...

For the definition and calculation of perplexity, please refer to this answer. Google proposed a human evaluation metric called Sensibleness and Specificity Average (SSA) which combines two ...