Lerner Zhang
  • Member for 4 years, 11 months
  • Last seen more than a week ago
How to do machine translation with no labeled data?
2 votes

In this paper: Unsupervised Machine Translation Using Monolingual Corpora Only the authors proposed a novel method. Intuitively it is an autoencoder, but the Start Of Sentence token is set to be ...

View answer
Does the human brain use beam search for text generation?
2 votes

I thought the answer might be no. In this 2020 ICLR paper: The Curious Case of Neural Text Degeneration, researchers found that beam search text is less surprising compared to human natural language....

View answer
How to determine the embedding size?
1 votes

I get an answer from this book: Machine Learning Design Patterns: Solutions to Common Challenges in Data Preparation, Model Building, and MLOps. If we’re in a hurry, one rule of thumb is to use the ...

View answer
How can I evaluate the performance of a system that generates text?
1 votes

Human evaluation is the gold standard as stated in this podcast by Asli Celikyilmaz, even if you only test a very small part of the generated text. You needed an automated method and this one: BLEURT ...

View answer
When is it time to switch to deep neural networks from simple networks in text classification problems?
1 votes

Source: https://blog.easysol.net/building-ai-applications/ When data is too big, complex and nonlinear it's time to try deep learning. It's always good to try to add some layers to see it can ...

View answer
What roles knowledge bases play now and will play in the future?
0 votes

It seems that Automated Knowledge Base Construction would be unfavorable. As Matt Gardner noted in NLP Highlights in 2019 that: Um, but I know that Google, for instance, canceled their knowledge base ...

View answer
Why is the perplexity a good evaluation metric for chatbots?
0 votes

For the definition and calculation of perplexity, please refer to this answer. Google proposed a human evaluation metric called Sensibleness and Specificity Average (SSA) which combines two ...

View answer