Questions tagged [machine-translation]
For questions related to machine translation (MT), which is the task of translating text using a computer, machine or software.
13
questions
0
votes
0answers
12 views
Why do both sin and cos have been used in positional encoding in Transformer model?
The Transformer model proposed in "Attention Is All You Need" uses sinusoid functions to do positional encoding. I wonder why do both sin and cos been involved in? And why do need to separate the odd ...
1
vote
0answers
15 views
Small Machine Translation Model
I would like to perform Machine Translation in tensorflow.js, in the browser. The issue is that state-of-the-art models have many gigabytes (fairseq ensemble), and translation is slow.
Do you know ...
1
vote
1answer
33 views
What are the differences between Bytenet and Wavenet?
I recently read Bytenet and Wavenet and I was curious why the first model is not as popular as the second. From my understanding, Bytenet can be seen as a seq2seq model where the encoder and the ...
2
votes
1answer
18 views
Is this technique image processing or computer vision?
If I use my mobile camera on a signboard or announcement board on a road or in a street (like the one attached in photo) where the message is written in Russian and my mobile shows me that message in ...
27
votes
9answers
6k views
What is the actual quality of machine translations?
Till today I - as an AI layman - am confused by the promised and achieved improvements of automated translation.
My impression is: there is still a very, very far way to go. Or are there other ...
3
votes
1answer
57 views
How do I identify a monologue or dialogue in a conversation?
How do I identify monologues and dialogues in a conversation (or transcript) using natural language processing? How do I distinguish between the two?
0
votes
0answers
41 views
About the Softmax in the Transformer / BERT
In the Transformer (adapted in BERT), we normalize the attention weights (dot product of keys and queries) using a softmax in the Scaled Dot-Product mechanism. It is unclear to me whether this ...
1
vote
1answer
14 views
Convolutional Sequence to Sequence Learning kernel parameters
I am reading the paper Convolutional Sequence to Sequence Learning by Facebook AI researchers and having trouble to understand how the dimensions of convolutional filters work here. Please take a look ...
2
votes
0answers
26 views
Translate product names with AI
I frequently need to translate product names for hundreds of similar products -- and I have a list of past product names. Is it possible to train AI to review past translations and translate? It doesn'...
0
votes
2answers
63 views
Do I need an encoder-decoder architecture to predict the next item of a sequence?
I am trying to understand how RNNs are used for sequence modelling.
On a tutorial here, it mentions that if you want to translate say a sentence from English to French you can use an encoder-decoder ...
3
votes
0answers
94 views
What is the intuition behind the calculation of the similarity between encoder and decoder states?
Suppose that we are doing machine translation. We have a conditional language model with attention where we are are trying to predict a sequence $y_1, y_2, \dots, y_J$ from $x_1, x_2, \dots x_I$: $$P(...
1
vote
1answer
27 views
Neural network with logical hidden layer - how to train it? Is it policy gradient problem? Chaining NNs?
I am doing neural machine translation task from language S to language T via interlingua L. So - there is the structure:
...
1
vote
2answers
110 views
Why can't we use Google Translate AI for everything?
Once a book is published in a language, why can't the publishers use Google Translate AI or some similar software to immediately render the book in other languages? Likewise for Wikipedia: I'm not ...
