The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [machine-translation]

For questions related to machine translation (MT), which is the task of translating text using a computer, machine or software.

9 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
94 views

What is the intuition behind the calculation of the similarity between encoder and decoder states?

Suppose that we are doing machine translation. We have a conditional language model with attention where we are are trying to predict a sequence $y_1, y_2, \dots, y_J$ from $x_1, x_2, \dots x_I$: $$P(...
2
votes
0answers
28 views

Best approach for online Machine Translation with few hundred of samples?

I want to implement a model that improves itself with the passage of time. My main task is to build a machine translator (from English to Urdu).. The problem I am facing is that I have very little ...
2
votes
0answers
26 views

Translate product names with AI

I frequently need to translate product names for hundreds of similar products -- and I have a list of past product names. Is it possible to train AI to review past translations and translate? It doesn'...
1
vote
0answers
16 views

How to train a transformer text to text model on counterexamples?

Is it possible to update the weights of a vanilla transformer model using counterexamples alongside examples? For example, from the PAWS data set, given the phrases "Although interchangeable, the ...
1
vote
0answers
18 views

Small Machine Translation Model

I would like to perform Machine Translation in tensorflow.js, in the browser. The issue is that state-of-the-art models have many gigabytes (fairseq ensemble), and translation is slow. Do you know ...
1
vote
1answer
43 views

What are the differences between Bytenet and Wavenet?

I recently read Bytenet and Wavenet and I was curious why the first model is not as popular as the second. From my understanding, Bytenet can be seen as a seq2seq model where the encoder and the ...
1
vote
1answer
18 views

Convolutional Sequence to Sequence Learning kernel parameters

I am reading the paper Convolutional Sequence to Sequence Learning by Facebook AI researchers and having trouble to understand how the dimensions of convolutional filters work here. Please take a look ...
0
votes
0answers
15 views

Why do both sin and cos have been used in positional encoding in Transformer model?

The Transformer model proposed in "Attention Is All You Need" uses sinusoid functions to do positional encoding. I wonder why do both sin and cos been involved in? And why do need to separate the odd ...
0
votes
0answers
50 views

About the Softmax in the Transformer / BERT

In the Transformer (adapted in BERT), we normalize the attention weights (dot product of keys and queries) using a softmax in the Scaled Dot-Product mechanism. It is unclear to me whether this ...