Questions tagged [machine-translation]
For questions related to machine translation (MT), which is the task of translating text using a computer, machine or software.
17
questions
2
votes
0answers
14 views
How to back propagate for implementation of Sequence-to-Sequence with Multi Decoders
I am proposing a modified version of Sequence-to-Sequence model with dual decoders. The problem that I am trying to solve is Neural Machine Translation into two languages at once. This is the ...
3
votes
0answers
33 views
Can sequence-to-sequence models be used to convert source code from one programming language to another?
Sequence-to-sequence models have achieved good performance in natural language translation. Could these models also be applied to convert source code written in one programming language to source code ...
2
votes
1answer
36 views
What happens when the output length in the brevity penalty is zero?
The brevity penalty is defined as
$$bp = e^{(1- r/c)},$$
where $r$ is the reference length and $c$ is the output length.
But what happens if the output length gets zero? Is there any standard way ...
2
votes
0answers
28 views
Best approach for online Machine Translation with few hundred of samples?
I want to implement a model that improves itself with the passage of time.
My main task is to build a machine translator (from English to Urdu).. The problem I am facing is that I have very little ...
1
vote
0answers
24 views
Why do both sine and cosine have been used in positional encoding in the transformer model?
The Transformer model proposed in "Attention Is All You Need" uses sinusoid functions to do the positional encoding.
Why have both sine and cosine been used? And why do we need to separate the odd ...
1
vote
0answers
21 views
Small Machine Translation Model
I would like to perform Machine Translation in tensorflow.js, in the browser. The issue is that state-of-the-art models have many gigabytes (fairseq ensemble), and translation is slow.
Do you know ...
3
votes
1answer
111 views
What are the differences between Bytenet and Wavenet?
I recently read Bytenet and Wavenet and I was curious why the first model is not as popular as the second. From my understanding, Bytenet can be seen as a seq2seq model where the encoder and the ...
3
votes
1answer
23 views
Is this technique image processing or computer vision?
If I use my mobile camera on a signboard or announcement board on a road or in a street (like the one attached in photo) where the message is written in Russian and my mobile shows me that message in ...
27
votes
9answers
6k views
What is the actual quality of machine translations?
Till today I - as an AI layman - am confused by the promised and achieved improvements of automated translation.
My impression is: there is still a very, very far way to go. Or are there other ...
4
votes
1answer
70 views
How do I identify a monologue or dialogue in a conversation?
How do I identify monologues and dialogues in a conversation (or transcript) using natural language processing? How do I distinguish between the two?
1
vote
0answers
87 views
How are the attention weights normalised in the transformer?
In the Transformer (adopted in BERT), we normalize the attention weights (dot product of keys and queries) using a softmax in the Scaled Dot-Product mechanism. It is unclear to me whether this ...
1
vote
1answer
22 views
Convolutional Sequence to Sequence Learning kernel parameters
I am reading the paper Convolutional Sequence to Sequence Learning by Facebook AI researchers and having trouble to understand how the dimensions of convolutional filters work here. Please take a look ...
2
votes
0answers
27 views
Translate product names with AI
I frequently need to translate product names for hundreds of similar products -- and I have a list of past product names. Is it possible to train AI to review past translations and translate? It doesn'...
0
votes
2answers
77 views
Do I need an encoder-decoder architecture to predict the next item of a sequence?
I am trying to understand how RNNs are used for sequence modelling.
On a tutorial here, it mentions that if you want to translate say a sentence from English to French you can use an encoder-decoder ...
3
votes
0answers
96 views
What is the intuition behind the calculation of the similarity between encoder and decoder states?
Suppose that we are doing machine translation. We have a conditional language model with attention where we are are trying to predict a sequence $y_1, y_2, \dots, y_J$ from $x_1, x_2, \dots x_I$: $$P(...
1
vote
1answer
29 views
Neural network with logical hidden layer - how to train it? Is it policy gradient problem? Chaining NNs?
I am doing neural machine translation task from language S to language T via interlingua L. So - there is the structure:
...
1
vote
2answers
127 views
Why can't we use Google Translate AI for everything?
Once a book is published in a language, why can't the publishers use Google Translate AI or some similar software to immediately render the book in other languages? Likewise for Wikipedia: I'm not ...
