Questions tagged [machine-translation]
For questions related to machine translation (MT), which is the task of translating text using a computer, machine or software.
44
questions
0
votes
1
answer
35
views
BERT2: How to use GPT2LMHeadModel to start a sentence, not complete it
I am using GPT2LMHeadModel to change the way GPT2 choose the next word in a sentence. At this point, I have to give the initial part of the sentence and GTP2 starts to predict the better next word.
I ...
- 101
0
votes
0
answers
18
views
What are the differences between BLEU and METEOR?
I am trying to understand the concept of evaluating the machine translation evaluation scores.
I understand how what BLEU score is trying to achieve. It looks into different n-grams like BLEU-1,BLEU-2,...
- 31
0
votes
2
answers
53
views
Why is the WMT16 dataset favoured for evaluating machine translation models?
The Workshop on Statistical Machine Translation has released translation challenges each year from 2004 on, which feature a dataset of sentence pairs in a variety of languages.
Even though the ...
- 1
1
vote
1
answer
36
views
Is image machine translation done in two steps?
Suppose I have images of hand-written Japanese text. If I want to translate those images, would my ML algorithm be a 2-step model (for example, a CNN to convert the image into Japanese characters/...
- 31
0
votes
1
answer
22
views
What does it mean to apply decomposition at inference-time in a machine translation system?
I'm reading this paper for sub-character decomposition for logographic languages and the authors mention decomposition at inference-time. They're using Transformer architecture.
More specifically, the ...
- 11
0
votes
1
answer
226
views
What is input (and shape) to K/V/Q of self-attention of EACH Decoder block of Language-translation model Transformer's tokens during Inference?
Transformer model of the original Attention paper has a decoder unit that works differently during Inference than Tranining.
I'm trying to understand the shapes used during decoder (both self-...
- 151
0
votes
1
answer
34
views
Given the immaturity of NLP tools for non-English languages, should I first translate the non-English language to English before text pre-processing?
For non-English languages (in my case Portuguese), what is the best approach? Should I use the not-so-complete tools in my language, or should I translate the text to English, and after using the ...
1
vote
1
answer
50
views
Does it make sense to use BLEU or ROUGE for any machine translation task?
Many machine translation metrics such as BLEU or ROUGE are used to evaluate sequence to sequence models where, usually, the sequences are pieces of natural language.
Is it possible to use these ...
- 71
1
vote
1
answer
39
views
How is Google Translate able to translate texts of arbitrarily large length?
Sequence-to-sequence models with attention are known to be limited by a maximum sequence length. So how can we handle sequences of arbitrarily large size? Do we just set a very large maximum sequence ...
- 71
0
votes
1
answer
22
views
Semantic-based evaluation of translations instead of BLEU
I have a text generation model and I want to evaluate its output by comparing it to a set of gold human-annotated references.
I went through machine-translation metrics and I found that BLEU is used ...
- 123
0
votes
0
answers
38
views
How can a CNN be used in machine translation?
How can a convolutional neural net (CNN) be used in machine translation?
Convolution is a mathematical operation, so how are natural languages translated into matrices?
e.g., DeepL_Translator#...
- 111
0
votes
0
answers
15
views
Does the transformers model (in "Attention is All You Need") exclude the encoder in language modelling tasks?
The language model I am referring to is the one outlined in "Attention is All You Need":
My understanding is that when the task is translation, the encoder's input could be "Hi, my ...
- 11
0
votes
0
answers
16
views
MBART and better Domain Specific Translations Using Masks?
I'm implementing https://huggingface.co/facebook/mbart-large-50-many-to-many-mmt for translations as it has shown promising results but I wanted to see if there was a way to translate specific parts ...
1
vote
0
answers
14
views
Can unsupervised models learn something from cat vocalizations?
I love cats, and over the years have noticed that they have recurrent patterns of vocalizations. For example, upon seeing a bird, a cat may start chittering, but the same cat would never chitter at ...
- 111
0
votes
0
answers
9
views
How can I design a machine translation model that produces a mapping between the words in the source and target sentences?
I have a dataset of sentences of language X and Y
X
Y
abc def lang
xyz pqrt mno uages
I want to have an output as a table with word-by-word translation (...
- 1
0
votes
0
answers
11
views
How does translation of a text in an HTML tag works? Consider the following cases
Recently I came a cross to the Google Translate's add-on for Chrome. Basically you have a web page and it translates that web page for you while keeping its structure.
I came to the conclusion that it ...
- 145
1
vote
0
answers
28
views
Training seq2seq translation model with one source and multiple target
So basically I'm training a sequence to sequence model that translates English sentences to Arabic sentences. I'm using the data provided by Anki @ manythings. I realized that some of the sentences in ...
- 11
1
vote
1
answer
106
views
What is the purpose of "alignment" in the self-attention mechanism of transformers?
I've been reading about transformers & have been having some difficulty understanding the concept of alignment.
Based on this article
Alignment means matching segments of original text with their ...
0
votes
0
answers
25
views
Finding or creating a dataset for Neural Text Simplification
I'm currently starting a research project focused on NLP.
One of the steps involved in this project will be the development of a text simplification system, probably using a neural encoder-decoder ...
- 41
2
votes
1
answer
322
views
How is Google Translate able to convert texts of different lengths?
According to my experience with Tensorflow and many other frameworks, neural networks have to have a fixed shape for any output, but how does Google translate convert texts of different lengths?
- 49
1
vote
1
answer
122
views
Can we use NLP to understand/parse/compile programming code?
I wonder if we can use Natural Language Processing (NLP) to process programming code:
Given a piece of code, can we
Translate it to human language to understand what it does? The input could be a ...
- 11
1
vote
1
answer
197
views
What are the main differences between a language model and a machine translation model?
What are the main differences between a language model and a machine translation model?
- 1,213
1
vote
0
answers
19
views
How to autocorelate multiple variants of same text into one?
I want to improve quality of translations for open-source projects in Ukrainian language. We have multiple translations from different authors. We can also translate messages using machine ...
5
votes
1
answer
143
views
Is there any resource that describes in detail a naive example-based machine translation algorithm?
I'm looking to develop a machine translation tool for a constructed language. I think that the example-based approach is the most suitable because the said language is very regular and I can have a ...
- 85
3
votes
1
answer
78
views
How to do machine translation with no labeled data?
Is it be possible to train a neural network, with no parallel bilingual data, for machine translation?
- 741
1
vote
0
answers
28
views
What's the best method to predict/generate signal from one sensor (source) to signal from another another (target)?
I was wondering what is the best method out there to find relationship between two 1D signals so that I can predict/generate one (source) from the other (target). For example, let's say that in ...
3
votes
0
answers
24
views
How to back propagate for implementation of Sequence-to-Sequence with Multi Decoders
I am proposing a modified version of Sequence-to-Sequence model with dual decoders. The problem that I am trying to solve is Neural Machine Translation into two languages at once. This is the ...
- 143
3
votes
0
answers
44
views
Can sequence-to-sequence models be used to convert source code from one programming language to another?
Sequence-to-sequence models have achieved good performance in natural language translation. Could these models also be applied to convert source code written in one programming language to source code ...
- 31
2
votes
1
answer
128
views
What happens when the output length in the brevity penalty is zero?
The brevity penalty is defined as
$$bp = e^{(1- r/c)},$$
where $r$ is the reference length and $c$ is the output length.
But what happens if the output length gets zero? Is there any standard way ...
2
votes
0
answers
34
views
Best approach for online Machine Translation with few hundred of samples?
I want to implement a model that improves itself with the passage of time.
My main task is to build a machine translator (from English to Urdu).. The problem I am facing is that I have very little ...
- 121
1
vote
0
answers
58
views
Why do both sine and cosine have been used in positional encoding in the transformer model?
The Transformer model proposed in "Attention Is All You Need" uses sinusoid functions to do the positional encoding.
Why have both sine and cosine been used? And why do we need to separate the odd ...
- 11
2
votes
0
answers
30
views
Small Machine Translation Model
I would like to perform Machine Translation in tensorflow.js, in the browser. The issue is that state-of-the-art models have many gigabytes (fairseq ensemble), and translation is slow.
Do you know ...
- 121
4
votes
1
answer
412
views
What are the differences between Bytenet and Wavenet?
I recently read Bytenet and Wavenet and I was curious why the first model is not as popular as the second. From my understanding, Bytenet can be seen as a seq2seq model where the encoder and the ...
- 1,078
3
votes
1
answer
42
views
Is this technique image processing or computer vision?
If I use my mobile camera on a signboard or announcement board on a road or in a street (like the one attached in photo) where the message is written in Russian and my mobile shows me that message in ...
- 163
29
votes
9
answers
7k
views
What is the actual quality of machine translations?
As an AI layman, till today I am confused by the promised and achieved improvements of automated translation.
My impression is: there is still a very, very far way to go. Or are there other ...
4
votes
1
answer
131
views
How do I identify a monologue or dialogue in a conversation?
How do I identify monologues and dialogues in a conversation (or transcript) using natural language processing? How do I distinguish between the two?
1
vote
0
answers
150
views
How are the attention weights normalised in the transformer?
In the Transformer (adopted in BERT), we normalize the attention weights (dot product of keys and queries) using a softmax in the Scaled Dot-Product mechanism. It is unclear to me whether this ...
- 131
1
vote
2
answers
68
views
Convolutional Sequence to Sequence Learning kernel parameters
I am reading the paper Convolutional Sequence to Sequence Learning by Facebook AI researchers and having trouble to understand how the dimensions of convolutional filters work here. Please take a look ...
- 325
2
votes
0
answers
38
views
Translate product names with AI
I frequently need to translate product names for hundreds of similar products -- and I have a list of past product names. Is it possible to train AI to review past translations and translate? It doesn'...
- 121
1
vote
2
answers
253
views
Do I need an encoder-decoder architecture to predict the next item of a sequence?
I am trying to understand how RNNs are used for sequence modelling.
On a tutorial here, it mentions that if you want to translate say a sentence from English to French you can use an encoder-decoder ...
- 173
3
votes
0
answers
147
views
What is the intuition behind the calculation of the similarity between encoder and decoder states?
Suppose that we are doing machine translation. We have a conditional language model with attention where we are are trying to predict a sequence $y_1, y_2, \dots, y_J$ from $x_1, x_2, \dots x_I$: $$P(...
- 31
1
vote
1
answer
54
views
Neural network with logical hidden layer - how to train it? Is it policy gradient problem? Chaining NNs?
I am doing neural machine translation task from language S to language T via interlingua L. So - there is the structure:
...
- 753
3
votes
2
answers
228
views
Why can't we use Google Translate for every translation task?
Once a book is published in a language, why can't the publishers use Google Translate AI or some similar software to immediately render the book in other languages? Likewise for Wikipedia: I'm not ...
- 403
0
votes
4
answers
1k
views
Why does Google Translate produce two different translations for the same Chinese text?
I don't understand why Google Translate translates the same text in different ways.
Here is the Wikipedia page of the 1973 film "Enter the Dragon". You can see that its traditional Chinese ...
- 111