Questions tagged [machine-translation]

For questions related to machine translation (MT), which is the task of translating text using a computer, machine or software.

Filter by
Sorted by
Tagged with
0 votes
1 answer
35 views

BERT2: How to use GPT2LMHeadModel to start a sentence, not complete it

I am using GPT2LMHeadModel to change the way GPT2 choose the next word in a sentence. At this point, I have to give the initial part of the sentence and GTP2 starts to predict the better next word. I ...
user avatar
  • 101
0 votes
0 answers
18 views

What are the differences between BLEU and METEOR?

I am trying to understand the concept of evaluating the machine translation evaluation scores. I understand how what BLEU score is trying to achieve. It looks into different n-grams like BLEU-1,BLEU-2,...
user avatar
0 votes
2 answers
53 views

Why is the WMT16 dataset favoured for evaluating machine translation models?

The Workshop on Statistical Machine Translation has released translation challenges each year from 2004 on, which feature a dataset of sentence pairs in a variety of languages. Even though the ...
user avatar
1 vote
1 answer
36 views

Is image machine translation done in two steps?

Suppose I have images of hand-written Japanese text. If I want to translate those images, would my ML algorithm be a 2-step model (for example, a CNN to convert the image into Japanese characters/...
user avatar
0 votes
1 answer
22 views

What does it mean to apply decomposition at inference-time in a machine translation system?

I'm reading this paper for sub-character decomposition for logographic languages and the authors mention decomposition at inference-time. They're using Transformer architecture. More specifically, the ...
user avatar
0 votes
1 answer
226 views

What is input (and shape) to K/V/Q of self-attention of EACH Decoder block of Language-translation model Transformer's tokens during Inference?

Transformer model of the original Attention paper has a decoder unit that works differently during Inference than Tranining. I'm trying to understand the shapes used during decoder (both self-...
user avatar
  • 151
0 votes
1 answer
34 views

Given the immaturity of NLP tools for non-English languages, should I first translate the non-English language to English before text pre-processing?

For non-English languages (in my case Portuguese), what is the best approach? Should I use the not-so-complete tools in my language, or should I translate the text to English, and after using the ...
user avatar
1 vote
1 answer
50 views

Does it make sense to use BLEU or ROUGE for any machine translation task?

Many machine translation metrics such as BLEU or ROUGE are used to evaluate sequence to sequence models where, usually, the sequences are pieces of natural language. Is it possible to use these ...
user avatar
  • 71
1 vote
1 answer
39 views

How is Google Translate able to translate texts of arbitrarily large length?

Sequence-to-sequence models with attention are known to be limited by a maximum sequence length. So how can we handle sequences of arbitrarily large size? Do we just set a very large maximum sequence ...
user avatar
  • 71
0 votes
1 answer
22 views

Semantic-based evaluation of translations instead of BLEU

I have a text generation model and I want to evaluate its output by comparing it to a set of gold human-annotated references. I went through machine-translation metrics and I found that BLEU is used ...
user avatar
  • 123
0 votes
0 answers
38 views

How can a CNN be used in machine translation?

How can a convolutional neural net (CNN) be used in machine translation? Convolution is a mathematical operation, so how are natural languages translated into matrices? e.g., DeepL_Translator#...
user avatar
  • 111
0 votes
0 answers
15 views

Does the transformers model (in "Attention is All You Need") exclude the encoder in language modelling tasks?

The language model I am referring to is the one outlined in "Attention is All You Need": My understanding is that when the task is translation, the encoder's input could be "Hi, my ...
user avatar
0 votes
0 answers
16 views

MBART and better Domain Specific Translations Using Masks?

I'm implementing https://huggingface.co/facebook/mbart-large-50-many-to-many-mmt for translations as it has shown promising results but I wanted to see if there was a way to translate specific parts ...
user avatar
1 vote
0 answers
14 views

Can unsupervised models learn something from cat vocalizations?

I love cats, and over the years have noticed that they have recurrent patterns of vocalizations. For example, upon seeing a bird, a cat may start chittering, but the same cat would never chitter at ...
user avatar
0 votes
0 answers
9 views

How can I design a machine translation model that produces a mapping between the words in the source and target sentences?

I have a dataset of sentences of language X and Y X Y abc def lang xyz pqrt mno uages I want to have an output as a table with word-by-word translation (...
user avatar
0 votes
0 answers
11 views

How does translation of a text in an HTML tag works? Consider the following cases

Recently I came a cross to the Google Translate's add-on for Chrome. Basically you have a web page and it translates that web page for you while keeping its structure. I came to the conclusion that it ...
user avatar
  • 145
1 vote
0 answers
28 views

Training seq2seq translation model with one source and multiple target

So basically I'm training a sequence to sequence model that translates English sentences to Arabic sentences. I'm using the data provided by Anki @ manythings. I realized that some of the sentences in ...
user avatar
  • 11
1 vote
1 answer
106 views

What is the purpose of "alignment" in the self-attention mechanism of transformers?

I've been reading about transformers & have been having some difficulty understanding the concept of alignment. Based on this article Alignment means matching segments of original text with their ...
user avatar
0 votes
0 answers
25 views

Finding or creating a dataset for Neural Text Simplification

I'm currently starting a research project focused on NLP. One of the steps involved in this project will be the development of a text simplification system, probably using a neural encoder-decoder ...
user avatar
2 votes
1 answer
322 views

How is Google Translate able to convert texts of different lengths?

According to my experience with Tensorflow and many other frameworks, neural networks have to have a fixed shape for any output, but how does Google translate convert texts of different lengths?
user avatar
  • 49
1 vote
1 answer
122 views

Can we use NLP to understand/parse/compile programming code?

I wonder if we can use Natural Language Processing (NLP) to process programming code: Given a piece of code, can we Translate it to human language to understand what it does? The input could be a ...
user avatar
  • 11
1 vote
1 answer
197 views

What are the main differences between a language model and a machine translation model?

What are the main differences between a language model and a machine translation model?
user avatar
  • 1,213
1 vote
0 answers
19 views

How to autocorelate multiple variants of same text into one?

I want to improve quality of translations for open-source projects in Ukrainian language. We have multiple translations from different authors. We can also translate messages using machine ...
user avatar
5 votes
1 answer
143 views

Is there any resource that describes in detail a naive example-based machine translation algorithm?

I'm looking to develop a machine translation tool for a constructed language. I think that the example-based approach is the most suitable because the said language is very regular and I can have a ...
user avatar
  • 85
3 votes
1 answer
78 views

How to do machine translation with no labeled data?

Is it be possible to train a neural network, with no parallel bilingual data, for machine translation?
user avatar
1 vote
0 answers
28 views

What's the best method to predict/generate signal from one sensor (source) to signal from another another (target)?

I was wondering what is the best method out there to find relationship between two 1D signals so that I can predict/generate one (source) from the other (target). For example, let's say that in ...
user avatar
3 votes
0 answers
24 views

How to back propagate for implementation of Sequence-to-Sequence with Multi Decoders

I am proposing a modified version of Sequence-to-Sequence model with dual decoders. The problem that I am trying to solve is Neural Machine Translation into two languages at once. This is the ...
user avatar
  • 143
3 votes
0 answers
44 views

Can sequence-to-sequence models be used to convert source code from one programming language to another?

Sequence-to-sequence models have achieved good performance in natural language translation. Could these models also be applied to convert source code written in one programming language to source code ...
user avatar
2 votes
1 answer
128 views

What happens when the output length in the brevity penalty is zero?

The brevity penalty is defined as $$bp = e^{(1- r/c)},$$ where $r$ is the reference length and $c$ is the output length. But what happens if the output length gets zero? Is there any standard way ...
user avatar
2 votes
0 answers
34 views

Best approach for online Machine Translation with few hundred of samples?

I want to implement a model that improves itself with the passage of time. My main task is to build a machine translator (from English to Urdu).. The problem I am facing is that I have very little ...
user avatar
1 vote
0 answers
58 views

Why do both sine and cosine have been used in positional encoding in the transformer model?

The Transformer model proposed in "Attention Is All You Need" uses sinusoid functions to do the positional encoding. Why have both sine and cosine been used? And why do we need to separate the odd ...
user avatar
  • 11
2 votes
0 answers
30 views

Small Machine Translation Model

I would like to perform Machine Translation in tensorflow.js, in the browser. The issue is that state-of-the-art models have many gigabytes (fairseq ensemble), and translation is slow. Do you know ...
user avatar
  • 121
4 votes
1 answer
412 views

What are the differences between Bytenet and Wavenet?

I recently read Bytenet and Wavenet and I was curious why the first model is not as popular as the second. From my understanding, Bytenet can be seen as a seq2seq model where the encoder and the ...
user avatar
  • 1,078
3 votes
1 answer
42 views

Is this technique image processing or computer vision?

If I use my mobile camera on a signboard or announcement board on a road or in a street (like the one attached in photo) where the message is written in Russian and my mobile shows me that message in ...
user avatar
  • 163
29 votes
9 answers
7k views

What is the actual quality of machine translations?

As an AI layman, till today I am confused by the promised and achieved improvements of automated translation. My impression is: there is still a very, very far way to go. Or are there other ...
user avatar
4 votes
1 answer
131 views

How do I identify a monologue or dialogue in a conversation?

How do I identify monologues and dialogues in a conversation (or transcript) using natural language processing? How do I distinguish between the two?
user avatar
1 vote
0 answers
150 views

How are the attention weights normalised in the transformer?

In the Transformer (adopted in BERT), we normalize the attention weights (dot product of keys and queries) using a softmax in the Scaled Dot-Product mechanism. It is unclear to me whether this ...
user avatar
  • 131
1 vote
2 answers
68 views

Convolutional Sequence to Sequence Learning kernel parameters

I am reading the paper Convolutional Sequence to Sequence Learning by Facebook AI researchers and having trouble to understand how the dimensions of convolutional filters work here. Please take a look ...
user avatar
  • 325
2 votes
0 answers
38 views

Translate product names with AI

I frequently need to translate product names for hundreds of similar products -- and I have a list of past product names. Is it possible to train AI to review past translations and translate? It doesn'...
user avatar
  • 121
1 vote
2 answers
253 views

Do I need an encoder-decoder architecture to predict the next item of a sequence?

I am trying to understand how RNNs are used for sequence modelling. On a tutorial here, it mentions that if you want to translate say a sentence from English to French you can use an encoder-decoder ...
user avatar
  • 173
3 votes
0 answers
147 views

What is the intuition behind the calculation of the similarity between encoder and decoder states?

Suppose that we are doing machine translation. We have a conditional language model with attention where we are are trying to predict a sequence $y_1, y_2, \dots, y_J$ from $x_1, x_2, \dots x_I$: $$P(...
user avatar
1 vote
1 answer
54 views

Neural network with logical hidden layer - how to train it? Is it policy gradient problem? Chaining NNs?

I am doing neural machine translation task from language S to language T via interlingua L. So - there is the structure: ...
user avatar
  • 753
3 votes
2 answers
228 views

Why can't we use Google Translate for every translation task?

Once a book is published in a language, why can't the publishers use Google Translate AI or some similar software to immediately render the book in other languages? Likewise for Wikipedia: I'm not ...
user avatar
0 votes
4 answers
1k views

Why does Google Translate produce two different translations for the same Chinese text?

I don't understand why Google Translate translates the same text in different ways. Here is the Wikipedia page of the 1973 film "Enter the Dragon". You can see that its traditional Chinese ...
user avatar