Questions tagged [machine-translation]
For questions related to machine translation (MT), which is the task of translating text using a computer, machine or software.
36
questions
0
votes
0answers
10 views
Does the transformers model (in “Attention is All You Need”) exclude the encoder in language modelling tasks?
The language model I am referring to is the one outlined in "Attention is All You Need":
My understanding is that when the task is translation, the encoder's input could be "Hi, my ...
0
votes
0answers
9 views
MBART and better Domain Specific Translations Using Masks?
I'm implementing https://huggingface.co/facebook/mbart-large-50-many-to-many-mmt for translations as it has shown promising results but I wanted to see if there was a way to translate specific parts ...
1
vote
0answers
14 views
Can unsupervised models learn something from cat vocalizations?
I love cats, and over the years have noticed that they have recurrent patterns of vocalizations. For example, upon seeing a bird, a cat may start chittering, but the same cat would never chitter at ...
0
votes
0answers
9 views
How can I design a machine translation model that produces a mapping between the words in the source and target sentences?
I have a dataset of sentences of language X and Y
X
Y
abc def lang
xyz pqrt mno uages
I want to have an output as a table with word-by-word translation (...
0
votes
0answers
10 views
How does translation of a text in an HTML tag works? Consider the following cases
Recently I came a cross to the Google Translate's add-on for Chrome. Basically you have a web page and it translates that web page for you while keeping its structure.
I came to the conclusion that it ...
1
vote
0answers
10 views
Training seq2seq translation model with one source and multiple target
So basically I'm training a sequence to sequence model that translates English sentences to Arabic sentences. I'm using the data provided by Anki @ manythings. I realized that some of the sentences in ...
0
votes
0answers
36 views
What is the role of this initial state of the LSTM layer in an encoder of a seq2seq model?
I am trying to follow this guide to implement a seq2seq machine translation model: https://www.tensorflow.org/tutorials/text/nmt_with_attention.
The tutorial's ...
0
votes
0answers
28 views
What is the purpose of “alignment” in the self-attention mechanism of transformers?
I've been reading about transformers & have been having some difficulty understanding the concept of alignment.
Based on this article
Alignment means matching segments of original text with their ...
0
votes
0answers
16 views
Finding or creating a dataset for Neural Text Simplification
I'm currently starting a research project focused on NLP.
One of the steps involved in this project will be the development of a text simplification system, probably using a neural encoder-decoder ...
1
vote
1answer
294 views
How is Google Translate able to convert texts of different lengths?
According to my experience with Tensorflow and many other frameworks, neural networks have to have a fixed shape for any output, but how does Google translate convert texts of different lengths?
0
votes
0answers
19 views
Effect of Batch Size on a Translation Model's Validation Scores
This is a general question.
I am training a neural machine translation model with different batch sizes: 16, 32, and 64 for the same amount of epochs (10).
I am getting very low validation scores for ...
1
vote
1answer
47 views
Can we use NLP to understand/parse/compile programming code?
I wonder if we can use Natural Language Processing (NLP) to process programming code:
Given a piece of code, can we
Translate it to human language to understand what it does? The input could be a ...
0
votes
0answers
27 views
Comparing English and Spanish Queries using NLP
I am trying to see whether there are differences in sentences between the topics in 2 languages ie English and Spanish. Eg. (Face masks are mandatory, la mascarilla es obligatoria) but this stretched ...
1
vote
1answer
46 views
What are the main differences between a language model and a machine translation model?
What are the main differences between a language model and a machine translation model?
1
vote
0answers
17 views
How to autocorelate multiple variants of same text into one?
I want to improve quality of translations for open-source projects in Ukrainian language. We have multiple translations from different authors. We can also translate messages using machine ...
4
votes
1answer
132 views
Is there any resource that describes in detail a naive example-based machine translation algorithm?
I'm looking to develop a machine translation tool for a constructed language. I think that the example-based approach is the most suitable because the said language is very regular and I can have a ...
2
votes
1answer
49 views
How to do machine translation with no labeled data?
Can it be possible to train a neural network with no parallel bilingual data?
1
vote
0answers
22 views
What's the best method to predict/generate signal from one sensor (source) to signal from another another (target)?
I was wondering what is the best method out there to find relationship between two 1D signals so that I can predict/generate one (source) from the other (target). For example, let's say that in ...
3
votes
0answers
22 views
How to back propagate for implementation of Sequence-to-Sequence with Multi Decoders
I am proposing a modified version of Sequence-to-Sequence model with dual decoders. The problem that I am trying to solve is Neural Machine Translation into two languages at once. This is the ...
3
votes
0answers
40 views
Can sequence-to-sequence models be used to convert source code from one programming language to another?
Sequence-to-sequence models have achieved good performance in natural language translation. Could these models also be applied to convert source code written in one programming language to source code ...
2
votes
1answer
104 views
What happens when the output length in the brevity penalty is zero?
The brevity penalty is defined as
$$bp = e^{(1- r/c)},$$
where $r$ is the reference length and $c$ is the output length.
But what happens if the output length gets zero? Is there any standard way ...
2
votes
0answers
34 views
Best approach for online Machine Translation with few hundred of samples?
I want to implement a model that improves itself with the passage of time.
My main task is to build a machine translator (from English to Urdu).. The problem I am facing is that I have very little ...
1
vote
0answers
45 views
Why do both sine and cosine have been used in positional encoding in the transformer model?
The Transformer model proposed in "Attention Is All You Need" uses sinusoid functions to do the positional encoding.
Why have both sine and cosine been used? And why do we need to separate the odd ...
2
votes
0answers
30 views
Small Machine Translation Model
I would like to perform Machine Translation in tensorflow.js, in the browser. The issue is that state-of-the-art models have many gigabytes (fairseq ensemble), and translation is slow.
Do you know ...
4
votes
1answer
312 views
What are the differences between Bytenet and Wavenet?
I recently read Bytenet and Wavenet and I was curious why the first model is not as popular as the second. From my understanding, Bytenet can be seen as a seq2seq model where the encoder and the ...
3
votes
1answer
35 views
Is this technique image processing or computer vision?
If I use my mobile camera on a signboard or announcement board on a road or in a street (like the one attached in photo) where the message is written in Russian and my mobile shows me that message in ...
28
votes
9answers
6k views
What is the actual quality of machine translations?
As an AI layman, till today I am confused by the promised and achieved improvements of automated translation.
My impression is: there is still a very, very far way to go. Or are there other ...
4
votes
1answer
109 views
How do I identify a monologue or dialogue in a conversation?
How do I identify monologues and dialogues in a conversation (or transcript) using natural language processing? How do I distinguish between the two?
1
vote
0answers
109 views
How are the attention weights normalised in the transformer?
In the Transformer (adopted in BERT), we normalize the attention weights (dot product of keys and queries) using a softmax in the Scaled Dot-Product mechanism. It is unclear to me whether this ...
1
vote
2answers
55 views
Convolutional Sequence to Sequence Learning kernel parameters
I am reading the paper Convolutional Sequence to Sequence Learning by Facebook AI researchers and having trouble to understand how the dimensions of convolutional filters work here. Please take a look ...
2
votes
0answers
32 views
Translate product names with AI
I frequently need to translate product names for hundreds of similar products -- and I have a list of past product names. Is it possible to train AI to review past translations and translate? It doesn'...
1
vote
2answers
187 views
Do I need an encoder-decoder architecture to predict the next item of a sequence?
I am trying to understand how RNNs are used for sequence modelling.
On a tutorial here, it mentions that if you want to translate say a sentence from English to French you can use an encoder-decoder ...
3
votes
0answers
124 views
What is the intuition behind the calculation of the similarity between encoder and decoder states?
Suppose that we are doing machine translation. We have a conditional language model with attention where we are are trying to predict a sequence $y_1, y_2, \dots, y_J$ from $x_1, x_2, \dots x_I$: $$P(...
1
vote
1answer
45 views
Neural network with logical hidden layer - how to train it? Is it policy gradient problem? Chaining NNs?
I am doing neural machine translation task from language S to language T via interlingua L. So - there is the structure:
...
2
votes
2answers
205 views
Why can't we use Google Translate for every translation task?
Once a book is published in a language, why can't the publishers use Google Translate AI or some similar software to immediately render the book in other languages? Likewise for Wikipedia: I'm not ...
0
votes
4answers
1k views
Why does Google Translate produce two different translations for the same Chinese text?
I don't understand why Google Translate translates the same text in different ways.
Here is the Wikipedia page of the 1973 film "Enter the Dragon". You can see that its traditional Chinese ...
