2
$\begingroup$

I want to implement a model that improves itself with the passage of time.

My main task is to build a machine translator (from English to Urdu).. The problem I am facing is that I have very little dataset available to train. Even if I create a corpus still there is a possibility of that corpus having poor translations due to outdated word choice for my native language.

I was thinking to create a model which predicts output and user tells whether it is correct or not. Or maybe suggests a better translation.

Now I have two options.

  1. Take that input from end user, append it to my dataset and retrain the model. (I don't know whether it is even possible or not at production level).

  2. Second is to reinforce that data into previous system. So far I only came to know about Online learning or Reinforcement learning (Q-learning, as my data is very small and even if user is training still not going to be in millions of sentences)

Am I on the right track, and how can I progress with either of these two options? Is there any prebuilt solution similar to this?

|improve this question
$\endgroup$
  • 2
    $\begingroup$ When you say you have a "few hundred samples", is that a few hundred sentences, or a few hundred large documents? $\endgroup$ – Neil Slater Oct 11 at 15:44
  • 1
    $\begingroup$ I am sorry to not being descriptive. But I mean few hundred sentences. $\endgroup$ – Abdul Rehman Oct 11 at 15:58

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.