I would like to train an RNN to follow the sentences:
"Would you like some cheese"? with "Yes, I would like some cheese."
So whenever the template "Would you like some ____?" appears then RNN produces the sequence above. And it should even work on sentences which are new like "Would you like some blumf?"
I have thought of various ways of doing this. Such as, as well as having 26 outputs for letters of the alphabet have about 20 more for "repeat the character that is 14 characters to the left" and so on.
Has this been done before or is there a better way?