Questions tagged [teacher-forcing]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
1 answer
179 views

How to do testing for an RNN that was trained with teacher forcing only?

If an RNN is trained using only the teacher forcing, then the network takes the actual output from the previous time step as input to the hidden state the next time step. We know that the actual ...
hanugm's user avatar
  • 3,792
2 votes
1 answer
57 views

Can teacher forcing in RNN ensure Turing completeness?

RNN has the same capability as a universal Turing machine. But I am confused whether RNN holds the same capabilities if we use teacher forcing. Consider the following excerpts from paragraphs taken ...
hanugm's user avatar
  • 3,792
1 vote
0 answers
59 views

Do bi-directional RNNs necessarily use 100% teacher forcing?

I typically think of teacher forcing as optional when training an RNN. We may either: use the output of time-step $t$ as the input to time-step $t+1$ use the $(t+1)$th input as the input to time-...
Alexander Soare's user avatar
3 votes
1 answer
979 views

What is teacher forcing?

In the paper Neural Programmer-Interpreters, the authors use the teacher forcing technique, but what exactly is it?
nbro's user avatar
  • 40.2k
1 vote
1 answer
142 views

Why feeding the correct output as input during training of seq2seq models?

I've read about seq2seq for time-series and it seemed really promising, but, when I went to implement it, all the tutorials I've found use the correct output as input to the decoder phase during ...
Ramon Dettmer's user avatar