1
$\begingroup$

I've read about seq2seq for time-series and it seemed really promising, but, when I went to implement it, all the tutorials I've found use the correct output as input to the decoder phase during training, instead of using the actual prediction made by the cell before it. Is there a reason why not do the latter?

I've been using the tutorial from here

But all the other tutorials that I've found followed the same principle.

Improve this question
$\endgroup$
1

1 Answer 1

Reset to default
0
$\begingroup$

The reason why you would use the ground truth as input to the decoder is to learn the testing distribution. From what I've seen so far, most of the papers are using scheduled sampling (Bengio et al.). Meaning that you will introduce a new term $p$, which will be the probability of the network to feed as input its own prediction. Initially, $p$ will be very small, so that the network will use the ground truth, but later as more iterations pass by, the probability will increase and the network will start using its own predictions.

Improve this answer
$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .