3
$\begingroup$

I understand that seq2seq models are perfectly suitable when the input and/or the output have variable lengths. However, if we know exactly the input/output sequence lengths of the neural network. Is this the best approach?

$\endgroup$

1 Answer 1

0
$\begingroup$

If you would classify a transformer as Seq2Seq, then it is arguably the best. This is only arguably due to accuracy.

Shallow neural networks or even decision trees and forests may be better in production due to lower training time, lower inference time and smaller size in memory.

Overall, it requires a bit of a compromise, and you need to do what suits your use case. For example you wouldn't run GPT-3 on a raspberry pi pico (for example). So it depends on what you mean by "best".

$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .