0
$\begingroup$

enter image description here

Does anyone know the reason why there's a FCNN after the self-attention layer? Or at least some intuition for it?

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.