I was recently reading a bit about transformers and I don't understand them very much but I was wondering if anyone knows if any of their techniques such as attention mechanism or anything has been applied to regression problems or function approximation problems?

If anyone has any references or ideas on if this is a sensible idea I would be interested to know :)


  • $\begingroup$ You're asking many questions here, even though you might not have noticed it. Transformers and attention are not the same thing. Moreover, it's not clear what you mean by "function approximation problems". I think you mean just "regression", but I could be wrong, so, please, edit your post to fix these issues. $\endgroup$
    – nbro
    Apr 20 at 13:33

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.