Pretty much the title. I'm no expert but from what I know, if you add up enough sine functions with proper amplitudes and frequencies you can get any function you want as a result. With that knowledge, wouldn't it make sense to have neuron's activation function be a sine function?

  • $\begingroup$ No it wouldn't. There are many considerations, like computational complexity, monotonicity, multivariate nature of data. $\endgroup$
    – user9947
    Sep 25 '20 at 20:42
  • $\begingroup$ There was once a similar question, which I answered by saying that the sine is periodic, and that may not be desirable. Doesn't the Fourier transform assume that you have like complex coefficients or something? I don't recall anymore. $\endgroup$
    – nbro
    Sep 25 '20 at 20:53

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.