Skip to main content
11 votes

What is the time complexity of the forward pass algorithm of a feedforward neural network?

Let's suppose that we have an MLP with $15$ inputs, $20$ hidden neurons and $2$ output neurons. The operations performed are only in the hidden and output neurons, given that the input neurons only ...
nbro's user avatar
  • 40.9k
4 votes

Are mult-adds and FLOPs equivalent?

According to this source, one MAC is roughly equal to two FLOP (multiply accumulate). My guess/understanding would be that the distinction is made because neural nets spend compute overwhelmingly on ...
k.c. sayz 'k.c sayz''s user avatar
1 vote

What are some resources regarding the complexity of training neural networks?

There are a few technical papers and books on the topic Computational Limitations on Learning from Examples (1988) by Leonard Pitt and Leslie G. Valiant, published in Journal of the ACM Training a 3-...
nbro's user avatar
  • 40.9k

Only top scored, non community-wiki answers of a minimum length are eligible