Questions tagged [forward-pass]

For questions about the "forward pass" algorithm of a neural network, i.e. the algorithm that transforms the input into the output of the neural network.

Filter by
Sorted by
Tagged with
2
votes
1answer
50 views

What is the Preferred Mathematical Representation for a Forward Pass in a Neural Network?

I know this may be a question of semantics but I always see different articles explain forward pass slightly different. e.g. Sometimes they represent a forward pass to a hidden layer in a standard ...
1
vote
0answers
33 views

Could a quantum computer perform vectorized forward propagation in deep networks?

Forward propagation in Deep Neural Networks In the "Forward Propagation in a Deep Network" video on Coursera, Andrew NG mentions that there's no way to avoid a for loop to loop through the ...
2
votes
0answers
112 views

What is the time complexity of the forward pass and back-propagation of the sequence-to-sequence model with and without attention?

I keep looking through the literature, but can't seem to find any information regarding the time complexity of the forward pass and back-propagation of the sequence-to-sequence RNN encoder-decoder ...
8
votes
1answer
1k views

What is the time complexity of the forward pass algorithm of a feedforward neural network?

How do I determine the time complexity of the forward pass algorithm of a feedforward neural network? How many multiplications are done to generate the output?