Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [backpropagation]

For questions related to the technique of backpropagation, whereby the loss, error, or correction signal calculated at the output of an artificial network output is fed back to the parameters in each layer of the network until the network's behavior converges to a training state within the required accuracy and reliability.

4
votes
1answer
104 views

How are filters weights updated for a CNN?

I've been trying to learn backpropagation for CNNs. I read several articles like this one and this one. They all say that to compute the gradients for the filters, you just do a convolution with the ...
0
votes
0answers
16 views

Difficulties to implement the layer-wise relevance propagation in MATLAB

I'm having serious issues with the implementation of the LRP algorithm for neural networks in MATLAB. The challenge is to implement the equations correctly. I'm trying to implement the deep-Taylor $\...
0
votes
2answers
42 views

How should the values of the filters of a CNN change?

I wrote a convolutional neural network for the MNIST dataset with Numpy from scratch. I am currently trying to understand every part and calculation. But one thing I noticed was the "just positive" ...
1
vote
0answers
32 views

How are the weights between the input and hidden layer updated in a 3 layer neural network?

Consider a feed-forward neural network with one hidden layer. How are the weights between the input and hidden layer updated, after the weights between the hidden layer and output layer are updated?
0
votes
1answer
29 views

When is bias values updated in back propagation?

I am new to deep learning. I have doubts on modifying bias values during back propagation. My doubts are Does the back propagation algorithm modifies the weigh values and bias values in the same pass?...
1
vote
1answer
56 views

Is back propagation applied for each data point or for a batch of data points?

I am new to deep learning and trying to understand the concept of back propagation. I have a doubt on when the back propagation is applied. Assume that I have a training data set of 1000 images for ...
0
votes
1answer
22 views

Back propagation on Flatten Layer in CNN

I am making a NN library without any other external NN lib and is implementing the Flatten layer. I know the forward implementation of flatten layer but is the backward just reshaping it or not? If ...
5
votes
2answers
99 views

Are on-line backpropagation iterations perpendicular to the constraint?

Raul Rojas' Neural Networks A Systematic Introduction, section 8.1.2 relates off-line backpropagation and on-line backpropagation with Gauss-Jacobi and Gauss-Seidel methods for finding the ...
2
votes
1answer
71 views

What is the difference between backpropagation and predictive coding?

Reading the high-level descriptions of backpropagation and predictive coding, they don't sound so drastically different. What is the key difference between these techniques? I am currently reading ...
0
votes
0answers
66 views

How to back-propagate illegal actions for policy gradient learning

When training a AI RL agent to play a game there'll be situations where the AI cannot perform certain actions lest they violate the game rules. That's easy to handle, and I can set illegal actions to ...
1
vote
1answer
37 views

Which local minima to choose according to the shape of the error surface?

The following plot shows error function output based on system weights. Two equal local minima are shown in green pointers. Note that the red dots are not related to the question. Considering the ...
3
votes
2answers
54 views

Could error surface shape be useful to detect which local minima is better for generalization?

The following plot shows error function output based on system weights. Two equal local minima are shown in green pointers. Note that the red dots are not related to the question. Does the right one ...
1
vote
1answer
57 views

How does backpropagation with unbounded activation functions such as ReLU work?

I am in the process of writing my own basic machine learning library in Python as an exercise to gain a good conceptual understanding. I have successfully implemented backpropagation for activation ...
1
vote
1answer
76 views

A neural network for digits recognition doesn't work (MNIST, Numpy) [closed]

I'm a beginner in machine learning and I was trying to make a test neural network for digits recognition from scratch using Numpy. I used MNIST dataset for training and testing. Input layer have 28*28 ...
2
votes
2answers
53 views

Which neuron represents which part of the input?

In a neural network, each neuron represents some part of the input. For example, in the case of a MNIST digit, consider the stem of the number 9. Each neuron in the NN represents some part of this ...
0
votes
1answer
35 views

Training the generator in a GAN pair with back propagation

For the purposes of this question I am asking about training the generator, assume that training the discriminator is another topic. My understanding of generative adversarial networks is that you ...
0
votes
1answer
200 views

Feed forward neural network using numpy for IRIS dataset

I tried to build a neural network for working on IRIS dataset using only numpy after reading an article (link: https://iamtrask.github.io/2015/07/12/basic-python-network/). I tried to search the ...
1
vote
2answers
228 views

What is the derivative function used in backpropagration?

I'm learning AI, but this confuses me. The derivative function used in backpropagation is the derivative of activation function or the derivative of loss function? These terms are confusing: ...
2
votes
1answer
42 views

What is the use of the $\epsilon$ term in this back-propagation equation?

I am currently looking at different documents to understand back-propagation, mainly at this document. Now, at page 3, there is the $\epsilon$ symbol involved: While I understand the main part of the ...
4
votes
1answer
39 views

Am I able to visualize the differentiation in backprop as follows?

I'm wondering if I can visualize the backprop process as follows (please excuse me if I have written something terrible wrong). If the loss function $L$ on a neural network represents the function has ...
1
vote
1answer
24 views

Training by one batch of examples, what does it mean

Say I have a batch of examples, each examples represent a state: ...
4
votes
4answers
297 views

What is the actual learning algorithm: back-propagation or gradient descent?

What is the actual learning algorithm: back-propagation or gradient descent (or, in general, the optimization algorithm)? I am reading through chapter 8 of Parallel Distributed Processing hand book ...
1
vote
0answers
28 views

Use of backpropagation for weight updates in a combination of 2 neural networks

Every neural network updates its weights through back-propagation. How is back-propagation used for updating weights in a combination of 2 or more neural networks (e.g.:CNN-LSTM, GAN-CNN, etc.). For ...
2
votes
0answers
91 views

Update of weights in Recurrent Neural Network through back propagation

How does Recurrent Neural Network updates its weights and bias through backpropagation? Is time taken into account while updating the weights of a RNN using Backpropagation through time(BPTT)?"
1
vote
0answers
33 views

Using features extracted from a CNN as convolutional filter

I'm a bit confused about this. Assume I have a CNN network with two branches: Top Bottom The top branch outputs a feature vector of shape 1x1x1x10 (batch, h, w, c) The bottom branch outputs a ...
2
votes
1answer
163 views

How to perform neural network with output constraint?

Imagine a "simple" feedforward, fully connected neural network, with some input size, some number of hidden layers, and some # of neurons....etc BUT with a fixed number of output size (that is saying, ...
0
votes
1answer
48 views

How do I know how changes in the weights are changing the reward in Reinforcement Learning

I already know the basics of the basic of Machine Learning. E.g.: Backpropagation, Convolution, etc. First of let me explain Reinforcement learning to make sure I grasped the concept correctly. In ...
1
vote
1answer
141 views

How to find partial derivative of softmax w.r.t logits in python

i have trouble implementing back propogation for multi class classification of CIFAR10 dataset My neural network has 2 layers forward propagation X -> L1 -> L2 weights W are initialized as random ...
0
votes
2answers
122 views

How do I change the values of a neural net

I'm trying to have a go at building a neural net, but I can't seem to figure out how to optimise the connections. I've tried to have a look online and it came up with "backpropagation". I looked ...
4
votes
1answer
1k views

How to train a CNN

When it comes to CNNs, I don't understand 2 things in the training process: How do I pass the error back when there are pooling layers between the convolutional layers? And if I know how it's done, ...
4
votes
1answer
65 views

Backpropagation With Medium-sized Neural Networks

So, I've been wanting to make my own Neural Network in Python, in order to better understand how it works. I've been following this series of videos as a sort of guide, but it seems the ...
1
vote
0answers
24 views

Has anyone investigated iteration awareness beyond RNN and LSTM?

This question considers the convergence of an artificial networks (MLPs, RNNs, LSTM nets, CNNs) over time or over the course of epochs made up of iterations through training examples. In this ...
1
vote
0answers
101 views

Backpropagation of convolutional neural network - confusion [closed]

I've already seen many articles about this topic and Backpropagation In Convolutional Neural Networks by Jefkine (5 September 2016) seems to be the best. Although, as author said, For the purposes ...
5
votes
1answer
132 views

Why not teach to a NN not only what is true, but also what is not true?

I'm not a person who studies neural networks, or does anything that is related with that area, but I have seen a couple of seminars, videos (such as 3Blue1Brown's Series), and what I am always told is ...
1
vote
1answer
242 views

Backward Pass for LSTMs

TL;DR I am currently trying to understand the mathematics in Ger's paper Long Short-Term Memory in Recurrent Neural Networks. I have found the document clear and readable so far. On pg. 21 of the ...
4
votes
1answer
1k views

Do we know what the units of neural networks will do before we train them?

I apologize if this is a repeated question or if this is too simple. I was learning about back-propagation and looking at the algorithm there is no particular 'partiality' given to any unit. What I ...
1
vote
1answer
908 views

How do I implement softmax forward propagation and backpropagation to replace sigmoid in a neural network?

I'm currently using 3Blue1Brown's tutorial series on neural networks and lack extensive calculus knowledge/experience. I'm using the following equations to calculate the gradients for weights and ...
0
votes
1answer
40 views

How to change a weight/bias with gradient

After watching 3Blue1Brown's tutorial series, and an array of others, I'm attempting to make my own neural network from scratch. So far, I'm able to calculate the gradient for each of the weights and ...
2
votes
3answers
1k views

What is the best XOR neural network configuration out there in terms of low error?

I'm trying to understand what would be the best neural network for implementing a XOR gate. I'm considering a neural network to be good if it can produce all the expected outcomes with the lowest ...
2
votes
0answers
435 views

How to calculate gradient of filter in convolution network

I have similar architecture like in image:CNN. I don't understand how to calculate gradient of filter F. I found these equations(source): Gradient and delta, where first equation calculate gradient ...
5
votes
3answers
432 views

CNN backpropagation with stride>1

I read that to compute the derivative of the error with respect to the input of a convolution layer is the same to make of a convolution between deltas of the next layer and the weight matrix rotated ...
2
votes
1answer
99 views

How to determine the size of biases? [closed]

I'm new to the world of machine learning. My question is how can I determine the size of the biases in a neural network (with backpropagation algorithm)? Currently, I have a 2-layer neural network (1 ...
11
votes
2answers
6k views

What is the time complexity for training a neural network using back-propagation?

Suppose that a NN contains $n$ hidden layers, $m$ training examples, $x$ features, and $n_i$ nodes in each layer. What is the time complexity to train this NN using back-propagation? I have a basic ...
1
vote
0answers
227 views

How does backpropagation work on a custom loss function whose components have magnitudes of different orders?

I want to use a custom loss function which is a weighted combination of l1 and DSSIM losses. The DSSIM loss is limited between 0 and 0.5 where as the l1 loss can be orders of magnitude greater and is ...
2
votes
1answer
203 views

Hand computing feed forward and back propagation of neural network

I used to treat back propagation as a black box but lately I want to understand more about it. I have used mattmuzr's and DuttA's explanaiton as a guide to hand compute a simple neural network. I have ...
4
votes
1answer
149 views

A few doubts on back propagation

I'm having trouble wrapping my head around some details of neural nets and back prop. For example's sake, consider the following net, where I have separated the 'neurons' into linear nodes plus ...
6
votes
2answers
4k views

How is gradient calculated for middle layer weights?

I am trying to understand backpropagation. I used a simple neural network with one input x, one hidden layer h and one output layer y, with weight w1 connecting x to h, and w2 connecting h to y. x--...
4
votes
1answer
278 views

How to deal with back-propagation when dealing with invalid moves in Reinforced Learning?

As discussed in this thread, you can handle invalid moves in Reinforced Learning by re-setting the probabilities of all illegal moves to zero and renormalising the output vector. In back-propagation, ...
0
votes
2answers
2k views

Can anyone show me the derivative of Leaky RELU in C#?

I am in the process of getting back into AI programming after some time out and have been building my neural net in C#.NET. I managed to get all of the feed-forward stuff working very eloquently but ...
2
votes
0answers
94 views

Data prepared to linear regression. Can I use it with backpropagation?

I'm studying a Master's Degree in Artificial Intelligence and I need to learn how to use the Java Neural Network Simulator, JavaNNS, program. In one practice I have to build a neural network to use ...