Questions tagged [backpropagation]

For questions related to the technique of backpropagation, whereby the loss, error, or correction signal calculated at the output of an artificial network output is fed back to the parameters in each layer of the network until the network's behavior converges to a training state within the required accuracy and reliability.

Filter by
Sorted by
Tagged with
1
vote
0answers
48 views

How are the weights between the input and hidden layer updated in a 3 layer neural network?

Consider a feed-forward neural network with one hidden layer. How are the weights between the input and hidden layer updated, after the weights between the hidden layer and output layer are updated?
4
votes
1answer
102 views

What are some concrete steps to deal with the vanishing gradient problem?

I am training an ANN for classification between 3 classes. The ANN has an input layer, one hidden layer and a 3 node output layer. The problem I am facing is that the output being produced by the 3 ...
1
vote
1answer
71 views

When is bias values updated in back propagation?

I am new to deep learning. I have doubts on modifying bias values during back propagation. My doubts are Does the back propagation algorithm modifies the weigh values and bias values in the same pass?...
5
votes
2answers
105 views

Are on-line backpropagation iterations perpendicular to the constraint?

Raul Rojas' Neural Networks A Systematic Introduction, section 8.1.2 relates off-line backpropagation and on-line backpropagation with Gauss-Jacobi and Gauss-Seidel methods for finding the ...
1
vote
1answer
138 views

Is back propagation applied for each data point or for a batch of data points?

I am new to deep learning and trying to understand the concept of back propagation. I have a doubt on when the back propagation is applied. Assume that I have a training data set of 1000 images for ...
2
votes
1answer
235 views

Hand computing feed forward and back propagation of neural network

I used to treat back propagation as a black box but lately I want to understand more about it. I have used mattmuzr's and DuttA's explanaiton as a guide to hand compute a simple neural network. I have ...
0
votes
1answer
218 views

Back propagation on Flatten Layer in CNN

I am making a NN library without any other external NN lib and is implementing the Flatten layer. I know the forward implementation of flatten layer but is the backward just reshaping it or not? If ...
2
votes
1answer
108 views

What is the difference between backpropagation and predictive coding?

Reading the high-level descriptions of backpropagation and predictive coding, they don't sound so drastically different. What is the key difference between these techniques? I am currently reading ...
0
votes
0answers
108 views

How to back-propagate illegal actions for policy gradient learning

When training a AI RL agent to play a game there'll be situations where the AI cannot perform certain actions lest they violate the game rules. That's easy to handle, and I can set illegal actions to ...
3
votes
2answers
60 views

Could error surface shape be useful to detect which local minima is better for generalization?

The following plot shows error function output based on system weights. Two equal local minima are shown in green pointers. Note that the red dots are not related to the question. Does the right one ...
1
vote
1answer
39 views

Which local minima to choose according to the shape of the error surface?

The following plot shows error function output based on system weights. Two equal local minima are shown in green pointers. Note that the red dots are not related to the question. Considering the ...
15
votes
2answers
9k views

What is the time complexity for training a neural network using back-propagation?

Suppose that a NN contains $n$ hidden layers, $m$ training examples, $x$ features, and $n_i$ nodes in each layer. What is the time complexity to train this NN using back-propagation? I have a basic ...
5
votes
0answers
124 views

How to design 4D Deep Recurrent Neural Networks using Tensorflow?

I want to design a simple model that predicts the movement of coordinates with RNNs. In a typical three-dimensional LSTM model, one feature is encoded as one hot encoding, and the ...
1
vote
1answer
130 views

How does backpropagation with unbounded activation functions such as ReLU work?

I am in the process of writing my own basic machine learning library in Python as an exercise to gain a good conceptual understanding. I have successfully implemented backpropagation for activation ...
1
vote
1answer
155 views

A neural network for digits recognition doesn't work (MNIST, Numpy) [closed]

I'm a beginner in machine learning and I was trying to make a test neural network for digits recognition from scratch using Numpy. I used MNIST dataset for training and testing. Input layer have 28*28 ...
0
votes
1answer
295 views

Feed forward neural network using numpy for IRIS dataset

I tried to build a neural network for working on IRIS dataset using only numpy after reading an article (link: https://iamtrask.github.io/2015/07/12/basic-python-network/). I tried to search the ...
1
vote
2answers
247 views

What is the derivative function used in backpropagration?

I'm learning AI, but this confuses me. The derivative function used in backpropagation is the derivative of activation function or the derivative of loss function? These terms are confusing: ...
1
vote
1answer
2k views

How do I implement softmax forward propagation and backpropagation to replace sigmoid in a neural network?

I'm currently using 3Blue1Brown's tutorial series on neural networks and lack extensive calculus knowledge/experience. I'm using the following equations to calculate the gradients for weights and ...
4
votes
1answer
40 views

Am I able to visualize the differentiation in backprop as follows?

I'm wondering if I can visualize the backprop process as follows (please excuse me if I have written something terrible wrong). If the loss function $L$ on a neural network represents the function has ...
1
vote
1answer
24 views

Training by one batch of examples, what does it mean

Say I have a batch of examples, each examples represent a state: ...
2
votes
0answers
96 views

Update of weights in Recurrent Neural Network through back propagation

How does Recurrent Neural Network updates its weights and bias through backpropagation? Is time taken into account while updating the weights of a RNN using Backpropagation through time(BPTT)?"
4
votes
4answers
422 views

What is the actual learning algorithm: back-propagation or gradient descent?

What is the actual learning algorithm: back-propagation or gradient descent (or, in general, the optimization algorithm)? I am reading through chapter 8 of Parallel Distributed Processing hand book ...
1
vote
0answers
28 views

Use of backpropagation for weight updates in a combination of 2 neural networks

Every neural network updates its weights through back-propagation. How is back-propagation used for updating weights in a combination of 2 or more neural networks (e.g.:CNN-LSTM, GAN-CNN, etc.). For ...
1
vote
1answer
443 views

What is the relation between back-propagation and reinforcement learning?

What is the relation between back-propagation and reinforcement learning?
1
vote
0answers
47 views

Using features extracted from a CNN as convolutional filter

I'm a bit confused about this. Assume I have a CNN network with two branches: Top Bottom The top branch outputs a feature vector of shape 1x1x1x10 (batch, h, w, c) The bottom branch outputs a ...
0
votes
1answer
61 views

How do I know how changes in the weights are changing the reward in Reinforcement Learning

I already know the basics of the basic of Machine Learning. E.g.: Backpropagation, Convolution, etc. First of let me explain Reinforcement learning to make sure I grasped the concept correctly. In ...
1
vote
0answers
29 views

Has anyone investigated iteration awareness beyond RNN and LSTM?

This question considers the convergence of an artificial networks (MLPs, RNNs, LSTM nets, CNNs) over time or over the course of epochs made up of iterations through training examples. In this ...
4
votes
1answer
305 views

How to deal with back-propagation when dealing with invalid moves in Reinforced Learning?

As discussed in this thread, you can handle invalid moves in Reinforced Learning by re-setting the probabilities of all illegal moves to zero and renormalising the output vector. In back-propagation, ...
1
vote
1answer
365 views

How to find partial derivative of softmax w.r.t logits in python

i have trouble implementing back propogation for multi class classification of CIFAR10 dataset My neural network has 2 layers forward propagation X -> L1 -> L2 weights W are initialized as random ...
-1
votes
2answers
147 views

How do I change the values of a neural net [closed]

I'm trying to have a go at building a neural net, but I can't seem to figure out how to optimise the connections. I've tried to have a look online and it came up with "backpropagation". I looked ...
3
votes
2answers
4k views

How to combine backpropagation in neural nets and reinforcement learning?

As I am trying to make an AI with reinforcement learning, I have found out and implemented a lot of things such as both these topics (NNs and RL) separately. But when trying to combine them, I have ...
4
votes
1answer
75 views

Backpropagation With Medium-sized Neural Networks

So, I've been wanting to make my own Neural Network in Python, in order to better understand how it works. I've been following this series of videos as a sort of guide, but it seems the ...
5
votes
1answer
2k views

How to train a CNN

When it comes to CNNs, I don't understand 2 things in the training process: How do I pass the error back when there are pooling layers between the convolutional layers? And if I know how it's done, ...
5
votes
1answer
486 views

What makes learned feature detectors specialize in CNN?

It has been shown that it is possible to use unsupervised learning techniques to produce good feature detectors in CNNs. I can't understand what drives specialization of those feature detectors. In ...
1
vote
0answers
148 views

Backpropagation of convolutional neural network - confusion [closed]

I've already seen many articles about this topic and Backpropagation In Convolutional Neural Networks by Jefkine (5 September 2016) seems to be the best. Although, as author said, For the purposes ...
2
votes
1answer
103 views

How to determine the size of biases? [closed]

I'm new to the world of machine learning. My question is how can I determine the size of the biases in a neural network (with backpropagation algorithm)? Currently, I have a 2-layer neural network (1 ...
1
vote
1answer
350 views

Backward Pass for LSTMs

TL;DR I am currently trying to understand the mathematics in Ger's paper Long Short-Term Memory in Recurrent Neural Networks. I have found the document clear and readable so far. On pg. 21 of the ...
5
votes
1answer
227 views

Why not teach to a NN not only what is true, but also what is not true?

I'm not a person who studies neural networks, or does anything that is related with that area, but I have seen a couple of seminars, videos (such as 3Blue1Brown's Series), and what I am always told is ...
4
votes
1answer
1k views

Do we know what the units of neural networks will do before we train them?

I apologize if this is a repeated question or if this is too simple. I was learning about back-propagation and looking at the algorithm there is no particular 'partiality' given to any unit. What I ...
16
votes
1answer
371 views

Differences between backpropagation techniques

Just for fun, I am trying to develop a neural network. Now, for backpropagation I saw two techniques. The first one is used here and in many other places too. What it does is: It computes the ...
0
votes
2answers
2k views

Can anyone show me the derivative of Leaky RELU in C#?

I am in the process of getting back into AI programming after some time out and have been building my neural net in C#.NET. I managed to get all of the feed-forward stuff working very eloquently but ...
2
votes
3answers
2k views

What is the best XOR neural network configuration out there in terms of low error?

I'm trying to understand what would be the best neural network for implementing a XOR gate. I'm considering a neural network to be good if it can produce all the expected outcomes with the lowest ...
3
votes
0answers
507 views

How to calculate gradient of filter in convolution network

I have similar architecture like in image:CNN. I don't understand how to calculate gradient of filter F. I found these equations(source): Gradient and delta, where first equation calculate gradient ...
0
votes
2answers
128 views
1
vote
0answers
296 views

How does backpropagation work on a custom loss function whose components have magnitudes of different orders?

I want to use a custom loss function which is a weighted combination of l1 and DSSIM losses. The DSSIM loss is limited between 0 and 0.5 where as the l1 loss can be orders of magnitude greater and is ...
6
votes
2answers
5k views

How is gradient calculated for middle layer weights?

I am trying to understand backpropagation. I used a simple neural network with one input x, one hidden layer h and one output layer y, with weight w1 connecting x to h, and w2 connecting h to y. x--...
4
votes
1answer
170 views

A few doubts on back propagation

I'm having trouble wrapping my head around some details of neural nets and back prop. For example's sake, consider the following net, where I have separated the 'neurons' into linear nodes plus ...
4
votes
3answers
2k views

How to test if my implementation of back propagation neural Network is correct

I am working on an implementation of the back propagation algorithm. What I have implemented so far seems working but I can't be sure that the algorithm is well implemented, here is what I have ...
2
votes
0answers
109 views

Data prepared to linear regression. Can I use it with backpropagation?

I'm studying a Master's Degree in Artificial Intelligence and I need to learn how to use the Java Neural Network Simulator, JavaNNS, program. In one practice I have to build a neural network to use ...
1
vote
2answers
176 views

Why does ReLU (and other non linearities) work?

Can someone please point me to where I can read up on why non linearities that can produce values larger than 1 or smaller than 0 work. My understanding is that neurons can only produce values between ...