Questions tagged [backpropagation]

For questions related to the technique of backpropagation, whereby the loss, error, or correction signal calculated at the output of an artificial network output is fed back to the parameters in each layer of the network until the network's behavior converges to a training state within the required accuracy and reliability.

Filter by
Sorted by
Tagged with
6
votes
2answers
5k views

How is gradient calculated for middle layer weights?

I am trying to understand backpropagation. I used a simple neural network with one input x, one hidden layer h and one output layer y, with weight w1 connecting x to h, and w2 connecting h to y. x--...
4
votes
1answer
170 views

A few doubts on back propagation

I'm having trouble wrapping my head around some details of neural nets and back prop. For example's sake, consider the following net, where I have separated the 'neurons' into linear nodes plus ...
4
votes
3answers
2k views

How to test if my implementation of back propagation neural Network is correct

I am working on an implementation of the back propagation algorithm. What I have implemented so far seems working but I can't be sure that the algorithm is well implemented, here is what I have ...
2
votes
0answers
110 views

Data prepared to linear regression. Can I use it with backpropagation?

I'm studying a Master's Degree in Artificial Intelligence and I need to learn how to use the Java Neural Network Simulator, JavaNNS, program. In one practice I have to build a neural network to use ...
1
vote
2answers
177 views

Why does ReLU (and other non linearities) work?

Can someone please point me to where I can read up on why non linearities that can produce values larger than 1 or smaller than 0 work. My understanding is that neurons can only produce values between ...
0
votes
1answer
98 views

Is there any research on neural networks with multiple outputs for hierarchical label classification?

I had this idea of training for example a CNN on images, and having output branches at several of its intermediate layers. The early layers' output branch might then predict high-level class of ...
1
vote
0answers
690 views

Forecasting and predict using matlab Artificial Neural Network [closed]

I selected the below data set for forecast and predict using artificial neural network as my final year project. https://archive.ics.uci.edu/ml/datasets/Bank+Marketing. I normalized the data set and ...
4
votes
2answers
631 views

Are Dreams a Form of Backpropagation?

Humans often dream of random events that occurred during the day. Could the reason for this be that our brains are backpropagating errors while we sleep, and we see the result of these ...
5
votes
1answer
169 views

What would an implementation of this Neural Network look like?

I'm relatively new to neural networks and was wondering what an implementation of this paper would look like. More specifically, how are the correct values of Kp, Ki, and Kd determined at run time so ...
1
vote
0answers
86 views

When do you back-propagate errors through a Neural Network when using TD Lambda

I have a Neural Network that I'm want to use to self-play Connect Four. The neural network receives the board state and is to provide an estimate of the states desirability. I would then, for each ...
4
votes
1answer
207 views

Finding an optimum back propagation algorithm

I recently started working on very simple machine learning codes in Python and I came across a big problem: teaching the system to improve on its guesses. So this is what the code is about: I will ...
6
votes
3answers
512 views

How do I know if my backpropagation is implemented correctly?

I'm working on implementation of the backpropagation algorithm for a simple neural network which predicts a probability of survival (1 or 0) and I can't get it above 80% no matter how much I try to ...
2
votes
0answers
46 views

Recommendations on which architecture to use to guess appointment

I'm currently developping an application which allows psychologists to manage their schedule and budget. As a proof of concept, I would like to create an intelligent appointment service. There can be ...
4
votes
1answer
148 views

Can a neural network learn to avoid wrong decisions using backpropagation?

I studied the articles on Neural Networks and Deep Learning from Michael Nielsen and developed a simple neural network based on his examples. I understand how backpropagation works and I already ...
1
vote
1answer
316 views

What is the order of execution of steps in back propagation algorithm in a neural network?

I am a machine learning newbie. I am trying to understand backpropagation algorithm. I have a training dataset of 60 instances/records. So what is the correct order of the process: Forward pass of ...
0
votes
1answer
235 views

Why doesnt my Neural Network work?

I Build this NN in c++. I reviewed it since 3 days. I checked every line 100 times, but I cant find my error. If someone can please help me find the Bugs: 1. The output is garbage 2. The weights go ...
5
votes
1answer
295 views

What kind of algorithm is the Levenberg–Marquardt algorithm?

Is a Levenberg–Marquardt algorithm a type of back-propagation algorithm or is it a different category of algorithm? Wikipedia says that it is a curve fitting algorithm. How is a curve fitting ...
8
votes
2answers
127 views

How do evolutionary algorithms have advantages over the conventional backpropagation methods?

How does employing evolutionary algorithms to design and train artificial neural networks have advantages over using the conventional backpropagation algorithms?