Skip to main content
Search type Search syntax
Tags [tag]
Exact "words here"
Author user:1234
user:me (yours)
Score score:3 (3+)
score:0 (none)
Answers answers:3 (3+)
answers:0 (none)
isaccepted:yes
hasaccepted:no
inquestion:1234
Views views:250
Code code:"if (foo != bar)"
Sections title:apples
body:"apples oranges"
URL url:"*.example.com"
Saves in:saves
Status closed:yes
duplicate:no
migrated:no
wiki:no
Types is:question
is:answer
Exclude -[tag]
-apples
For more details on advanced search visit our help page
Results tagged with
Search options answers only not deleted user 4631

For questions about training networks, rules systems, or other AI system components.

8 votes
Accepted

What are the best known gradient-free training methods for deep learning?

There are several different algorithms that can be used for gradient free neural network training. …
Aiden Grossman's user avatar
7 votes

Why are the initial weights of neural networks randomly initialised?

The initial weights in a neural network are initialized randomly because the gradient based methods commonly used to train neural networks do not work well when all of the weights are initialized to t …
Aiden Grossman's user avatar
1 vote

How does an activation function's derivative measure error rate in a neural network?

Measuring the error rate of a neural network does not involve the derivative of the sigmoid function at all. It only needs the neural networks outputs, and the expected outputs. It does not matter how …
Aiden Grossman's user avatar
1 vote
Accepted

Can particle swarm optimization be used to train neural networks with more than one hidden l...

If you have, let's say, 1,000,000 training examples, you are doing a lot more error calculations, even if you used a small batch size, than if you used another technique lake back-propagation or a related …
Aiden Grossman's user avatar
1 vote
Accepted

Are both the training and inference systems required in the same application?

Training and inference are usually completed on two separate systems. … However, training and inference are almost always done on two separate systems. …
Aiden Grossman's user avatar