# Tag Info

### Did Minsky and Papert know that multi-layer perceptrons could solve XOR?

There does not appear to be a historical consensus on this. The Wikipedia page on the Perceptrons book (which does not come down on either side) gives an argument that the ability of MLPs to compute ...
• 7,106
Accepted

### Why is the perceptron criterion function differentiable?

$\max(-y_i(w x_i), 0)$ is not partial derivable respect $w$ if $w x_i=0$. Loss functions are problematic when not derivable in some point, but even more when they are flat (constant) in some interval ...
• 1,272
Accepted

### What is the significance of weights in a feedforward neural network?

You described a single-layer feedforward network. They can have multiple layers. The significance of the weights is that they make a linear transformation from the output of the previous layer and ...
• 381

### Did Minsky and Papert know that multi-layer perceptrons could solve XOR?

Whether Minsky knew or not, it was definitely known to Rosenblatt, as he published those results in his really pioneering report - Principles of Neurodynamics: Perceptrons and the Theory of Brain ...
• 51

### Did Minsky and Papert know that multi-layer perceptrons could solve XOR?

In section 13.2 Other Multilayer Machines (pp. 231-232) of the book Perceptrons: An Introduction to Computational Geometry (expanded edition, third printing, 1988) Minsky and Papert actually talk ...
• 34.9k
Accepted

### Which Rosenblatt's paper describes Rosenblatt's perceptron training algorithm?

The paper (or report) that formally introduced the perceptron is The Perceptron — A Perceiving and Recognizing Automaton (1957) by Frank Rosenblatt. If you read the first page of this paper, you can ...
• 34.9k
Accepted

• 772
1 vote

### Where does the so-called 'loss' / 'loss function' fit into the idea of a perceptron / artificial neuron (as presented in the figure)?

The loss function is simply a way to measure how wrong a neural network is, it doesn't affect the output of the neuron. Say we have a neural network with 3 output neurons that attempts to classify ...
• 11
1 vote
Accepted

### Where does the so-called 'loss' / 'loss function' fit into the idea of a perceptron / artificial neuron (as presented in the figure)?

Loss function is a function used to measure the loss. It is not used in any component of a neuron. It is used in updating the weights of the neuron i.e., in order to train the neuron. The contribution ...
• 3,241
1 vote
Accepted

### In practice, are perceptrons typically implemented as objects?

Unless one performs an exhaustive search, it's difficult to answer your question. However, in the widely used libraries, such as TensorFlow, PyTorch and sklearn, most abstractions (like neural ...
• 34.9k
1 vote
Accepted

### Why did the developement of neural networks stop between 50s and 80s?

I will first address your main question "Why did the development of neural networks stop between 50s and 80s?" In 40-50s there was a lot of progress (McCulloch and Pitts); the perceptron was ...
• 164
1 vote
Accepted

### What is the equation to update the weights in the perceptron algorithm?

I will tell you my knowledge, correct me if I am wrong. Perceptron Learning Algorithm (PLA) is a simple method to solve the binary classification problem. Define a function: $$f_w(x) = w^Tx + b$$ ...
• 857
1 vote

### How do I determine the most appropriate classifier for a certain problem?

This is one of the main skills that separates someone with a deep understanding of, and experience in, machine learning learning, from a neophyte. There are several approaches: Try several methods, ...
• 8,927

Only top scored, non community-wiki answers of a minimum length are eligible