Questions tagged [perceptron]
For questions about the perceptron learning algorithm in Machine Learning.
9
questions
2
votes
3
answers
292
views
Where does the so-called 'loss' / 'loss function' fit into the idea of a perceptron / artificial neuron (as presented in the figure)?
I am currently studying the textbook Neural Networks and Deep Learning by Charu C. Aggarwal. Chapter 1.2.1.3 Choice of Activation and Loss Functions presents the following figure:
$\overline{X}$ is ...
- 477
14
votes
3
answers
5k
views
Did Minsky and Papert know that multi-layer perceptrons could solve XOR?
In their famous book entitled Perceptrons: An Introduction to Computational Geometry, Minsky and Papert show that a perceptron can't solve the XOR problem. This contributed to the first AI winter, ...
- 2,059
7
votes
1
answer
1k
views
Which Rosenblatt's paper describes Rosenblatt's perceptron training algorithm?
I struggle to find Rosenblatt's perceptron training algorithm in any of his publications from 1957 - 1961, namely:
Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms
The ...
- 83
6
votes
5
answers
1k
views
Why can't the XOR linear inseparability problem be solved with one perceptron like this?
Consider a perceptron where $w_0=1$ and $w_1=1$:
Now, suppose that we use the following activation function
\begin{align}
f(x)=
\begin{cases}
1, \text{ if }x =1\\
0, \text{ otherwise}
\end{cases}
\...
- 163
5
votes
1
answer
247
views
Which part of "Perceptrons: An Introduction to Computational Geometry" tells that a perceptron cannot solve the XOR problem?
In the book "Perceptrons: An Introduction to Computational Geometry" by Minsky and Papert (1969), which part of this book tells that a single-layer perceptron could not solve the XOR problem?
I have ...
- 51
4
votes
1
answer
184
views
What's the difference between a "perceptron" and a GLM?
In a comment to this question user nbro comments:
As a side note, "perceptrons" and "neural networks" may not be the same thing. People usually use the term perceptron to refer to ...
- 278
3
votes
2
answers
2k
views
Perceptron learning algorithm: different accuracies for different training methods
So, my question is a bit theoretical. I have been trying to implement a perceptron based classifier with outputs 1 and 0 depending on the category. I have used 2 methods: The ...
user9947
3
votes
0
answers
210
views
If we use a perceptron with a non-monotonic activation function, can it solve the XOR problem?
I found several papers about how to build a perceptron able to solve the XOR problem. The papers describe a solution where the heaviside step function is replaced by a non-monotonic activation ...
- 31
1
vote
1
answer
108
views
An explanation involving the sign activation, its affect on the loss function, and the perceptron and perceptron criterion: what is this saying?
I am currently studying the textbook Neural Networks and Deep Learning by Charu C. Aggarwal. Chapter 1.2.1.3 Choice of Activation and Loss Functions says the following:
The classical activation ...
- 477