# Questions tagged [perceptron]

For questions about the perceptron learning algorithm in Machine Learning.

48 questions
Filter by
Sorted by
Tagged with
25 views

### How to show $\rho > 0$ when $\rho$ be minimum attainable from $y_n(W^{*T}X_n)$, where $W^*$ the vector that separates the data?

In the book Learning from Data written (by Abu Mostafa), we have the following exercise: Let $\rho$ be minimum attainable from $y_n(W^{*T}X_n)$ where $W^*$ is the vector that separates the data. Show ...
56 views

### What's the difference between a "perceptron" and a GLM?

In a comment to this question user nbro comments: As a side note, "perceptrons" and "neural networks" may not be the same thing. People usually use the term perceptron to refer to ...
19 views

### What's the effect of increasing hidden nodes?

Topic Demarcation I find many topics on "how to choose the number of hidden nodes". I'm not interested in the answer to that question. What I learned I learned, that if you increase the ...
24 views

### Is the main difference between the logistic regression and the perceptron the activation function they use?

I went through a Stats StackExchange's post about the difference between logistic regression and perceptron, which is too long to get the key point. I'd like to consider the question in terms of the ...
55 views

### What are (all) the differences between a neuron and a perceptron?

I know two differences between a neuron and a perceptron Neuron employs non-linear activation function and perceptron employs only a threshold activation function. Output of a neuron is not ...
27 views

### Could someone help tell what the labels are pointed out by red rectangles?

The following figure comes from the paper The perceptron: A probabilistic model for information storage and organization in the brain I can tell the labels pointed out by blue rectangles are: "...
35 views

### An explanation involving the sign activation, its affect on the loss function, and the perceptron and perceptron criterion: what is this saying? (#2)

I recently asked a very similar question here, but the answer only seems to address the first part of the quote, rather than the second part that contains the perceptron criterion example. Therefore, ...
21 views

### What are the labels in figure1 in the Paper "The perceptron: A probabilistic model for information storage and organization in the brain"?

This figure comes from The perceptron: A probabilistic model for information storage and organization in the brain I guess the first circle (neuron) labels RETINA, the second labels perceptron area, ...
28 views

### Is the formula $\frac {1}{s}\sum _{j=1}^{s}|d_{j}-y_{j}(t)|$ the correct form of 0-1 loss function, in the context of Perceptron?

Per page 7 of this MIT lecture notes, the original single-layer Perceptron uses 0-1 loss function. Wikipedia uses $${\frac {1}{s}}\sum _{j=1}^{s}|d_{j}-y_{j}(t)|} \tag{1$$ to denote ...
55 views

### An explanation involving the sign activation, its affect on the loss function, and the perceptron and perceptron criterion: what is this saying?

I am currently studying the textbook Neural Networks and Deep Learning by Charu C. Aggarwal. Chapter 1.2.1.3 Choice of Activation and Loss Functions says the following: The classical activation ...
41 views

### Is $(y_i - \hat y_i)x_i$, part of the formula for updating weights for perceptron, the gradient of some kind of loss function?

A post gives a formula for perceptron to update weights I understand almost all the parts of it, except for the part $(y_i - \hat y_i)x_i$ where does it come from? Is it the gradient of some kind of ...
51 views

### Flowchart for a simplified perceptron leaning algorithm [critique request]

I made a flowchart for a simplified perceptron leaning algorithm. Here is the process of the leaning algorithm. Step_1: Initialize the weights first. Step_2: Get a training example randomly and make ...