Skip to main content

Questions tagged [hinge-loss]

For questions about the hinge loss, which is typically used for "maximum-margin" classification, most notably for support vector machines (SVMs).

Filter by
Sorted by
Tagged with
7 votes
2 answers
891 views

How should we interpret this figure that relates the perceptron criterion and the hinge loss?

I am currently studying the textbook Neural Networks and Deep Learning by Charu C. Aggarwal. Chapter 1.2.1.2 Relationship with Support Vector Machines says the following: The perceptron criterion is ...
The Pointer's user avatar
2 votes
1 answer
6k views

What is the definition of the hinge loss function?

I came across the hinge loss function for training a neural network model, but I did not know the analytical form for the same. I can write the mean squared error loss function (which is more often ...
hanugm's user avatar
  • 3,850
1 vote
1 answer
175 views

What is the definition of the "cost" function in the SVM's objective function?

In a course that I am attending, the cost function of a support vector machine is given by $$J(\theta)=\sum_{i=1}^{m} y^{(i)} \operatorname{cost}_{1}\left(\theta^{T} x^{(i)}\right)+\left(1-y^{(i)}\...
jr123456jr987654321's user avatar
1 vote
0 answers
19 views

Why is the Hinge Loss defined this way?

I have a question regarding the Hinge Loss function used for classifiers and in general the "max-margin" types of classifiers, it is defined as $$max(0,1-t*y)$$ where $t$ is the intended ...
Riccardo Caiulo's user avatar