Questions tagged [hinge-loss]

For questions about the hinge loss, which is typically used for "maximum-margin" classification, most notably for support vector machines (SVMs).

Filter by
Sorted by
Tagged with
2 votes
1 answer
3k views

What is the definition of the hinge loss function?

I came across the hinge loss function for training a neural network model, but I did not know the analytical form for the same. I can write the mean squared error loss function (which is more often ...
user avatar
  • 3,201
5 votes
1 answer
394 views

How should we interpret this figure that relates the perceptron criterion and the hinge loss?

I am currently studying the textbook Neural Networks and Deep Learning by Charu C. Aggarwal. Chapter 1.2.1.2 Relationship with Support Vector Machines says the following: The perceptron criterion is ...
user avatar
1 vote
1 answer
136 views

What is the definition of the "cost" function in the SVM's objective function?

In a course that I am attending, the cost function of a support vector machine is given by $$J(\theta)=\sum_{i=1}^{m} y^{(i)} \operatorname{cost}_{1}\left(\theta^{T} x^{(i)}\right)+\left(1-y^{(i)}\...
user avatar