People who code: we want your input. Take the Survey

# Questions tagged [support-vector-machine]

For questions about support vector machines (SVMs), which are supervised learning models with associated learning algorithms that analyze data used for classification and regression analysis.

41 questions
Filter by
Sorted by
Tagged with
0answers
11 views

### How to obtain part filter anchors in DPM Detector

The DPM detector (https://cs.brown.edu/people/pfelzens/papers/lsvm-pami.pdf) uses latent-svm to train the weights of the root and part filters. During training for positive samples, it alternates ...
0answers
9 views

### Can you correlate decision boundary of final layer of a neural network to predictive distribution?

I was reading in a On the Decision Boundary of Deep Neural Networks that the final layer of a MLP can be equated to an SVM and can generate decision boundaries similar to methods with SVM. I was ...
1answer
108 views

### What is the definition of the hinge loss function?

I came across the hinge loss function for training a neural network model, but I did not know the analytical form for the same. I can write the mean squared error loss function (which is more often ...
1answer
46 views

### What is the smoothness assumption in SVMs?

In this research paper, we have the following claim the smoothness assumption that underlies many kernel methods such as Support Vector Machines (SVMs) does not hold for deep neural networks trained ...
0answers
78 views

### Why is the margin attained with $\Phi=\left[2 x, 2 x^{2}\right]^{T}$ greater than the margin attained with $\Phi=\left[x, x^{2}\right]^{T}$?

I am trying to understand the solution to part 4 of problem 3 from the midterm exam 6.867 Machine learning: Mid-term exam (October 15, 2003). For reproducibility, here is problem 3. We consider here ...
2answers
121 views

### If the training data are linearly separable, which of the following $L(w)$ has less optimum answer for $w$, when $y = w^Tx$?

I'm studying machine learning and I came into a challenging question. The answer is 2. But based on my ML notes, all of them are true. Where are the wrong points?
1answer
89 views

### What are support values in a support vector machine?

I started reading up on SVM and very little is defined of what are support values. I reckon it's they are denoted as $\alpha$ in most formulations.
0answers
46 views

### How does the support vector machine constraint imply that sample selection bias will not systematically affect the output of the optimisation?

I am currently studying the paper Learning and Evaluating Classifiers under Sample Selection Bias by Bianca Zadrozny. In section 3.4. Support vector machines, the author says the following: 3.4. ...
1answer
56 views

### Does the image is logistic regression or SVM, and why? [closed]

Does the image is logistic regression or SVM, and why?
0answers
43 views

### What is the easiest method to solve a regularized SVM with Lagrangian?

Consider the regularized SVM approach: \begin{equation} g (\alpha) = \sum_{i=1}^{n} \alpha_i - \frac{1}{2}\sum_{i=1}^{n} \sum_{j=1}^{n} \alpha_i \alpha_j y_i y_j \langle \phi(x_i), \phi(x_j)\rangle_H \...
1answer
298 views

### How should we interpret this figure that relates the perceptron criterion and the hinge loss?

I am currently studying the textbook Neural Networks and Deep Learning by Charu C. Aggarwal. Chapter 1.2.1.2 Relationship with Support Vector Machines says the following: The perceptron criterion is ...
1answer
89 views

### Why doesn't the set $\{ -2, +2 \}$ in $E(X) = (y − \text{sign}\{\overline{W} \cdot \overline{X} \}) \in \{ −2, +2 \}$ include $0$?

I am currently studying the textbook Neural Networks and Deep Learning by Charu C. Aggarwal. Chapter 1.2.1.2 Relationship with Support Vector Machines says the following: The perceptron criterion is ...
1answer
34 views

### Support Vector Machine Convert optimisation problem from argmax to argmin

I'm new to the AI Stackexchange and wasn't certain if this should go here or to Maths instead but thought the context with ML may be useful to understand my problem. I hope posting this question here ...
1answer
77 views

### Why does the training time of SVMs dramatically decrease after applying dimensionality reduction to the features?

Training an SVM with an RBF kernel model with c = 5.5 and gamma = 1.06, for a 5-class classification problem on the NSL-KDD ...
1answer
106 views

0answers
29 views

### Why is my SVM not reaching good accuracy when trained to perform binary classification of search results?

I am trying to perform binary classification of search results based on the relevance to the query. I followed this tutorial on how to make an SVM, and I got it to work with a small iris dataset. Now, ...
1answer
125 views

### How do you perform a gradient based adversarial attack on an SVM based model?

I have an SVM currently and want to perform a gradient based attack on it similar to FGSM discussed in Explaining And Harnessing Adversarial Examples. I am struggling to actually calculate the ...
1answer
43 views

### What are the variables used in a Gaussian radial basis kernel in the context of SVMs?

If I have the Gaussian kernel $$k(x, x') = \operatorname{exp}\left( -\| x - x' \|^2 / 2\sigma^2 \right)$$ What is $x$ and $x'$ in the context of training an SVM?
1answer
111 views

### How do I poison an SVM with manifold regularization?

I'm working on Adversarial Machine Learning, and have read multiple papers on this topic, some of them are mentioned as follows: Poisoning Attacks on SVMs: https://arxiv.org/pdf/1206.6389.pdf ...
1answer
41 views

### Does the bag-of-visual-words method improve the classification accuracy?

I'm a beginner in computer vision. I want to know which option among the following two can get better accuracy of image classification. SIFT features + SVM Bag-of-visual-words features + SVM Here's ...
0answers
25 views

### Scoring feature vector with Support Vector Machine

I am reading the R-CNN paper by Ross Girshick1 et al. (link) and I fail to understand how they do the inference. This is described in the section 2.2.Test-time Detection in the paper. I quote: At ...
0answers
25 views

### Is it possible to combine multiple SVMs that were trained on sublayers of a CNN into one combined SVM?

I have created a CNN for use on the MNIST dataset for now (so I have 10 classes). I have trained SVMs on the sublayers of this trained CNN and wish to combine them into a combined SVM as to give a ...
0answers
45 views

### A generalized quadratic loss and Newton iteration for Support Vector Regression, why doesn't it generalize well?

I'm comparing the results of an Newton optimizer for a modified version of SVM ( a generalized quadratic loss, similar to the one stated in: A generalized quadratic loss for SVM ) with classic SVM^...
1answer
743 views

### How do I combine models trained on different data to increase classification accuracy?

I have two trained models. One is using a LinearSVC algorithm and is trained on numerical data from medical examination from patients with diabetic retinopathy. The second one is a neural network ...
1answer
163 views

### How to implement SVM algorithm from scratch in a programming language?

I'm a computer scientist who's studying support vector machines (SVMs) in a machine learning course. I have some understanding of how SVMs are designed, thanks to 16. Learning: Support Vector Machines ...
0answers
24 views

### why my regression model predict every datapoint to the same value

I am trying to train a SVR but I found that with some combination of features, the trained SVR predict every point in test set to the same value. this problem occurs much more when I use linear kernel ...
1answer
125 views

### Why do we use the word “kernel” in the expression “Gaussian kernel”?

I've heard the expression "Gaussian kernel" in several contexts (e.g. in the kernel trick used in SVM). A Gaussian kernel usually refers to a Gaussian function (that is, a function similar to the ...
4answers
410 views

### What are the domains where SVMs are still state-of-the-art?

It seems that deep neural networks and other neural network based models are dominating many current areas like computer vision, object classification, reinforcement learning, etc. Are there domains ...
0answers
33 views

### What is the benefit of scaling the hyperparameter C of an SVM?

Please read the following page of the Sklearn documentation. The figure shown there (see below) illustrates why C should be scaled when using a SVM with 'l1' penalty, whereas it shouldn't be scaled ...
1answer
59 views

### How does an svm work? How does it perform comparisons between malignant and benign tumor

How do Support Vector Machines (SVMs) differentiate between a glass and a bottle or between a malignant and a benign tumor when it dealing with it for the first time? What will be the analysis ...
2answers
218 views

### What is the purpose of the “gamma” parameter in SVMs?

I want to understand what the gamma parameter does in an SVM. According to this page. Intuitively, the gamma parameter defines ...
3answers
300 views

### What is a support vector machine?

What is a support vector machine (SVM)? Is an SVM a kind of a neural network, meaning it has nodes and weights, etc.? What is it best used for? Where I can find information about these?
5answers
5k views

### Why does training an SVM take so long? How can I speed it up?

I'm trying to create and test non-linear SVMs with various kernels (RBF, Sigmoid, Polynomial) in scikit-learn, to create a model which can classify anomalies and benign behaviors. My dataset includes ...
1answer
633 views

### How do I use a taxonomy and the support vector machine for question classification?

I am going to develop an open-domain natural language question-answering (NLQA) system, and will use the support vector machine (SVM) as the machine learning (ML) model for question classification. ...
2answers
675 views

### Are the shortcomings of neural networks diminishing?

Having worked with neural networks for about half a year, I have experienced first-hand what are often claimed as their main disadvantages, i.e. overfitting and getting stuck in local minima. However, ...