# Questions tagged [support-vector-machine]

For questions about support vector machines (SVMs), which are supervised learning models with associated learning algorithms that analyze data used for classification and regression analysis.

59 questions
Filter by
Sorted by
Tagged with
7 views

### SVM Kernal the correct approach for classification problem?

I am working on a classification model that I will explain below and I wanted to get some insight on the optimal approach. I am currently experimenting with SKLearn and SVM Kernel as such svm.SVC(...
• 101
21 views

### Linear SVM Hyperparameter Selection

I'm trying to train a linear SVM on the CIFAR-10 dataset and I obtained the results in the plot below for the hyper-parameter tuning (learning rate and regularization strength). It looks like the ...
14 views

### Support Vector Machine used in Image Classification

I am looking for a reference preferably a paper that details how Support Vector Machines (SVMs), and OpenCV were used to perform image classification before Convultional Neural Networks (CNNs). I am ...
• 101
1 vote
57 views

### Suitability of Gaussian RBF (radial basis function) in SVM to separate the two classes

Given the following data samples (square and triangle mean two classes), why is it suitable to use a Gaussian RBF (radial basis function) in SVM to separate the two classes?
• 816
1 vote
19 views

### Why is the Hinge Loss defined this way?

I have a question regarding the Hinge Loss function used for classifiers and in general the "max-margin" types of classifiers, it is defined as $$max(0,1-t*y)$$ where $t$ is the intended ...
17 views

### Why are projected variables in canonical correlation analysis uncorrelated?

Let $x\in R^d$ and $y\in R^e$ be two vectors with covariance and cross-covariance matrices $S_{xx}, S_{yy}, S_{xy}, S_{yx}$. The canonical correlation analysis is based on the projection of $x$ onto ...
• 816
26 views

### Can we derive the support vector machines dual formulation without directly using lagrangian duality theory?

Lagrangian duality theory allows us to derive the dual formulation for support vector machines and to show that the primal and the dual solutions are equivalent. My question is: is it possible to ...
19 views

### Meaning of Objective and Risk in DLIB HOG-SVM detector

I am using dlib simple object detector for training a HOG-SVM object detector. Everything is working fine when I test manually. However, I can't find any resources that tell me what is the meaning of ...
17 views

### My text classifier behaves like regex

I'm trying to train binary classifier that classifies ask to ask programming questions, programming questions that say "I'm getting an error about x/I have problem about x" but don't say the ...
207 views

### Machine learning for arranging 2D points

I have a problem wherein I have 2D points in an image that would be associated with a corresponding label/sequence number. For instance following are 4 such examples: As you can see all of them have ...
396 views

### Do Support Vector Machines have the ability to learn while in use?

I've read in some literature,that SVMs are characterized by their adaptivity. Does that mean they can learn while in use?
157 views

### What to say about time complexity of SVM?

I've read it in some literature now that the training speed of SVM (in general) is very low. Why is that the case? What is to say about time complexity of SVM?
94 views

### How to use PCA to reduce the dimension of output features of convolutional layers of CNN

I am working on a hybrid CNN-SVM classification using python. I tried to get the final output features of the CNN model(flatten layer) to be fed to the SVM classifier. The output shape obtained from ...
• 11
1 vote
235 views

### Why are SVMs / Softmax classifiers considered linear while neural networks are non-linear?

My understanding is that neural networks are definitely not linear classifiers, as the point of functions like ReLU is to introduce non-linearity. However, here's where my understanding starts to ...
• 153
1 vote
72 views

### Why does the SVM perform poorly on test data that has a different class distribution than the training data?

Do you know why the SVM performs poorly on test data that has a different class distribution than the training data? The training data has around 15 classes, and the additional testing data has around ...
• 11
56 views

### Distinguishing text with opposite meanings in SVM (False Information Detection)

I am currently working on a Binary Text Classification Model (False Information Detection) using Support Vector Machine and used TF-IDF as text vectorizer in Python. I have already tried training the ...
67 views

### Does $(\langle w, x \rangle + b) = ||x - x'||$ hold?

Currently, I am trying to understand the mathematics of SVM's using the textbook 'Mathematics for Machine Learning' by Deisenrot et. al. On page 375, they define the distance between a point $x$ and ...
134 views

### Do I need to tune the hyper-parameters or more data if SVR model performs poorly?

I am using non-linear data to SVR and have tried tuning the hyperparameters and still have a poor model performance. Do I need more data or format the data for more suitable results? I get similar ...
80 views

### How can I weight each point in one-class SVM?

I want to give weights to some data points Specifically, these are points related to anomalies (I'm implementing one-class SVM for anomaly detection) Exactly, I want to consider some data points that ...
1 vote
26 views

### Can you correlate decision boundary of final layer of a neural network to predictive distribution?

I was reading in a On the Decision Boundary of Deep Neural Networks that the final layer of a MLP can be equated to an SVM and can generate decision boundaries similar to methods with SVM. I was ...
• 795
6k views

### What is the definition of the hinge loss function?

I came across the hinge loss function for training a neural network model, but I did not know the analytical form for the same. I can write the mean squared error loss function (which is more often ...
• 3,880
1 vote
551 views

### What is the smoothness assumption in SVMs?

In this research paper, we have the following claim the smoothness assumption that underlies many kernel methods such as Support Vector Machines (SVMs) does not hold for deep neural networks trained ...
• 159
90 views

### Why is the margin attained with $\Phi=\left[2 x, 2 x^{2}\right]^{T}$ greater than the margin attained with $\Phi=\left[x, x^{2}\right]^{T}$?

I am trying to understand the solution to part 4 of problem 3 from the midterm exam 6.867 Machine learning: Mid-term exam (October 15, 2003). For reproducibility, here is problem 3. We consider here ...
1 vote
486 views

### If the training data are linearly separable, which of the following $L(w)$ has less optimum answer for $w$, when $y = w^Tx$?

I'm studying machine learning and I came into a challenging question. The answer is 2. But based on my ML notes, all of them are true. Where are the wrong points?
• 19
242 views

### What are support values in a support vector machine?

I started reading up on SVM and very little is defined of what are support values. I reckon it's they are denoted as $\alpha$ in most formulations.
• 133
61 views

### How does the support vector machine constraint imply that sample selection bias will not systematically affect the output of the optimisation?

I am currently studying the paper Learning and Evaluating Classifiers under Sample Selection Bias by Bianca Zadrozny. In section 3.4. Support vector machines, the author says the following: 3.4. ...
• 569
1 vote
66 views

### Does the image is logistic regression or SVM, and why? [closed]

Does the image is logistic regression or SVM, and why?
• 121
895 views

### How should we interpret this figure that relates the perceptron criterion and the hinge loss?

I am currently studying the textbook Neural Networks and Deep Learning by Charu C. Aggarwal. Chapter 1.2.1.2 Relationship with Support Vector Machines says the following: The perceptron criterion is ...
• 569
130 views

### Why doesn't the set $\{ -2, +2 \}$ in $E(X) = (y − \text{sign}\{\overline{W} \cdot \overline{X} \}) \in \{ −2, +2 \}$ include $0$?

I am currently studying the textbook Neural Networks and Deep Learning by Charu C. Aggarwal. Chapter 1.2.1.2 Relationship with Support Vector Machines says the following: The perceptron criterion is ...
• 569
184 views

### Support Vector Machine Convert optimisation problem from argmax to argmin

I'm new to the AI Stackexchange and wasn't certain if this should go here or to Maths instead but thought the context with ML may be useful to understand my problem. I hope posting this question here ...
• 21
1 vote
166 views

### Why does the training time of SVMs dramatically decrease after applying dimensionality reduction to the features?

Training an SVM with an RBF kernel model with c = 5.5 and gamma = 1.06, for a 5-class classification problem on the NSL-KDD ...
1 vote
175 views

1 vote
46 views

### Why is my SVM not reaching good accuracy when trained to perform binary classification of search results?

I am trying to perform binary classification of search results based on the relevance to the query. I followed this tutorial on how to make an SVM, and I got it to work with a small iris dataset. Now, ...
• 116
1 vote
293 views

### How do you perform a gradient based adversarial attack on an SVM based model?

I have an SVM currently and want to perform a gradient based attack on it similar to FGSM discussed in Explaining And Harnessing Adversarial Examples. I am struggling to actually calculate the ...
1 vote
74 views

### What are the variables used in a Gaussian radial basis kernel in the context of SVMs?

If I have the Gaussian kernel $$k(x, x') = \operatorname{exp}\left( -\| x - x' \|^2 / 2\sigma^2 \right)$$ What is $x$ and $x'$ in the context of training an SVM?
161 views

### How do I poison an SVM with manifold regularization?

I'm working on Adversarial Machine Learning, and have read multiple papers on this topic, some of them are mentioned as follows: Poisoning Attacks on SVMs: https://arxiv.org/pdf/1206.6389.pdf ...
• 135
158 views

### Does the bag-of-visual-words method improve the classification accuracy?

I'm a beginner in computer vision. I want to know which option among the following two can get better accuracy of image classification. SIFT features + SVM Bag-of-visual-words features + SVM Here's ...
• 21
1 vote
58 views

### Scoring feature vector with Support Vector Machine

I am reading the R-CNN paper by Ross Girshick1 et al. (link) and I fail to understand how they do the inference. This is described in the section 2.2.Test-time Detection in the paper. I quote: At ...
• 1,138
1 vote
79 views

### Is it possible to combine multiple SVMs that were trained on sublayers of a CNN into one combined SVM?

I have created a CNN for use on the MNIST dataset for now (so I have 10 classes). I have trained SVMs on the sublayers of this trained CNN and wish to combine them into a combined SVM as to give a ...
1 vote
49 views

### A generalized quadratic loss and Newton iteration for Support Vector Regression, why doesn't it generalize well?

I'm comparing the results of an Newton optimizer for a modified version of SVM ( a generalized quadratic loss, similar to the one stated in: A generalized quadratic loss for SVM ) with classic SVM^...
1k views

### How do I combine models trained on different data to increase classification accuracy?

I have two trained models. One is using a LinearSVC algorithm and is trained on numerical data from medical examination from patients with diabetic retinopathy. The second one is a neural network ...
1k views

### How to implement SVM algorithm from scratch in a programming language?

I'm a computer scientist who's studying support vector machines (SVMs) in a machine learning course. I have some understanding of how SVMs are designed, thanks to 16. Learning: Support Vector Machines ...
• 141
1 vote