Questions tagged [supervised-learning]

For questions related to supervised learning.

Filter by
Sorted by
Tagged with
55
votes
3answers
50k views

What is self-supervised learning in machine learning?

What is self-supervised learning in machine learning? How is it different from supervised learning?
9
votes
3answers
2k views

Do GANs come under supervised learning or unsupervised learning?

Do GANs come under supervised learning or unsupervised learning? My guess is that they come under supervised learning, as we have labeled dataset of images, but I am not sure as there might be other ...
8
votes
3answers
4k views

What is the relation between semi-supervised and self-supervised visual representation learning?

What's the differences between semi-supervised learning and self-supervised visual representation learning, and how they are connected?
8
votes
1answer
400 views

What are the different approaches used in Machine Learning?

There seem to be so many sub-fields, so I'm interested in getting a better understanding of the approaches. I'm looking for information on a single framework per answer, in order to allow for ...
7
votes
1answer
500 views

Does AlphaZero use Q-Learning?

I was reading the AlphaZero paper Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm, and it seems they don't mention Q-Learning anywhere. So does AZ use Q-...
5
votes
1answer
171 views

Can supervised learning be recast as reinforcement learning problem?

Let's assume that there is a sequence of pairs $(x_i, y_i), (x_{i+1}, y_{i+1}), \dots$ of observations and corresponding labels. Let's also assume that the $x$ is considered as independent variable ...
5
votes
2answers
289 views

Is it possible to guide a reinforcement learning algorithm?

I have just started to study reinforcement learning and, as far as I understand, existing algorithms search for the optimal solution/policy, but do not allow the possibility for the programmer to ...
5
votes
1answer
1k views

What is the difference between imitation learning and classification done by experts?

In short, imitation learning means learning from the experts. Suppose I have a dataset with labels based on the actions of experts. I use a simple binary classifier algorithm to assess whether it is ...
5
votes
1answer
922 views

Variational Autoencoder task for better feature extraction

I have a CNN with the regression task of a single scalar. I was wondering if an additional task of reconstructing the image (used for learning visual concepts), seen in a DeepMind presentation with ...
5
votes
2answers
100 views

What should the range of the output layer be when performing classification?

I am working on a MLP neural networks, using supervised learning (2 classes and multi-class classification problems). For the hidden layers, I am using $\tanh$ (which produces an output in the range $[...
4
votes
1answer
61 views

How could decision tree learning algorithms cope with imbalanced classes?

Decision trees and random forests may or not be more suited to solve supervised learning problems with imbalanced labels (or classes) in datasets. For example, see the article Using Random Forest to ...
4
votes
2answers
231 views

What is the meaning of “exploration” in reinforcement and supervised learning?

While exploration is an integral part of reinforcement learning (RL), it does not pertain to supervised learning (SL) since the latter is already provided with the data set from the start. That said, ...
4
votes
2answers
113 views

How can AI be used to design UI Interfaces?

I'm very new to AI. I read somewhere that AI can be used to create GUI UI/UX design. That has fascinated me for a long time. But, since I'm very new here, I don't have any idea how it can happen. ...
3
votes
2answers
166 views

How can reinforcement learning be unsupervised learning if it uses deep learning?

I was watching a video in my online course where I'm learning about A.I. I am a very beginner in it. At one point in the course, the instructor says that reinforcement learning (RL) needs a deep ...
3
votes
2answers
583 views

What is the difference between reinforcement learning and AutoML?

My vague understanding of reinforcement learning (RL) is that it's very similar to supervised learning except that it updates on a continuous feed of data/activity, this to me sounds very similar to ...
3
votes
1answer
137 views

Why are neural networks always trained “by themselves”?

In the current rush of artificial intelligence research, fueled by NN, independent of the paper I choose, the NN are always trained by themselves. Sure, there are architectures that combine CNN and ...
3
votes
1answer
140 views

How is the reward in reinforcement learning different from the label in supervised learning problems?

How is the notion of immediate reward used in the reinforcement learning different from the notion of a label we find in the supervised learning problems?
3
votes
1answer
171 views

How Does AlphaGo Zero Implement Reinforcement Learning?

AlphaGo Zero (https://deepmind.com/blog/alphago-zero-learning-scratch/) has several key components that contribute to it's success: A Monte Carlo Tree Search Algorithm that allows it to better search ...
3
votes
1answer
71 views

How can I learn a graph given nodes with features in a supervised fashion?

I have a dataset and want to be able to construct a graph from it in a supervised fashion. Let's assume I have a dataset with N nodes, each node has e.g. 10 features. Out of these N nodes, I want to ...
3
votes
1answer
104 views

What needs to be done to make a fair algorithm?

What needs to be done to make a fair algorithm (supervised and unsupervised)? In this context, there is no consensus on the definition of fairness, so you can use the definition you find most ...
3
votes
1answer
826 views

Are the training loss and validation loss plotted per sample or per batch?

I am using a CNN to train on some data, where training size = 21700 samples, and test size is 653 samples, and say I am using a batch_size of 500 (I am accounting for samples out of batch size as well)...
3
votes
1answer
72 views

Can we use ML to do anything else other than predicting (in the case of mathematical problems)?

(The math problem here just serves as an example, my question is on this type of problems in general). Given two Schur polynomials, $s_\mu$, $s_\nu$, we know that we can decompose their product into a ...
3
votes
0answers
120 views

What are the differences between CRF and HMM?

What I know about CRF is that they are discriminative models, while HMM are generative models, but, in the inference method, both use the same algorithm, that is, the Viterbi algorithm, and forward ...
3
votes
0answers
22 views

Backpropagation: how to take into account different samples quality

I have a NN I'd like to train using supervised learning. Some samples of the training set, however, have better "quality" than others, so I'd like the algorithm to pay "special attention" to them. As ...
3
votes
2answers
994 views

Can a machine learning model predict the pattern of given sequence?

I am curious if it is possible to do so. For example, if I supply $[0, 1, 2, 3, 4, 5]$, the model should return "natural number sequence", $[1,3,5,7,9,11]$, it should return "natural ...
2
votes
4answers
132 views

How is regression machine learning?

In regression, in order to minimize an error function, a functional form of hypothesis $h$ must be decided upon, and it must be assumed (as far as I'm concerned) that $f$, the true mapping of instance ...
2
votes
1answer
87 views

How can we teach a neural net to make arbitrary data associations?

Let's say I have pairs of keys and values of the form $(x_1, y_1), \dots, (x_N, y_N)$. Then I give a neural net a key and a value, $(x_i, y_i)$. For example, $x_i$ could be $4$ and $y_i$ could be $3$, ...
2
votes
1answer
143 views

How can supervised learning be viewed as a conditional probability of the labels given the inputs?

In the literature and textbooks, one often sees supervised learning expressed as a conditional probability, e.g., $$\rho(\vec{y}|\vec{x},\vec{\theta})$$ where $\vec{\theta}$ denotes a learned set of ...
2
votes
2answers
64 views

What does “immediate vector-valued feedback” mean?

In the book Artificial Intelligence Engines: A Tutorial Introduction to the Mathematics of Deep Learning, James Stone says With supervised learning, the response to each input vector is an output ...
2
votes
1answer
92 views

Can supervised learning be used to solve the inverted pendulum problem?

I know that reinforcement learning has been used to solve the inverted pendulum problem. Can supervised learning be used to solve the inverted pendulum problem? For example, there could be an ...
2
votes
1answer
75 views

What are the most common methods to enable neural networks to adapt to changing environments?

For real applications, concept drifts often exist, i.e., the relationship between the input and output changes overtime. Thus, we need our AI or machine learning system to quickly adapt to the ...
2
votes
1answer
31 views

If the accuracy of my current model is low ($50 \%$) and we want to minimize time in collecting more data, should we try other models?

Suppose we have a data set with $4,000$ labeled examples. The outcome variable is trinary (three possible categorical values). Suppose the accuracy of a given model is "bad" (e.g. less than $50 \%$). ...
2
votes
0answers
24 views

Literature on the advantages of using an auto-encoder for classification

Given a supervised problem with X, y input pairs, one can do two things for obtaining the function f that maps X with y with Neural Networks (and in general in machine learning): Deploy directly a ...
2
votes
0answers
51 views

Why is 'scatter' used instead of variance in LDA?

I've been reading about Fisher's Linear Discriminant Analysis lately, and I noticed that the objective function (particularly for two-class classification) to be maximized contains scatter terms ...
2
votes
0answers
29 views

Is there a classification task with multiple attribute regression?

I'm trying to look for a task that predicts a discrete label first (classification), and then predicts the multiple continuous attributes of the predicted class. I found some papers about multi-output ...
2
votes
0answers
48 views

Can a typical supervised learning problem be solved with reinforcement learning methods?

Let's say I want to teach a neural to classify images, and, for some reason, I insist on using reinforcement learning rather than supervised learning. I have a dataset of images and their matching ...
2
votes
1answer
85 views

An infinite VC dimensional space vs using hierarchical subspaces of finite but growing VC dimensions

I have the following scenario. I have a binary classification problem, whose underlying function is a step function. The probability distribution of feature vectors is a uniform over the domain. Case ...
2
votes
0answers
149 views

When to use which metric in machine learning?

In machine learning, there are several metrics to assess the quality of the models: accuracy, precision, recall, f measure, ROC (AUC), etc. There are cases when certain metrics are more appropriate ...
1
vote
2answers
1k views

What is “planning” in the context of reinforcement learning, and how is it different from RL and SL?

This is an excerpt taken from Sutton and Barto (pg. 3): Another key feature of reinforcement learning is that it explicitly considers the whole problem of a goal-directed agent interacting with an ...
1
vote
1answer
52 views

Solving the supervised learning problem of learning $p(y \vert \mathbf{x})$ by using traditional unsupervised technologies to learn $p(\mathbf{x}, y)$

I am currently studying Deep Learning by Goodfellow, Bengio, and Courville. In chapter 5.1.2 The Performance Measure, $P$, the authors say the following: Unsupervised learning and supervised learning ...
1
vote
2answers
735 views

How can I use 1-channel images as input to a CNN?

I need to develop a convolutional neural network whose inputs are 1-channel images, but I dont know how to do it, given that most libraries use 3 channel images. Should I convert my images to RGB? Is ...
1
vote
1answer
394 views

Does neuroevolution require a labelled dataset?

A neuroevolution algorithm, such as DXNN, can be used to refine the topology and weights of an artificial neural network (ANN). The GA will require a fitness function, which means you need labeled ...
1
vote
1answer
299 views

How to generate labels for self-supervised training?

I've been reading a lot lately about self-supervised learning and I didn't understand very well how to generate the desired label for a given image. Let's say that I have an image classification task, ...
1
vote
1answer
114 views

What is the difference between distant supervision and self-supervision?

Weak supervision is supervised learning, with uncertainty in the labeling, e.g. due to automatic labeling or because non-experts labelled the data [1]. Distant supervision [2, 3] is a type of weak ...
1
vote
3answers
180 views

Recognize pattern in dataset

I'm currently working on a group project where we need to find a pattern in a given dataset. The dataset is a collection of X, Y, Z values of a gyroscope from someone who is walking. If you plot these ...
1
vote
1answer
684 views

Why isn't the reverse KL divergence commonly used in supervised learning?

Forward KL Divergence (also known as cross entropy loss) is a standard loss function in supervised learning problems. I understand why it is so: matching a known a trained distribution to a known ...
1
vote
0answers
19 views

Is there any known approach to generate sets of objects?

I am looking for some known approach, or some previous work, on the following problem: Let $\Sigma$ be an alphabet of symbols and $\Sigma^*$ be the set of all the strings that you can compose from ...
1
vote
1answer
40 views

Aside from specific training sets, what distinguishes the capabilities of different AI implementations?

(Disclaimer: I don't know much about ML/AI, besides some basic ideas behind it all.) It seems like ML/AI models can often be boiled down to statistics, where certain levers (weights) get fine-tuned ...
1
vote
0answers
14 views

Multiple Inertia sensors system based for gestures recognition

I am a newbie to Machine Learning field as I am engaging to a personal project that I am trying to use the 6 degree of freedom Inertial Measurement Units(IMUs) measuring the Acceleration acting on 3 ...
1
vote
0answers
40 views

What is a multi channel supervised classifier?

I came across a paper that describes its model architecture in the following way. Our TRIL network is a two-channel network jointly trained to predict the expert’s action given state and the system’s ...