Questions tagged [supervised-learning]

For questions related to supervised learning.

Filter by
Sorted by
Tagged with
7
votes
3answers
2k views

What is the relation between semi-supervised and self-supervised visual representation learning?

What's the differences between semi-supervised learning and self-supervised visual representation learning, and how they are connected?
1
vote
1answer
21 views

How to generate labels for self-supervised training?

I've been reading a lot lately about self-supervised learning and I didn't understand very well how to generate the desired label for a given image. Let's say that I have an image classification task, ...
7
votes
3answers
1k views

Do GANs come under supervised learning or unsupervised learning?

Do GANs come under supervised learning or unsupervised learning? My guess is that they come under supervised learning, as we have labeled dataset of images, but I am not sure as there might be other ...
38
votes
3answers
31k views

What is self-supervised learning in machine learning?

What is self-supervised learning in machine learning? How is it different from supervised learning?
0
votes
0answers
18 views

Finding whether an input column is missing

I am working on a problem similar to this one:(supervised, artificial data) ...
1
vote
0answers
36 views

What is a multi channel supervised classifier?

I came across a paper that describes its model architecture in the following way. Our TRIL network is a two-channel network jointly trained to predict the expert’s action given state and the system’s ...
1
vote
0answers
43 views

Advantages of training Neural Networks based on analytic success criteria

What is the reason to train a Neural Network to estimate a task's success (i.e. robotic grasp planning) using a simulator that is based on analytic grasp quality metrics? Isn't a perfectly trained NN ...
2
votes
0answers
46 views

Why is 'scatter' used instead of variance in LDA?

I've been reading about Fisher's Linear Discriminant Analysis lately, and I noticed that the objective function (particularly for two-class classification) to be maximized contains scatter terms ...
2
votes
1answer
84 views

How can supervised learning be viewed as a conditional probability of the labels given the inputs?

In the literature and textbooks, one often sees supervised learning expressed as a conditional probability, e.g., $$\rho(\vec{y}|\vec{x},\vec{\theta})$$ where $\vec{\theta}$ denotes a learned set of ...
2
votes
1answer
77 views

How is the reward in reinforcement learning different from the label in supervised learning problems?

How is the notion of immediate reward used in the reinforcement learning different from the notion of a label we find in the supervised learning problems?
5
votes
1answer
113 views

Can supervised learning be recast as reinforcement learning problem?

Let's assume that there is a sequence of pairs $(x_i, y_i), (x_{i+1}, y_{i+1}), \dots$ of observations and corresponding labels. Let's also assume that the $x$ is considered as independent variable ...
1
vote
1answer
57 views

What is the difference between distant supervision and self-supervision?

Weak supervision is supervised learning, with uncertainty in the labeling, e.g. due to automatic labeling or because non-experts labelled the data [1]. Distant supervision [2, 3] is a type of weak ...
1
vote
0answers
33 views

Does self-supervised learning require auxiliary tasks?

Self-supervised learning algorithms provide labels automatically. But, it is not clear what else is required for an algorithm to fall under the category "self-supervised": Some say, self-...
0
votes
0answers
22 views

How to train an Encoder-Decoder LSTM for sequence to sequence prediction?

I have a dataset where for each country there is a name (string) and a multivariate time series (all integers). I am trying to use an Encoder-Decoder LSTM to forecast the next time steps in the time ...
0
votes
0answers
19 views

Input with variable length Classification problem

I have a dataset with patient information with discrete labels (labels are stages of a particular disease) which needs to be predicted (Basically a classification problem). The data set looks ...
0
votes
0answers
19 views

Train a model using a multi-column text-filled excel sheet

I have an excel sheet filled with my own personal appreciations of movies I've watched, and I want to use it to train an AI model so that it can predict if I'll like a specific movie or not, based on ...
1
vote
1answer
58 views

Reinforcement learning with industrial continuous process

I am new to RL and wish to realize a RL control for an industrial process. The goal is to control the temperature and humidity in a vegetal food production chamber. States: External temperature and ...
2
votes
0answers
27 views

Is there a classification task with multiple attribute regression?

I'm trying to look for a task that predicts a discrete label first (classification), and then predicts the multiple continuous attributes of the predicted class. I found some papers about multi-output ...
1
vote
1answer
64 views

Can supervised learning be used to solve the inverted pendulum problem?

I know that reinforcement learning has been used to solve the inverted pendulum problem. Can supervised learning be used to solve the inverted pendulum problem? For example, there could be an ...
2
votes
1answer
53 views

An infinite VC dimensional space vs using hierarchical subspaces of finite but growing VC dimensions

I have the following scenario. I have a binary classification problem, whose underlying function is a step function. The probability distribution of feature vectors is a uniform over the domain. Case ...
3
votes
2answers
131 views

How can reinforcement learning be unsupervised learning if it uses deep learning?

I was watching a video in my online course where I'm learning about A.I. I am a very beginner in it. At one point in the course, the instructor says that reinforcement learning (RL) needs a deep ...
2
votes
0answers
44 views

Can a typical supervised learning problem be solved with reinforcement learning methods?

Let's say I want to teach a neural to classify images, and, for some reason, I insist on using reinforcement learning rather than supervised learning. I have a dataset of images and their matching ...
0
votes
1answer
30 views

Is radial basis function network appropriate for small datasets?

I'm a computer engineering student and I'm about to work on my master thesis. My professor gave me a small dataset with brain Computed Axial Tomography records. I would like to use deep learning to ...
1
vote
0answers
36 views

How can I approximate a function that determines the priority of objects?

I am facing the following supervised learning problem: An object is fully characterized by its position in $R^n$. There are $m$ objects. There are fully observable (i.e. their positions are always ...
1
vote
1answer
42 views

What are the pros and cons of supervised, semi-supervised and unsupervised relation extraction in NLP?

I am following the NLP course taught by Dan Jurafsky. In the video lectures Supervised Relation Extraction and Semi Supervised and Unsupervised Relation Extraction Jurafsky explains supervised, semi-...
3
votes
1answer
65 views

How can I learn a graph given nodes with features in a supervised fashion?

I have a dataset and want to be able to construct a graph from it in a supervised fashion. Let's assume I have a dataset with N nodes, each node has e.g. 10 features. Out of these N nodes, I want to ...
5
votes
2answers
282 views

Is it possible to guide a reinforcement learning algorithm?

I have just started to study reinforcement learning and, as far as I understand, existing algorithms search for the optimal solution/policy, but do not allow the possibility for the programmer to ...
1
vote
0answers
31 views

Model for supervised sequence classification task

The Problem I am currently working on a sequence classification problem I try to solve with machine learning. The target variable is the current state of a system. This target variable is following a ...
1
vote
1answer
35 views

Solving the supervised learning problem of learning $p(y \vert \mathbf{x})$ by using traditional unsupervised technologies to learn $p(\mathbf{x}, y)$

I am currently studying Deep Learning by Goodfellow, Bengio, and Courville. In chapter 5.1.2 The Performance Measure, $P$, the authors say the following: Unsupervised learning and supervised learning ...
1
vote
3answers
122 views

Recognize pattern in dataset

I'm currently working on a group project where we need to find a pattern in a given dataset. The dataset is a collection of X, Y, Z values of a gyroscope from someone who is walking. If you plot these ...
1
vote
0answers
21 views

Specific Neural Network Subtype for Automatic Web Scraping (Hyperlink Identification)

For a personal project, I'm trying to download files from a specific set of websites using a web scraper. The scraper has to navigate multiple webpages to get to the files I want to download. I'd like ...
2
votes
2answers
59 views

What does “immediate vector-valued feedback” mean?

In the book Artificial Intelligence Engines: A Tutorial Introduction to the Mathematics of Deep Learning, James Stone says With supervised learning, the response to each input vector is an output ...
6
votes
2answers
330 views

What are different approaches used in Machine Learning?

There seem to be so many sub-fields, so I'm interested in getting a better understanding of the approaches. I'm looking for information on a single framework per answer, in order to allow for ...
1
vote
0answers
38 views

How can I build a model to approximate the function $f(n) = 2n$?

I made the following HTML nd javascript to predict $f(n) = 2n$. Basically, I am trying to design my first neural network which predicts 2 multiplied by a number. I know we don't need a neural network ...
1
vote
2answers
447 views

How can I use 1-channel images as input to a CNN?

I need to develop a convolutional neural network whose inputs are 1-channel images, but I dont know how to do it, given that most libraries use 3 channel images. Should I convert my images to RGB? Is ...
4
votes
1answer
56 views

How could decision tree learning algorithms cope with imbalanced classes?

Decision trees and random forests may or not be more suited to solve supervised learning problems with imbalanced labels (or classes) in datasets. For example, see the article Using Random Forest to ...
3
votes
1answer
84 views

What needs to be done to make a fair algorithm?

What needs to be done to make a fair algorithm (supervised and unsupervised)? In this context, there is no consensus on the definition of fairness, so you can use the definition you find most ...
3
votes
2answers
326 views

What is the difference between reinforcement learning and AutoML?

My vague understanding of reinforcement learning (RL) is that it's very similar to supervised learning except that it updates on a continuous feed of data/activity, this to me sounds very similar to ...
1
vote
0answers
38 views

How can I generate keywords associated with a website given its URL?

I have a column with links to websites and another column with keywords from those websites. I have to find a map between these two, such that for a new input, which is a website's URL, I can generate ...
1
vote
1answer
76 views

Class imbalance and “all zeros” one-hot encoding?

I tried this example for a multi class classifier, but when looking at the data I realized two things: There are many examples of "all zeros" vectors, that is, messages that don't belong in any ...
2
votes
1answer
67 views

What are the most common methods to enable neural networks to adapt to changing environments?

For real applications, concept drifts often exist, i.e., the relationship between the input and output changes overtime. Thus, we need our AI or machine learning system to quickly adapt to the ...
5
votes
2answers
90 views

What should the range of the output layer be when performing classification?

I am working on a MLP neural networks, using supervised learning (2 classes and multi-class classification problems). For the hidden layers, I am using $\tanh$ (which produces an output in the range $[...
2
votes
1answer
332 views

Are the training loss and validation loss plotted per sample or per batch?

I am using a CNN to train on some data, where training size = 21700 samples, and test size is 653 samples, and say I am using a batch_size of 500 (I am accounting for samples out of batch size as well)...
3
votes
0answers
67 views

What are the differences between CRF and HMM?

What I know about CRF is that they are discriminative models, while HMM are generative models, but, in the inference method, both use the same algorithm, that is, the Viterbi algorithm, and forward ...
4
votes
2answers
89 views

How can AI be used to design UI Interfaces?

I'm very new to AI. I read somewhere that AI can be used to create GUI UI/UX design. That has fascinated me for a long time. But, since I'm very new here, I don't have any idea how it can happen. ...
2
votes
1answer
26 views

Model Performance and Size of Data Set

Suppose we have a data set with $4,000$ labeled examples. The outcome variable is trinary (three possible categorical values). Suppose the accuracy of a given model is "bad" (e.g. less than $50 \%$). ...
1
vote
1answer
379 views

Does neuroevolution require a labelled dataset?

A neuroevolution algorithm, such as DXNN, can be used to refine the topology and weights of an artificial neural network (ANN). The GA will require a fitness function, which means you need labeled ...
6
votes
1answer
305 views

Does AlphaZero use Q-Learning?

I was reading the AlphaZero paper Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm, and it seems they don't mention Q-Learning anywhere. So does AZ use Q-...
2
votes
1answer
126 views

Why are neural networks always trained “by themselves”?

In the current rush of artificial intelligence research, fueled by NN, independent of the paper I choose, the NN are always trained by themselves. Sure, there are architectures that combine CNN and ...
2
votes
4answers
120 views

How is regression machine learning?

In regression, in order to minimize an error function, a functional form of hypothesis $h$ must be decided upon, and it must be assumed (as far as I'm concerned) that $f$, the true mapping of instance ...