Questions tagged [unsupervised-learning]

For questions about AI that learns without being provided with a set of labels (expected answers) along with the set of input examples.

Filter by
Sorted by
Tagged with
2
votes
1answer
28 views

Is this dataset with only two features suitable for clustering with k-means?

I am working with the K-means clustering algorithm for unsupervised learning. Is the following dataset suitable for the k-means clustering task or not? Why or why not? The dataset has only two ...
0
votes
0answers
11 views

How would one modify CycleGAN in order to map a distribution to itself?

CycleGAN can map between two different distributions $X$ and $Y$ with cycle consistency. This is done with generator functions $F: X \mapsto Y$ and $G: Y \mapsto X$, such that $||G(F(x)) - x||_1 \...
2
votes
1answer
27 views

When labelled data is not available, what are some common unsupervised learning algorithms for pattern recognition that can be used?

In pattern recognition systems, when no labeled data is available, what are some common unsupervised learning algorithms for pattern recognition, that can be used?
3
votes
2answers
104 views

How can reinforcement learning be unsupervised learning if it uses deep learning?

I was watching a video in my online course where I'm learning about A.I. I am a very beginner in it. At one point in the course, the instructor says that reinforcement learning (RL) needs a deep ...
1
vote
1answer
22 views

Applying Eligibility Traces to Q-Learning algorithm does not improve results (And might not function well)

I am trying to apply Eligibility Traces to a currently working Q-Learning algorithm. The reference code for the Q-Learning algorithm was taken from this great blog ...
1
vote
0answers
26 views

How do I approach this problem?

Let's say I have a dataset with multiple types of multiple ingredients (salt1,salt2, etc). Each n-th variation of each ingredient vs flavor may be represented by an n×k matrix that where an ingredient ...
0
votes
0answers
48 views

How can I group the entries of the network traffic by their similarity?

I have the traffic of my network (with hundreds of entries). Below I am showing only 9 entries. ...
2
votes
1answer
30 views

Is there a notion of generalization in unsupervised learning?

I've been learning a little bit about generalization theory, and in particular, the PAC (and PAC-Bayes) approach to thinking about this problem. So, I started to wonder if there is an analogous ...
2
votes
2answers
45 views

Could clustering be used to parse pdf documents to get headings and titles?

I'm a bit new to AI and I'd like to use some kind of clustering algorithm to solve a problem: I'm trying to parse pdf documents to get headings and titles. I can parse pdf to html and I'm then able ...
3
votes
6answers
64 views

How can I cluster this data frame with several features and observations?

How can I cluster the data frame below with several features and observations? And how would I go about determining the quality of those clusters? Is k-NN appropriate for this? ...
1
vote
1answer
32 views

What are the pros and cons of supervised, semi-supervised and unsupervised relation extraction in NLP?

I am following the NLP course taught by Dan Jurafsky. In the video lectures Supervised Relation Extraction and Semi Supervised and Unsupervised Relation Extraction Jurafsky explains supervised, semi-...
1
vote
1answer
33 views

How can I use autoencoders to analyze patterns and classify them?

I generated a bunch of simulation data from a complex physical simulation that spits out patterns. I am trying to apply unsupervised learning to analyze the patterns and ideally classify them into ...
1
vote
1answer
31 views

Solving the supervised learning problem of learning $p(y \vert \mathbf{x})$ by using traditional unsupervised technologies to learn $p(\mathbf{x}, y)$

I am currently studying Deep Learning by Goodfellow, Bengio, and Courville. In chapter 5.1.2 The Performance Measure, $P$, the authors say the following: Unsupervised learning and supervised ...
1
vote
0answers
29 views

Training an unsupervised convolutional neural network to learn a general representation of a Lua module

I am trying to train a CNN in keras to learn a general representation of a Lua module, e.g. requires at the beginning, local variables, local functions, interface (returns) and in between some ...
1
vote
0answers
41 views

How is clustering used in the unsupervised training of a neural network?

How is clustering used in the unsupervised training of a neural network? Can you provide an example?
3
votes
1answer
59 views

In unsupervised learning, what is meant by “finding the probability of an image”?

The specific problem I'm having is with a Fully Visible Belief Network. It is an explicit density model (though I don't know what quantifies something being such) that uses the chain rule to decompose ...
2
votes
1answer
28 views

Unsupervised learning to optimize a function of the input

I am looking to build a neural network that takes an input vector $\mathbf{X}$ and outputs a vector $\mathbf{Y}$ such at $f(\mathbf{X}, \mathbf{Y})$ is minimized, where $f$ is some function. The ...
3
votes
1answer
115 views

Is there any Python library available for manifold learning using diffusion map? [closed]

I would like to use unsupervised learning with a technique called diffusion map based manifold learning in Python. The original paper on the diffusion map is An Introduction to Diffusion Maps. I have ...
3
votes
1answer
80 views

What needs to be done to make a fair algorithm?

What needs to be done to make a fair algorithm (supervised and unsupervised)? In this context, there is no consensus on the definition of fairness, so you can use the definition you find most ...
4
votes
1answer
42 views

Are there methods that allow deep networks to learn object categorization in a self-supervised way?

When training a deep network to learn object classification from a set like ImageNet, we minimize the cross entropy between the ground truth and the predicted categories. This is done in a supervised ...
4
votes
1answer
60 views

How does the network know which objects to track in the paper “Label-Free Supervision of Neural Networks with Physics and Domain Knowledge”?

I was reading the paper Label-Free Supervision of Neural Networks with Physics and Domain Knowledge, published at AAAI 2017, which won the best paper award. I understand the math and it makes sense. ...
3
votes
1answer
34 views

Do the eigenvectors represent the original features?

I've got a test dataset with 4 features and the PCA produces a set of 4 eigenvectors, e.g., ...
1
vote
0answers
92 views

Which approaches are best suited for text deblurring?

I want to deblur text images using deep learning. Which approaches are best suited for the task? Any example networks? Is unsupervised network the best approach? GAN or cycle GAN for these purposes? ...
2
votes
2answers
100 views

Is unsupervised learning a branch of AI?

From Artificial Intelligence: A Modern Approach, a book by Stuart Russell and Peter Norvig, this is the definition of AI: We define AI as the study of agents that receive percepts from the ...
0
votes
2answers
39 views

How can I cluster based on the complementary categories?

K-means tries to find centroid and then clusters around the centroids. But what if we want to cluster based on the complement? For example, suppose we have a group of animals and we want to cluster ...
3
votes
1answer
62 views

Is unsupervised disentanglement really impossible?

In Locatello et al's Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations he claims to prove unsupervised disentanglement is impossible. His entire claim is ...
1
vote
1answer
91 views

What is the role of the 'fuzzifier' w in Fuzzy Clustering?

According to my lecture, Fuzzy c-Means tries to minimize the following objective function: $$J(X,B,U)=\sum_{i=1}^c\sum_{j=1}^n u_{ij}^w \, d^2(\vec{\beta_i},\vec{x_j})$$ where $X$ are the data ...
2
votes
1answer
41 views

Is a multi-layer Kohonen network possible?

The Kohonen network is one fully connected layer, which clusters the input into classes by a given metric. However, the one layer does not allow to operate with complex relations, that's why deep ...
1
vote
0answers
13 views

Predicting Hot Categories In a Reference Manager

Reference managers like Zotero or Mendeley allow researchers to categorize papers into hierarchical categories called collections. The User navigates through a listing of these collections when filing ...
1
vote
0answers
213 views

Dense bottleneck layer in Autoencoder

I would like to use the bottleneck layer of U-Net (last layer of the encoder) to calculate the similarity between two images. For that I have to somehow flatten the last layer of the encoder. In my ...
1
vote
0answers
20 views

Prediction of values with an unsupervised model

Given a set of historical data points, I am trying to predict a continuous output of which I have no historical record of, therefore the problem is of an unsupervised nature. I am wondering if there ...
2
votes
1answer
69 views

Reconstruction Errors in Auto Encoders after Training

Autoencoders are used for unsupervised anomaly detection by at first learning the features of the data set with mainly "normal" data points. Then new data can be considered anomalous, if the new data ...
4
votes
2answers
162 views

Is there a machine learning algorithm to find similar sales patterns?

I have a dataset as follows (and the table extends to include an extra 146 columns for companies 4-149) Is there an algorithm I could use effectively to find similar patterns in sales from the other ...
3
votes
1answer
54 views

Which unsupervised learning algorithm can be used for peaks detection?

So, I have a dataset which has around 1388 unique products and I have to do unsupervised learning on them in order to find anomalies (high/low peaks). The data below just represents one product. The <...
3
votes
0answers
33 views

References and books for unsupervised learning

I am looking for good introductory and advanced books in AI, especially unsupervised learning. I have already read books like Probabilistic Graphical Models from D. Kholler and Pattern Recognition and ...
1
vote
1answer
49 views

Is there an LSTM-based unsupervised learning algorithm to label a dataset of curves?

I have a big amount of light curves (image below). I am trying to label the points as signal or background (the signal appears usually periodically, several times, for a given light curve). More ...
5
votes
1answer
539 views

Variational Autoencoder task for better feature extraction

I have a CNN with the regression task of a single scalar. I was wondering if an additional task of reconstructing the image (used for learning visual concepts), seen in a DeepMind presentation with ...
1
vote
0answers
15 views

Is there a way to compare the similarities among different graphs and then cluster them using Unsupervised learning?

I have a dataset about (240000,23). For my task, I have to use an unsupervised learning method and apply it on every single column separately in order to detect anomalies that might exist. I have pre-...
5
votes
1answer
117 views

Unsupervised Learning for anomaly detection

I've started working on anomaly detection in Python. My dataset is a time series one. The data is being collected by some sensors which record and collect data on semiconductor making machines. My ...
3
votes
1answer
87 views

What is graph clustering?

There are several (family of) algorithms that can be used to cluster a set of $d$-dimensional points: for example, k-means, k-medoids, hierarchical clustering (agglomerative or divisive). What is ...
2
votes
2answers
70 views

Which unsupervised anomaly detection algorithms are there?

I need to create model which will find suspicious entries or anomalies in a network, whose characteristics or features are the asset_id, ...
1
vote
2answers
253 views

Where can I find an implementation of the wake-sleep algorithm?

I'm looking to build from scratch an implementation of the wake-sleep algorithm, for unsupervised learning with neural networks. I plan on doing this in Python in order to better understand how it ...
1
vote
0answers
30 views

identifying pattern in datasets

i am new to machine learning. i'm trying to identify driving pattern through accelerometer and gyroscope sensor. i have been collecting the data of both the sensors and have been storing them in .csv ...
4
votes
3answers
764 views

How to implement a Continuous Control of a quadruped robot with Deep Reinforcement Learning in Pybullet and OpenAI Gym?

Description I have designed this robot in URDF format and its environment in pybullet. Each leg has a minimum and maximum value of movement. What reinforcement algorithm will be best to create a ...
2
votes
1answer
104 views

Why isn't the Credit Card Fraud Detection dataset from Kaggle already balanced?

I am working on a credit card fraud detection problem using autoencoders. I have a question regarding the dataset I'll be using. I've downloaded the dataset for the above problem from Kaggle, which ...
1
vote
0answers
29 views

a question about Zeiler's paper “Deconvolutional Networks”

In "4.1 Learning multi-layer deconvolutional filters" section, the last paragraph says that "Since our model is generative, we can sample from it. In Fig. 3 we show ...
1
vote
1answer
35 views

Steps for final Logistic Regression Modal

I am new for machine learning and I am tried to understand basic steps to get final modal of Logistic Regression. I know Logistic Regression is supervisory learning technique. Therefore we want to ...
0
votes
1answer
70 views

Using unsupervised learning for classification problems

Let's say there are two types of cancer(Type 1 and Type 2). Say we want to see if one of pour friends has cancer Type 1 or 2. We can treat this as a classification problem. But what if we use ...
7
votes
2answers
1k views

Do GANs come under supervised learning or unsupervised learning?

Do GANs come under supervised learning or unsupervised learning? My guess is that they come under supervised learning, as we have labeled dataset of images, but I am not sure as there might be other ...
1
vote
1answer
38 views

What is the approach to deduce formal rules based on data?

We have data in text format as sentences. The goal is to detect rules which exist in this set of sentences. I have a limited set of contextless sentences that fit a pattern and want to find the ...