People who code: we want your input. Take the Survey

Questions tagged [unsupervised-learning]

For questions about AI that learns without being provided with a set of labels (expected answers) along with the set of input examples.

Filter by
Sorted by
Tagged with
1
vote
0answers
27 views

How to learn transition type in a 1-hour extended DJ Mix?

How would you design a model which learns the transitions in a given 1-hour DJ Mix? To be specific, the model should be able to learn transitions, specify the occurring time and the type (Crossfade, ...
1
vote
0answers
14 views

What is the best clustering method to detect anomalies for data with mostly categorical data?

I have a dataset with about 85 columns. Out of the 85 columns, 70+ are categorical. My goal is to identify the outliers in this dataset through clustering methods as I do not have a target column. ...
1
vote
0answers
14 views

Can unsupervised models learn something from cat vocalizations?

I love cats, and over the years have noticed that they have recurrent patterns of vocalizations. For example, upon seeing a bird, a cat may start chittering, but the same cat would never chitter at ...
2
votes
0answers
37 views

Does Yann LeCun consider k-means self-supervised learning?

I was discussing the topic of self-supervised learning with a colleague. After a while we realized we were using different definitions. That's never helpful. Both of us were introduced to self-...
2
votes
1answer
46 views

Is there a clustering algorithm that can make n clusters and the n+1 “others” cluster?

As far as I know all clustering algorithms assume that all delivered data points have to find its cluster. My question is, is there an algorithm that could focus only on n clusters (number stated by ...
4
votes
1answer
67 views

What is the relation between self-taught learning and transfer learning?

I am new to transfer learning and I start by reading A Survey on Transfer Learning, and it stated the following: according to different situations of labeled and unlabeled data in the source domain, ...
0
votes
0answers
41 views

How to use Product Matching to create Product Bundles

I am working on a product matching model. GOAL A store has many products like creams, perfumes, other beauty products. Based on product properties I have to create bundles of it so we can sell more ...
0
votes
0answers
8 views

Why does self-supervised representation learning (such as SimpleSiam) use a ResNet encoder that is trained in a supervised fashion?

Can anybody explain to me why does self-supervised representation learning on images using Siamese neural networks (such as SimpleSiam (https://arxiv.org/abs/2011.10566), SimCLR, Boyl) use a ResNet ...
1
vote
1answer
484 views

Is there a bias-variance equivalent in unsupervised learning?

In supervised learning, bias, variance are pretty easy to calculate with labeled data. I was wondering if there's something equivalent in unsupervised learning, or like a way to estimate such things? ...
0
votes
0answers
10 views

Is there any method that combines temporal action proposals with multiple actions' classifiers?

I am trying to classify actions in untrimmed videos. These videos contain a very imbalanced set of actions (where the background class is the majority). I have previously tried frame-wise action ...
0
votes
0answers
30 views

Interpreting a self organizing map resulting from the same dataset with different standard deviations

I am working on a task where the goal is to make a sofm learn a mapping from a three-dimensional space (the input space) to a two-dimensional space (the sofm "grid"). The data points are ...
0
votes
1answer
27 views

Which algorithm can be used for extracting text patterns in tabular data?

I am working with tabular data that is similar to the below: Name Phone Number ISO3 Country Amount Email ... ... Outcome Possible Reason Leona Sunfurry (555)-555-5555 United States 58.96 leo_sun@...
3
votes
2answers
39 views

Accuracy metric for Clustering

I have a model that outputs a latent N-dimensional embedding for all data points, trained in a way that clusters data-points from the same class together, while being separated from other clusters ...
1
vote
1answer
48 views

Aside from specific training sets, what distinguishes the capabilities of different AI implementations?

(Disclaimer: I don't know much about ML/AI, besides some basic ideas behind it all.) It seems like ML/AI models can often be boiled down to statistics, where certain levers (weights) get fine-tuned ...
0
votes
0answers
36 views

Which models can I use for supervised learning with images?

I have to do a project that detects fabric surface errors and I will use machine learning methods to deal with it. I have a dataset that includes around six thousand fabric surface images with the ...
1
vote
1answer
46 views

How does dimensionality reduction occur in Self organizing Map (SOM)?

We have n dimension input for SOM and the output 2-D clusters. How does it happen?
5
votes
1answer
351 views

What is the “Hello World” problem of Unsupervised Learning?

As a followup to this question, I'm interested in what the typical "Hello World" problem (first easy example problem) is for unsupervised learning. A quick Google search didn't find any ...
0
votes
0answers
13 views

Finding Cycles in a State Sequence

Suppose I observe a set of states $\mathbf{X} = \{X_{1}, X_{2}, \ldots, X_{K}\}$ over time. I assume that there exist $M$ cycles $\mathbf{C} = \{C_{1}, C_{2}, \ldots, C_{M} \}$ in the observed state ...
1
vote
1answer
71 views

What should the output of a neural network that needs to classify in an unsupervised fashion XOR data be?

XOR data, without labels: [[0,0],[0,1],[1,0],[1,1]] I'm using this network for auto-classifying XOR data: ...
2
votes
0answers
69 views

NEAT can't solve XOR completely

I'm currently implementing the NEAT algorithm. But problems occur when testing it with problems which don't have a linear solution(for example xor). My xor only produces 3 correct outputs once at a ...
2
votes
1answer
62 views

Should forecasting with neural networks only be treated as a supervised learning (regression) problem?

I have recently made a work about the application of neural networks to time series forecasting, and I treated this as a supervised learning (regression) problem. I have come across the suggestion of ...
0
votes
0answers
43 views

How to train an Encoder-Decoder LSTM for sequence to sequence prediction?

I have a dataset where for each country there is a name (string) and a multivariate time series (all integers). I am trying to use an Encoder-Decoder LSTM to forecast the next time steps in the time ...
2
votes
1answer
104 views

Is this dataset with only two features suitable for clustering with k-means?

I am working with the K-means clustering algorithm for unsupervised learning. Is the following dataset suitable for the k-means clustering task or not? Why or why not? The dataset has only two ...
2
votes
1answer
44 views

When labelled data is not available, what are some common unsupervised learning algorithms for pattern recognition that can be used?

In pattern recognition systems, when no labeled data is available, what are some common unsupervised learning algorithms for pattern recognition, that can be used?
4
votes
2answers
205 views

How can reinforcement learning be unsupervised learning if it uses deep learning?

I was watching a video in my online course where I'm learning about A.I. I am a very beginner in it. At one point in the course, the instructor says that reinforcement learning (RL) needs a deep ...
1
vote
1answer
37 views

Applying Eligibility Traces to Q-Learning algorithm does not improve results (And might not function well)

I am trying to apply Eligibility Traces to a currently working Q-Learning algorithm. The reference code for the Q-Learning algorithm was taken from this great blog ...
1
vote
0answers
35 views

How do I approach this problem?

Let's say I have a dataset with multiple types of multiple ingredients (salt1,salt2, etc). Each n-th variation of each ingredient vs flavor may be represented by an n×k matrix that where an ingredient ...
0
votes
0answers
56 views

How can I group the entries of the network traffic by their similarity?

I have the traffic of my network (with hundreds of entries). Below I am showing only 9 entries. ...
2
votes
1answer
44 views

Is there a notion of generalization in unsupervised learning?

I've been learning a little bit about generalization theory, and in particular, the PAC (and PAC-Bayes) approach to thinking about this problem. So, I started to wonder if there is an analogous ...
2
votes
2answers
61 views

Could clustering be used to parse pdf documents to get headings and titles?

I'm a bit new to AI and I'd like to use some kind of clustering algorithm to solve a problem: I'm trying to parse pdf documents to get headings and titles. I can parse pdf to html and I'm then able ...
3
votes
6answers
74 views

How can I cluster this data frame with several features and observations?

How can I cluster the data frame below with several features and observations? And how would I go about determining the quality of those clusters? Is k-NN appropriate for this? ...
0
votes
1answer
91 views

What are the pros and cons of supervised, semi-supervised and unsupervised relation extraction in NLP?

I am following the NLP course taught by Dan Jurafsky. In the video lectures Supervised Relation Extraction and Semi Supervised and Unsupervised Relation Extraction Jurafsky explains supervised, semi-...
2
votes
2answers
89 views

How can I use autoencoders to analyze patterns and classify them?

I generated a bunch of simulation data from a complex physical simulation that spits out patterns. I am trying to apply unsupervised learning to analyze the patterns and ideally classify them into ...
1
vote
1answer
59 views

Solving the supervised learning problem of learning $p(y \vert \mathbf{x})$ by using traditional unsupervised technologies to learn $p(\mathbf{x}, y)$

I am currently studying Deep Learning by Goodfellow, Bengio, and Courville. In chapter 5.1.2 The Performance Measure, $P$, the authors say the following: Unsupervised learning and supervised learning ...
1
vote
0answers
34 views

Training an unsupervised convolutional neural network to learn a general representation of a Lua module

I am trying to train a CNN in keras to learn a general representation of a Lua module, e.g. requires at the beginning, local variables, local functions, interface (returns) and in between some ...
1
vote
0answers
46 views

How is clustering used in the unsupervised training of a neural network?

How is clustering used in the unsupervised training of a neural network? Can you provide an example?
3
votes
1answer
69 views

In unsupervised learning, what is meant by “finding the probability of an image”?

The specific problem I'm having is with a Fully Visible Belief Network. It is an explicit density model (though I don't know what quantifies something being such) that uses the chain rule to decompose ...
3
votes
2answers
74 views

Unsupervised learning to optimize a function of the input

I am looking to build a neural network that takes an input vector $\mathbf{X}$ and outputs a vector $\mathbf{Y}$ such at $f(\mathbf{X}, \mathbf{Y})$ is minimized, where $f$ is some function. The ...
3
votes
1answer
359 views

Is there any Python library available for manifold learning using diffusion map? [closed]

I would like to use unsupervised learning with a technique called diffusion map based manifold learning in Python. The original paper on the diffusion map is An Introduction to Diffusion Maps. I have ...
3
votes
1answer
112 views

What needs to be done to make a fair algorithm?

What needs to be done to make a fair algorithm (supervised and unsupervised)? In this context, there is no consensus on the definition of fairness, so you can use the definition you find most ...
4
votes
1answer
46 views

Are there methods that allow deep networks to learn object categorization in a self-supervised way?

When training a deep network to learn object classification from a set like ImageNet, we minimize the cross entropy between the ground truth and the predicted categories. This is done in a supervised ...
6
votes
1answer
79 views

How does the network know which objects to track in the paper “Label-Free Supervision of Neural Networks with Physics and Domain Knowledge”?

I was reading the paper Label-Free Supervision of Neural Networks with Physics and Domain Knowledge, published at AAAI 2017, which won the best paper award. I understand the math and it makes sense. ...
3
votes
1answer
35 views

Do the eigenvectors represent the original features?

I've got a test dataset with 4 features and the PCA produces a set of 4 eigenvectors, e.g., ...
1
vote
0answers
734 views

Which approaches are best suited for text deblurring?

I want to deblur text images using deep learning. Which approaches are best suited for the task? Any example networks? Is unsupervised network the best approach? GAN or cycle GAN for these purposes? ...
2
votes
1answer
115 views

Is unsupervised learning a branch of AI?

From Artificial Intelligence: A Modern Approach, a book by Stuart Russell and Peter Norvig, this is the definition of AI: We define AI as the study of agents that receive percepts from the ...
0
votes
2answers
53 views

How can I cluster based on the complementary categories?

K-means tries to find centroid and then clusters around the centroids. But what if we want to cluster based on the complement? For example, suppose we have a group of animals and we want to cluster ...
3
votes
1answer
91 views

Is unsupervised disentanglement really impossible?

In Locatello et al's Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representations he claims to prove unsupervised disentanglement is impossible. His entire claim is ...
1
vote
1answer
419 views

What is the role of the 'fuzzifier' w in Fuzzy Clustering?

According to my lecture, Fuzzy c-Means tries to minimize the following objective function: $$J(X,B,U)=\sum_{i=1}^c\sum_{j=1}^n u_{ij}^w \, d^2(\vec{\beta_i},\vec{x_j})$$ where $X$ are the data ...
2
votes
1answer
61 views

Is a multi-layer Kohonen network possible?

The Kohonen network is one fully connected layer, which clusters the input into classes by a given metric. However, the one layer does not allow to operate with complex relations, that's why deep ...
1
vote
0answers
18 views

Predicting Hot Categories In a Reference Manager

Reference managers like Zotero or Mendeley allow researchers to categorize papers into hierarchical categories called collections. The User navigates through a listing of these collections when filing ...