Questions tagged [clustering]

For questions related to clustering (a usual unsupervised learning technique).

Filter by
Sorted by
Tagged with
1
vote
1answer
17 views

Perform clustering on high dimensional data

Recently I trained a BYOL model on a set of images to learn an embedding space where similar vectors are close by. The performance was fantastic when I performed approximate K-nearest neighbours ...
0
votes
0answers
13 views

Is it possible that k-means generates a cluster with no points in it, if the initial centroid is not properly set and no of cluster is large?

Is it possible that sklearn's k-means algorithm will generate a cluster that has no points at all, given that the number of k is large and the initial centroid is just random? Furthermore, will k-...
0
votes
0answers
33 views

What is the best machine learning algorithm for clustering dots based on coordinates $(x,y)$ with consideration of weight of the points?

I'm looking for a machine learning algorithm for clustering points based on their coordinates. Furthermore, I want to take into consideration the weights of each point. Suppose there is a weight in ...
0
votes
0answers
20 views

Expectation-maximization calculation for example shown in Artificial intelligence A modern approach

I am reading learning Bayes net parameter values for hidden variables in Artificial intellegence A modern approach by Russel and Norvig. My questions on above text: Author mentioned that "...
2
votes
0answers
25 views

What would be a reasonable option for clustering for unknown number of clusters and a lot of outliers?

I am implementing the CV detection pipeline with the use of SIFT and KNN Matcher. Image keypoints matched to the query keypoints produce the following image: The matched objects have a lot of key ...
0
votes
1answer
29 views

In this example of fuzzy c-means, what is the difference between "sigma" and "center" for the clusters?

In this example, what exactly do "Cluster" and "Sigma" mean? (They chose random coordinates for the three centroids of the groups) Centers: Cluster centers, returned as a ...
0
votes
1answer
21 views

How to reduce the number of clusters produced by the Markov Clustering Algorithm?

I have used the Markov Clustering Algorithm (MCL) to cluster tweets, based on their similarity. However, I got a too high number of clusters, and most of the clusters have only one tweet. Any ...
0
votes
0answers
42 views

What are some machine learning frameworks for supervised clustering?

I have a task where I need to take "data points" which consist of collections of items. Each item needs to be categorised according to predefined categories. That's the easy part - my ...
0
votes
0answers
14 views

Do Self Organizing Maps (SOMs) require as much data as a typical neural network?

The question is in the title. I'm looking at clustering sequences and have created a short-list of approaches: Clustering on Edit Distance: Needleman-Wunsch: Similarity measure (used in ESAC) ...
0
votes
0answers
15 views

Are there any well-known ways to fuzzy-cluster (variable length) sequences of trajectories?

I have this issue where I need to create 'soft' clusters for different trajectories. The data is sequences of integers where each integer means a specific point; so I have sequences like $s=(1,47,9)$ ...
1
vote
0answers
14 views

What is the best clustering method to detect anomalies for data with mostly categorical data?

I have a dataset with about 85 columns. Out of the 85 columns, 70+ are categorical. My goal is to identify the outliers in this dataset through clustering methods as I do not have a target column. ...
0
votes
0answers
11 views

Dealing with unwanted clustering in the dataset

I have a dataset of sentences that I embedded using the USE for training an image2Seq model. But when I applied t-SNE to the embeddings, applied K-Means, and plotted a scatterplot, I could see that ...
2
votes
0answers
36 views

Is there a technique for analyzing the relationship between time-series clusters?

I have two time-series datasets (temperature and speed of the vehicle). I will use Agglomerative Hierarchical Clustering and DTW to cluster both datasets. I am looking for a technique (like regression ...
0
votes
0answers
7 views

Split a city into a set of candidate locations (cells) via a clustering algorithm (DBSCAN or OPTICS)

The authors of the following paper predict the market attraction for restaurants based on user reviews for different locations to select an ideal location. To do so they have split the city into a set ...
2
votes
1answer
51 views

Is there a clustering algorithm that can make n clusters and the n+1 "others" cluster?

As far as I know all clustering algorithms assume that all delivered data points have to find its cluster. My question is, is there an algorithm that could focus only on n clusters (number stated by ...
0
votes
0answers
62 views

How to use Product Matching to create Product Bundles

I am working on a product matching model. GOAL A store has many products like creams, perfumes, other beauty products. Based on product properties I have to create bundles of it so we can sell more ...
3
votes
1answer
91 views

How to define machine learning to cover clustering, classification, and regression?

How to define machine learning to cover clustering, classification, and regression? What unites these problems?
0
votes
0answers
33 views

Interpreting a self organizing map resulting from the same dataset with different standard deviations

I am working on a task where the goal is to make a sofm learn a mapping from a three-dimensional space (the input space) to a two-dimensional space (the sofm "grid"). The data points are ...
3
votes
2answers
49 views

Accuracy metric for Clustering

I have a model that outputs a latent N-dimensional embedding for all data points, trained in a way that clusters data-points from the same class together, while being separated from other clusters ...
2
votes
1answer
88 views

What exactly is the eigenspace of a graph (in spectral clustering)?

When we find the eigenvectors of a graph (say in the context of spectral clustering), what exactly is the vector space involved here? Of what vector space (or eigenspace) are we finding the ...
3
votes
0answers
21 views

What is meant by subspace clustering in MFA?

The basic idea of MFA is to perform subspace clustering by assuming the covariance structure for each component of the form, $\Sigma_i = \Lambda_i \Lambda_i^T + \Psi_i$, where $\Lambda_i \in \mathbb{R}...
2
votes
0answers
37 views

How does Hartigan & Wong algorithm compare to Lloyd's and Macqueen's algorithm in K-means clustering?

As far I know, this is how the latter two algorithms work... Lloyd's algorithm Choose the number of clusters. Choose a distance metric (typically squared euclidean). Randomly assign each observation ...
1
vote
0answers
54 views

How to cluster data points such that the number of clusters is kept minimal and each cluster projects well onto a lower-dimensional subspace?

If I want to find a (linear) subspace onto which a data-set projects well, I can simply use PCA. However, often the data can project with much smaller error if I first separate it into a couple of ...
1
vote
0answers
82 views

Combining clustering and deep learning for computer vision

Is there any recent work on combining clustering approaches (k-means, or gaussian mixture or PGM) with deep learning for computer vision? In particular I'm interested in if anyone has used the first ...
2
votes
0answers
62 views

Would it be possible to implement the principals of the K means clustering algorithm in a Neural Network

During a Machine Learning course which I have done I have learnt about the K means algorithm. Is it possible to use the principals of K means within a neural network?
2
votes
1answer
181 views

Is this dataset with only two features suitable for clustering with k-means?

I am working with the K-means clustering algorithm for unsupervised learning. Is the following dataset suitable for the k-means clustering task or not? Why or why not? The dataset has only two ...
1
vote
0answers
38 views

How do I approach this problem?

Let's say I have a dataset with multiple types of multiple ingredients (salt1,salt2, etc). Each n-th variation of each ingredient vs flavor may be represented by an n×k matrix that where an ingredient ...
2
votes
2answers
66 views

Could clustering be used to parse pdf documents to get headings and titles?

I'm a bit new to AI and I'd like to use some kind of clustering algorithm to solve a problem: I'm trying to parse pdf documents to get headings and titles. I can parse pdf to html and I'm then able ...
3
votes
6answers
76 views

How can I cluster this data frame with several features and observations?

How can I cluster the data frame below with several features and observations? And how would I go about determining the quality of those clusters? Is k-NN appropriate for this? ...
2
votes
0answers
65 views

Neural network to extract correlated columns

I want to use a neural network to find correlated columns in a .csv file and give them as a output. The input .csv file has ...
1
vote
0answers
22 views

Finding unique faces in a video

I am trying to find unique (distinct) faces in multiple videos files. What is the best way to do that?
1
vote
0answers
47 views

How is clustering used in the unsupervised training of a neural network?

How is clustering used in the unsupervised training of a neural network? Can you provide an example?
1
vote
1answer
39 views

How to detect patterns in salary distribution if we are suspecting malicious distribution based on employee's region?

We are having suspects in salary distribution in our organisation due to employee's region. The data we have is as the following: ...
2
votes
0answers
23 views

Clustering of very high dimensional data and large number of examples without losing info in dimensions

I'm trying to get a grasp on scalability of clustering algorithms, and have a toy example in mind. Let's say I have around a million or so songs from $50$ genres. Each song has characteristics - some ...
2
votes
1answer
117 views

Is unsupervised learning a branch of AI?

From Artificial Intelligence: A Modern Approach, a book by Stuart Russell and Peter Norvig, this is the definition of AI: We define AI as the study of agents that receive percepts from the ...
0
votes
2answers
65 views

How can I cluster based on the complementary categories?

K-means tries to find centroid and then clusters around the centroids. But what if we want to cluster based on the complement? For example, suppose we have a group of animals and we want to cluster ...
1
vote
1answer
517 views

What is the role of the 'fuzzifier' w in Fuzzy Clustering?

According to my lecture, Fuzzy c-Means tries to minimize the following objective function: $$J(X,B,U)=\sum_{i=1}^c\sum_{j=1}^n u_{ij}^w \, d^2(\vec{\beta_i},\vec{x_j})$$ where $X$ are the data ...
3
votes
2answers
386 views

How to compute the number of centroids for K-means clustering algorithm given minimal distance?

I need to cluster my points into unknown number of clusters, given the minimal Euclidean distance R between the two clusters. Any two clusters that are closer than this minimal distance should be ...
3
votes
1answer
149 views

What is graph clustering?

There are several (family of) algorithms that can be used to cluster a set of $d$-dimensional points: for example, k-means, k-medoids, hierarchical clustering (agglomerative or divisive). What is ...
3
votes
1answer
113 views

How do we know the classification boundaries of the data?

Consider an image classification problem. Conceptually, we then have some high dimensional space where all the images can be represented as points, and having large enough labeled data set we can ...
3
votes
2answers
76 views

What techniques to explore for dynamic clustering of documents (emails)?

I have a dataset of unlabelled emails that fall into distinct categories (around a dozen). I want to be able to classify them along with new ones to come in the future in a dynamic matter. I know that ...
3
votes
1answer
160 views

Is it normal that SOM clusters the instances with the "versicolor" class into multiple different BMUs?

I have trained (with different sizes, learning rates, and epochs) a SOM network to cluster the Iris dataset. The instances associated with the class setosa have ...
1
vote
1answer
192 views

How to refine K-means clustering on a data set?

I'm working with a data set where the data is stored in a string such as AxByCyA where A, B ...