Questions tagged [anomaly-detection]

For questions related to anomaly detection (or outlier detection) algorithms, which is the identification of rare items, events or observations which raise suspicions by differing significantly from the majority of the data. There are unsupervised, supervised and semi-supervised anomaly detection algorithms.

Filter by
Sorted by
Tagged with
0
votes
0answers
51 views

What are some scalable approaches to perform anomaly detection (for images with small cracks) with unsupervised learning?

I have some images with anomalies, like small cracks, but it's an imbalanced dataset. Please, suggest some effective scalable approaches. Should I consider convolutional auto-encoders? It's supposed ...
1
vote
0answers
76 views

How can a de-noising auto-encoder act as an anomaly detection model?

In some research papers, I have seen that, for training the autoencoders, instead of giving the non-anomalous input images, they add some anomalies to the normal input images, and train the auto-...
0
votes
0answers
31 views

How to deal with large number of features for Anomaly Detection

I am trying to build anomaly detection with low false positives .Dataset that i am using is a patient health sensor data. A number of parameters from the patient's sensors are collected hourly and I ...
1
vote
0answers
22 views

What models will you suggest to use in Industrial Anomaly Detection and Predictive analysis on live streamed data?

I have been working on industrial data, that is fed live, I want to explore a few models which might suit for this the best. The data are KPI data from the manufacturing Industry.
2
votes
0answers
86 views

Is it possible to use entity embedding with autoencoder for anomaly detetction?

I'm trying to build autoencoder in keras in order to detect anomalies. However, most of the data is categorical and I have to encode it. When it comes to production, categorical features can take new ...
3
votes
0answers
23 views

Defect Detection System using Deep Learning

What is the general approach to defect detection in deep learning? Would the approach be better if we try to learn the positive images (defects in images) as much as possible or we try to learn the ...
1
vote
1answer
73 views

Understanding the reconstruction loss in the paper “Anomaly Detection using Deep Learning based Image Completion”

I would like to implement the approach represented in this paper. Here they used following reconstruction loss: $$ L(X)= \frac{\lambda \cdot || M \odot (X - F(\overline{M} \odot X)) ||_{1} + (1 - \...
2
votes
1answer
94 views

Reconstruction Errors in Auto Encoders after Training

Autoencoders are used for unsupervised anomaly detection by at first learning the features of the data set with mainly "normal" data points. Then new data can be considered anomalous, if the new data ...
2
votes
0answers
106 views

Application of Blockchain in Fraud detection in stock market

I want to develop a fraud detection application in the stock market Using Blockchain technology, we have some pattern that defines the anomaly for use of supervised machine learning but there is one ...
4
votes
1answer
63 views

Which unsupervised learning algorithm can be used for peaks detection?

So, I have a dataset which has around 1388 unique products and I have to do unsupervised learning on them in order to find anomalies (high/low peaks). The data below just represents one product. The <...
5
votes
1answer
143 views

Which unsupervised learning technique can be used for anomaly detection in a time series?

I've started working on anomaly detection in Python. My dataset is a time series one. The data is being collected by some sensors which record and collect data on semiconductor making machines. My ...
2
votes
0answers
88 views

How to perform unsupervised anomaly detection from log file with mostly textual data?

I have a log file of the format, Index, Date, Timestamp, Module, App, Context, Session, Verbosity level, Description The log file can be considered as a master log, which consists of individual ...
2
votes
2answers
76 views

Which unsupervised anomaly detection algorithms are there?

I need to create model which will find suspicious entries or anomalies in a network, whose characteristics or features are the asset_id, ...
5
votes
1answer
98 views

Find anomalies from records of categorical data

I have a data-set with $m$ observations and $p$ categorical variables (nominal), each variable $X_1, X_2,\dots, X_p$ has several different possible values. Ultimately, I am looking for a way to find ...