English
Related papers

Related papers: Unsupervised anomaly detection in large-scale estu…

200 papers

Building a scalable machine learning system for unsupervised anomaly detection via representation learning is highly desirable. One of the prevalent methods is using a reconstruction error from variational autoencoder (VAE) via maximizing…

Machine Learning · Computer Science 2020-05-08 Seonho Park , George Adosoglou , Panos M. Pardalos

Anomaly detection in tabular data remains challenging due to complex feature interactions and the scarcity of anomalous examples. Denoising autoencoders rely on fixed-magnitude noise, limiting adaptability to diverse data distributions.…

Machine Learning · Computer Science 2025-08-04 Timur Sattarov , Marco Schreyer , Damian Borth

Anomaly detection is a fundamental task in machine learning and data mining, with significant applications in cybersecurity, industrial fault diagnosis, and clinical disease monitoring. Traditional methods, such as statistical modeling and…

Machine Learning · Computer Science 2025-05-09 Yi Chen

Advancements in deep learning techniques have given a boost to the performance of anomaly detection. However, real-world and safety-critical applications demand a level of transparency and reasoning beyond accuracy. The task of anomaly…

Machine Learning · Computer Science 2023-11-03 Laya Rafiee Sevyeri , Ivaxi Sheth , Farhood Farahnak , Samira Ebrahimi Kahou , Shirin Abbasinejad Enger

This paper proposes an effective modelling of sound event spectra with a hidden data-size-imbalance, for improved Acoustic Event Detection (AED). The proposed method models each event as an aggregated representation of a few latent factors,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-08 Chaitanya Narisetty , Tatsuya Komatsu , Reishi Kondo

Methods for unsupervised anomaly detection suffer from the fact that the data is unlabeled, making it difficult to assess the optimality of detection algorithms. Ensemble learning has shown exceptional results in classification and…

Machine Learning · Statistics 2016-10-26 Edward Yu , Parth Parekh

Anomaly Detection (AD) defines the task of identifying observations or events that deviate from typical - or normal - patterns, a critical capability in IT security for recognizing incidents such as system misconfigurations, malware…

Detecting rare and diverse anomalies in highly imbalanced datasets-such as Advanced Persistent Threats (APTs) in cybersecurity-remains a fundamental challenge for machine learning systems. Active learning offers a promising direction by…

Machine Learning · Computer Science 2026-02-04 Sidahmed Benabderrahmane , Petko Valtchev , James Cheney , Talal Rahwan

Unsupervised anomaly detection (UAD) plays an important role in modern data analytics and it is crucial to provide simple yet effective and guaranteed UAD algorithms for real applications. In this paper, we present a novel UAD method for…

Machine Learning · Computer Science 2024-12-17 Wei Dai , Kai Hwang , Jicong Fan

The detection and classification of anomalies in gravitational wave data plays a critical role in improving the sensitivity of searches for signals of astrophysical origins. We present ABNORMAL (AI Based Nonstationarity Observer for…

General Relativity and Quantum Cosmology · Physics 2025-08-28 Yi-Yang Guo , Soumya D. Mohanty , Xie Qunying , Yu-Xiao Liu

River water-quality monitoring is increasingly conducted using automated in situ sensors, enabling timelier identification of unexpected values. However, anomalies caused by technical issues confound these data, while the volume and…

Uncertainty estimation for unlabeled data is crucial to active learning. With a deep neural network employed as the backbone model, the data selection process is highly challenging due to the potential over-confidence of the model…

Machine Learning · Computer Science 2024-02-14 Xingjian Li , Pengkun Yang , Yangcheng Gu , Xueying Zhan , Tianyang Wang , Min Xu , Chengzhong Xu

Deep approaches to anomaly detection have recently shown promising results over shallow methods on large and complex datasets. Typically anomaly detection is treated as an unsupervised learning problem. In practice however, one may…

There is a growing need to quickly and accurately identify anomalous behavior in ships. This paper applies a variation of the Density Based Spatial Clustering Among Noise (DBSCAN) algorithm to identify such anomalous behavior given a ship's…

Methodology · Statistics 2021-07-09 Carsten Botts

In this paper, we propose Normality-Calibrated Autoencoder (NCAE), which can boost anomaly detection performance on the contaminated datasets without any prior information or explicit abnormal samples in the training phase. The NCAE…

Machine Learning · Computer Science 2021-10-29 Jongmin Yu , Hyeontaek Oh , Minkyung Kim , Junsik Kim

Machine learning offers potential solutions to current issues in industrial systems in areas such as quality control and predictive maintenance, but also faces unique barriers in industrial applications. An ongoing challenge is extreme…

Machine Learning · Computer Science 2026-01-15 Lesley Wheat , Martin v. Mohrenschildt , Saeid Habibi

Anomalous Sound Detection (ASD) is often formulated as a machine attribute classification task, a strategy necessitated by the common scenario where only normal data is available for training. However, the exhaustive collection of machine…

Sound · Computer Science 2025-09-22 Xin Fang , Guirui Zhong , Qing Wang , Fan Chu , Lei Wang , Mengui Qian , Mingqi Cai , Jiangzhao Wu , Jianqing Gao , Jun Du

Given a long list of anomaly detection algorithms developed in the last few decades, how do they perform with regard to (i) varying levels of supervision, (ii) different types of anomalies, and (iii) noisy and corrupted data? In this work,…

Machine Learning · Computer Science 2022-09-20 Songqiao Han , Xiyang Hu , Hailiang Huang , Mingqi Jiang , Yue Zhao

To achieve high-levels of autonomy, modern robots require the ability to detect and recover from anomalies and failures with minimal human supervision. Multi-modal sensor signals could provide more information for such anomaly detection…

Robotics · Computer Science 2020-12-17 Tianchen Ji , Sri Theja Vuppala , Girish Chowdhary , Katherine Driggs-Campbell

In recent years, the wood product industry has been facing a skilled labor shortage. The result is more frequent sudden failures, resulting in additional costs for these companies already operating in a very competitive market. Moreover,…

Sound · Computer Science 2025-01-10 Anthony Deschênes , Rémi Georges , Cem Subakan , Bruna Ugulino , Antoine Henry , Michael Morin