English
Related papers

Related papers: Machine Learning for Complex Systems with Abnormal…

200 papers

Data-driven anomaly detection methods typically build a model for the normal behavior of the target system, and score each data instance with respect to this model. A threshold is invariably needed to identify data instances with high (or…

Machine Learning · Statistics 2019-10-09 Sreelekha Guggilam , S. M. Arshad Zaidi , Varun Chandola , Abani Patra

This paper proposes a fully Bayesian framework for node-level outlier detection in graph signals, where measurements are observed on the nodes of an underlying graph. Unlike traditional outlier detection methods, our approach accounts for…

Methodology · Statistics 2026-04-17 Seongmin Kim , Kyusoon Kim

We develop a mixture-based approach to robust density modeling and outlier detection for experimental multivariate data that includes measurement error information. Our model is designed to infer atypical measurements that are not due to…

Astrophysics · Physics 2007-09-07 Jianyong Sun , Ata Kaban , Somak Raychaudhury

An anomaly detection method based on deep autoencoders is proposed to address anomalies that often occur in enterprise-level ETL data streams. The study first analyzes multiple types of anomalies in ETL processes, including delays, missing…

Machine Learning · Computer Science 2025-11-04 Xin Chen , Saili Uday Gadgil , Kangning Gao , Yi Hu , Cong Nie

Deep Learning models possess two key traits that, in combination, make their use in the real world a risky prospect. One, they do not typically generalize well outside of the distribution for which they were trained, and two, they tend to…

Machine Learning · Computer Science 2021-09-29 Jonathan S. Kent , Bo Li

Outlier recognition is a fundamental problem in data analysis and has attracted a great deal of attention in the past decades. However, most existing methods still suffer from several issues such as high time and space complexities or…

Computational Geometry · Computer Science 2019-04-09 Hu Ding , Mingquan Ye

The detection of out-of-distribution data points is a common task in particle physics. It is used for monitoring complex particle detectors or for identifying rare and unexpected events that may be indicative of new phenomena or physics…

Data Analysis, Statistics and Probability · Physics 2024-02-07 Vasilis Belis , Patrick Odagiu , Thea Klæboe Årrestad

Outliers are ubiquitous in modern data sets. Distance-based techniques are a popular non-parametric approach to outlier detection as they require no prior assumptions on the data generating distribution and are simple to implement. Scaling…

Machine Learning · Statistics 2016-05-04 Mario Lucic , Olivier Bachem , Andreas Krause

We consider state estimation for networked systems where measurements from sensor nodes are contaminated by outliers. A new hierarchical measurement model is formulated for outlier detection by integrating the outlier-free measurement model…

Applications · Statistics 2022-11-08 Hongwei Wang , Hongbin Li , Wei Zhang , Junyi Zuo , Heping Wang , Jun Fang

Outlier detection (OD) literature exhibits numerous algorithms as it applies to diverse domains. However, given a new detection task, it is unclear how to choose an algorithm to use, nor how to set its hyperparameter(s) (HPs) in…

Machine Learning · Computer Science 2022-10-20 Xueying Ding , Lingxiao Zhao , Leman Akoglu

This paper considers the problem of outlier detection in functional data analysis focusing particularly on the more difficult case of shape outliers. We present an inductive conformal anomaly detection method based on elastic functional…

Methodology · Statistics 2025-04-11 Jason Adams , Brandon Berman , Joshua Michalenko , J. Derek Tucker

Event sequence data record the occurrences of events in continuous time. Event sequence forecasting based on temporal point processes (TPPs) has been extensively studied, but outlier or anomaly detection, especially without any supervision…

Machine Learning · Computer Science 2024-11-26 Somjit Nath , Yik Chau Lui , Siqi Liu

Data anomalies are ubiquitous in real world datasets, and can have an adverse impact on machine learning (ML) systems, such as automated home valuation. Detecting anomalies could make ML applications more responsible and trustworthy.…

Machine Learning · Computer Science 2020-09-22 Egor Klevak , Sangdi Lin , Andy Martin , Ondrej Linda , Eric Ringger

This paper evaluates algorithms for classification and outlier detection accuracies in temporal data. We focus on algorithms that train and classify rapidly and can be used for systems that need to incorporate new data regularly. Hence, we…

Machine Learning · Statistics 2018-05-03 Victoria J. Hodge , Jim Austin

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

We consider the multi-class classification problem when the training data and the out-of-sample test data may have different distributions and propose a method called BCOPS (balanced and conformal optimized prediction sets). BCOPS…

Methodology · Statistics 2019-06-26 Leying Guan , Rob Tibshirani

We consider the problem of transfer learning in outlier detection where target abnormal data is rare. While transfer learning has been considered extensively in traditional balanced classification, the problem of transfer in outlier…

Machine Learning · Computer Science 2025-01-06 Mohammadreza M. Kalan , Eitan J. Neugut , Samory Kpotufe

Out-of-distribution (OOD) detection is crucial for developing trustworthy and reliable machine learning systems. Recent advances in training with auxiliary OOD data demonstrate efficacy in enhancing detection capabilities. Nonetheless,…

Machine Learning · Computer Science 2025-02-06 Hengzhuang Li , Teng Zhang

A real-time autoencoder-based anomaly detection system using semi-supervised machine learning has been developed for the online Data Quality Monitoring system of the electromagnetic calorimeter of the CMS detector at the CERN LHC. A novel…

Instrumentation and Detectors · Physics 2024-07-31 Abhirami Harilal , Kyungmin Park , Manfred Paulini

Anomaly detection aims at identifying data points that show systematic deviations from the majority of data in an unlabeled dataset. A common assumption is that clean training data (free of anomalies) is available, which is often violated…

Machine Learning · Computer Science 2022-07-20 Chen Qiu , Aodong Li , Marius Kloft , Maja Rudolph , Stephan Mandt