English
Related papers

Related papers: Diminishing Empirical Risk Minimization for Unsupe…

200 papers

Known for their impressive performance in generative modeling, diffusion models are attractive candidates for density-based anomaly detection. This paper investigates different variations of diffusion modeling for unsupervised and…

Machine Learning · Computer Science 2026-05-11 Victor Livernoche , Vineet Jain , Yashar Hezaveh , Siamak Ravanbakhsh

In this paper, we study unsupervised anomaly detection algorithms that learn a neural network representation, i.e. regular patterns of normal data, which anomalies are deviating from. Inspired by a similar concept in engineering, we refer…

Machine Learning · Computer Science 2025-11-12 Simon Klüttermann , Tim Katzke , Emmanuel Müller

We study the minimal error of the Empirical Risk Minimization (ERM) procedure in the task of regression, both in the random and the fixed design settings. Our sharp lower bounds shed light on the possibility (or impossibility) of adapting…

Statistics Theory · Mathematics 2021-02-25 Gil Kur , Alexander Rakhlin

Anomaly detection (AD) is the identification of data samples that do not fit a learned data distribution. As such, AD systems can help physicians to determine the presence, severity, and extension of a pathology. Deep generative models,…

Image and Video Processing · Electrical Eng. & Systems 2021-04-12 Jaime Simarro , Ezequiel de la Rosa , Thijs Vande Vyvere , David Robben , Diana M. Sima

Early detection of anomalies in medical images such as brain MRI is highly relevant for diagnosis and treatment of many conditions. Supervised machine learning methods are limited to a small number of pathologies where there is good…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Alexander Frotscher , Jaivardhan Kapoor , Thomas Wolfers , Christian F. Baumgartner

Empirical risk minimization (ERM) is ubiquitous in machine learning and underlies most supervised learning methods. While there has been a large body of work on algorithms for various ERM problems, the exact computational complexity of ERM…

Computational Complexity · Computer Science 2017-04-11 Arturs Backurs , Piotr Indyk , Ludwig Schmidt

Time series anomaly detection is extensively studied in statistics, economics, and computer science. Over the years, numerous methods have been proposed for time series anomaly detection using deep learning-based methods. Many of these…

Machine Learning · Computer Science 2022-08-25 Shahroz Tariq , Binh M. Le , Simon S. Woo

Anomaly detection tools and methods present a key capability in modern cyberphysical and failure prediction systems. Despite the fast-paced development in deep learning architectures for anomaly detection, model optimization for a given…

Machine Learning · Computer Science 2023-05-29 Marcin Pietron , Dominik Zurek , Kamil Faber , Roberto Corizzo

Detection of anomalous situations for complex mission-critical systems hold paramount importance when their service continuity needs to be ensured. A major challenge in detecting anomalies from the operational data arises due to the…

Machine Learning · Computer Science 2025-05-20 Shanay Mehta , Shlok Mehendale , Nicole Fernandes , Jyotirmoy Sarkar , Santonu Sarkar , Snehanshu Saha

A significant limitation of one-class classification anomaly detection methods is their reliance on the assumption that unlabeled training data only contains normal instances. To overcome this impractical assumption, we propose two novel…

Machine Learning · Computer Science 2023-09-04 Le Thi Khanh Hien , Sukanya Patra , Souhaib Ben Taieb

Empirical Risk Minimization (ERM) algorithms are widely used in a variety of estimation and prediction tasks in signal-processing and machine learning applications. Despite their popularity, a theory that explains their statistical…

Machine Learning · Statistics 2020-07-07 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

Anomaly detection or more generally outliers detection is one of the most popular and challenging subject in theoretical and applied machine learning. The main challenge is that in general we have access to very few labeled data or no…

Machine Learning · Computer Science 2023-05-31 Mansour Zoubeirou A Mayaki , Michel Riveill

Although deep learning has been applied to successfully address many data mining problems, relatively limited work has been done on deep learning for anomaly detection. Existing deep anomaly detection methods, which focus on learning new…

Machine Learning · Computer Science 2019-11-21 Guansong Pang , Chunhua Shen , Anton van den Hengel

Most deep anomaly detection models are based on learning normality from datasets due to the difficulty of defining abnormality by its diverse and inconsistent nature. Therefore, it has been a common practice to learn normality under the…

Machine Learning · Computer Science 2023-09-19 Minkyung Kim , Jongmin Yu , Junsik Kim , Tae-Hyun Oh , Jun Kyun Choi

In recent years, there is a growing need to train machine learning models on a huge volume of data. Designing efficient distributed optimization algorithms for empirical risk minimization (ERM) has therefore become an active and challenging…

Optimization and Control · Mathematics 2019-11-19 Ching-pei Lee , Kai-Wei Chang

Anomaly detection is to recognize samples that differ in some respect from the training observations. These samples which do not conform to the distribution of normal data are called outliers or anomalies. In real-world anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , Yalda Mohsenzadeh

Invariant Causal Prediction (Peters et al., 2016) is a technique for out-of-distribution generalization which assumes that some aspects of the data distribution vary across the training set but that the underlying causal mechanisms remain…

Machine Learning · Computer Science 2021-03-30 Elan Rosenfeld , Pradeep Ravikumar , Andrej Risteski

Anomaly detection on time series data is increasingly common across various industrial domains that monitor metrics in order to prevent potential accidents and economic losses. However, a scarcity of labeled data and ambiguous definitions…

Machine Learning · Computer Science 2022-12-29 Lawrence Wong , Dongyu Liu , Laure Berti-Equille , Sarah Alnegheimish , Kalyan Veeramachaneni

The Extreme Learning Machine (ELM) is a growing statistical technique widely applied to regression problems. In essence, ELMs are single-layer neural networks where the hidden layer weights are randomly sampled from a specific distribution,…

Machine Learning · Statistics 2025-07-31 Daniela De Canditiis , Fabiano Veglianti

Anomaly detection (AD) is essential in identifying rare and often critical events in complex systems, finding applications in fields such as network intrusion detection, financial fraud detection, and fault detection in infrastructure and…

Machine Learning · Computer Science 2024-06-12 Hao Dong , Gaëtan Frusque , Yue Zhao , Eleni Chatzi , Olga Fink