English
Related papers

Related papers: Perfect density models cannot guarantee anomaly de…

200 papers

Anomaly detection is the process of finding data points that deviate from a baseline. In a real-life setting, anomalies are usually unknown or extremely rare. Moreover, the detection must be accomplished in a timely manner or the risk of…

Machine Learning · Computer Science 2019-04-26 Mariem Ben Fadhel , Kofi Nyarko

Anomaly detection is a field of intense research. Identifying low probability events in data/images is a challenging problem given the high-dimensionality of the data, especially when no (or little) information about the anomaly is…

Machine Learning · Computer Science 2022-04-13 José A. Padrón-Hidalgo , Valero Laparra , Gustau Camps-Valls

In high dimensional settings, density estimation algorithms rely crucially on their inductive bias. Despite recent empirical success, the inductive bias of deep generative models is not well understood. In this paper we propose a framework…

Machine Learning · Computer Science 2018-11-09 Shengjia Zhao , Hongyu Ren , Arianna Yuan , Jiaming Song , Noah Goodman , Stefano Ermon

We present a novel method for image anomaly detection, where algorithms that use samples drawn from some distribution of "normal" data, aim to detect out-of-distribution (abnormal) samples. Our approach includes a combination of encoder and…

Image and Video Processing · Electrical Eng. & Systems 2020-03-02 Nina Tuluptceva , Bart Bakker , Irina Fedulova , Anton Konushin

Though anomaly detection (AD) can be viewed as a classification problem (nominal vs. anomalous) it is usually treated in an unsupervised manner since one typically does not have access to, or it is infeasible to utilize, a dataset that…

Machine Learning · Computer Science 2023-01-30 Lukas Ruff , Robert A. Vandermeulen , Billy Joe Franks , Klaus-Robert Müller , Marius Kloft

Data augmentation methods are commonly integrated into the training of anomaly detection models. Previous approaches have primarily focused on replicating real-world anomalies or enhancing diversity, without considering that the standard of…

Artificial Intelligence · Computer Science 2024-12-30 Jiang Lin , Yaping Yan

Anomaly detection is a relevant problem in the area of data analysis. In networked systems, where individual entities interact in pairs, anomalies are observed when pattern of interactions deviates from patterns considered regular. Properly…

Social and Information Networks · Computer Science 2023-10-25 Hadiseh Safdari , Caterina De Bacco

Machine learning models encounter Out-of-Distribution (OoD) errors when the data seen at test time are generated from a different stochastic generator than the one used to generate the training data. One proposal to scale OoD detection to…

Machine Learning · Statistics 2019-05-27 Hyunsun Choi , Eric Jang , Alexander A. Alemi

Recent studies of generalization in deep learning have observed a puzzling trend: accuracies of models on one data distribution are approximately linear functions of the accuracies on another distribution. We explain this trend under an…

Machine Learning · Computer Science 2021-02-24 Horia Mania , Suvrit Sra

Out-of-distribution (OOD) detection is crucial to safety-critical machine learning applications and has been extensively studied. While recent studies have predominantly focused on classifier-based methods, research on deep generative model…

Machine Learning · Computer Science 2024-02-19 Genki Osada , Tsubasa Takahashi , Takashi Nishide

We present a new subspace-based method to construct probabilistic models for high-dimensional data and highlight its use in anomaly detection. The approach is based on a statistical estimation of probability density using densities of…

Machine Learning · Computer Science 2021-08-16 Cetin Savkli , Catherine Schwartz

This paper addresses the task of set prediction using deep learning. This is important because the output of many computer vision tasks, including image tagging and object detection, are naturally expressed as sets of entities rather than…

Computer Vision and Pattern Recognition · Computer Science 2017-08-14 S. Hamid Rezatofighi , Vijay Kumar B G , Anton Milan , Ehsan Abbasnejad , Anthony Dick , Ian Reid

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Machine Learning · Computer Science 2025-07-11 Yifan Ding , Arturas Aleksandraus , Amirhossein Ahmadian , Jonas Unger , Fredrik Lindsten , Gabriel Eilertsen

This paper tackles the challenge of detecting unreliable behavior in regression algorithms, which may arise from intrinsic variability (e.g., aleatoric uncertainty) or modeling errors (e.g., model uncertainty). First, we formally introduce…

Machine Learning · Computer Science 2024-06-12 Andres Altieri , Marco Romanelli , Georg Pichler , Florence Alberge , Pablo Piantanida

Several interesting generative learning algorithms involve a complex probability distribution over many random variables, involving intractable normalization constants or latent variable normalization. Some of them may even not have an…

Machine Learning · Computer Science 2014-05-13 Yoshua Bengio , Li Yao , Kyunghyun Cho

In recent years, neural network-based anomaly detection methods have attracted considerable attention in the hyperspectral remote sensing domain due to the powerful reconstruction ability compared with traditional methods. However, actual…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Shaoqi Yu , Xiaorun Li , Shuhan Chen , Liaoying Zhao

This study explores the concept of high-density anomalies. As opposed to the traditional concept of anomalies as isolated occurrences, high-density anomalies are deviant cases positioned in the most normal regions of the data space. Such…

Machine Learning · Computer Science 2021-04-06 Ralph Foorthuis

With the increase in the learning capability of deep convolution-based architectures, various applications of such models have been proposed over time. In the field of anomaly detection, improvements in deep learning opened new prospects of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Jin-Ha Lee , Marcella Astrid , Muhammad Zaigham Zaheer , Seung-Ik Lee

Learning representations that clearly distinguish between normal and abnormal data is key to the success of anomaly detection. Most of existing anomaly detection algorithms use activation representations from forward propagation while not…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Gukyeong Kwon , Mohit Prabhushankar , Dogancan Temel , Ghassan AlRegib

Models for learning probability distributions such as generative models and density estimators behave quite differently from models for learning functions. One example is found in the memorization phenomenon, namely the ultimate convergence…

Machine Learning · Statistics 2021-03-03 Hongkang Yang , Weinan E