English
Related papers

Related papers: Exploring the Intrinsic Probability Distribution f…

200 papers

Deep generative models have been demonstrated as state-of-the-art density estimators. Yet, recent work has found that they often assign a higher likelihood to data from outside the training distribution. This seemingly paradoxical behavior…

Machine Learning · Computer Science 2022-01-19 Jakob D. Havtorn , Jes Frellsen , Søren Hauberg , Lars Maaløe

Out-of-distribution (OOD) detection is a critical task for deploying machine learning models in the open world. Distance-based methods have demonstrated promise, where testing samples are detected as OOD if they are relatively far away from…

Machine Learning · Computer Science 2022-12-09 Yiyou Sun , Yifei Ming , Xiaojin Zhu , Yixuan Li

Visual anomaly detection is common in several applications including medical screening and production quality check. Although a definition of the anomaly is an unknown trend in data, in many cases some hints or samples of the anomaly class…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Daiki Kimura , Minori Narita , Asim Munawar , Ryuki Tachibana

We propose a modified density estimation problem that is highly effective for detecting anomalies in tabular data. Our approach assumes that the density function is relatively stable (with lower variance) around normal samples. We have…

Machine Learning · Computer Science 2024-05-09 Amit Rozner , Barak Battash , Henry Li , Lior Wolf , Ofir Lindenbaum

We study the problem of approximately recovering a probability distribution given noisy measurements of its Chebyshev polynomial moments. This problem arises broadly across algorithms, statistics, and machine learning. By leveraging a…

Data Structures and Algorithms · Computer Science 2026-05-20 Cameron Musco , Christopher Musco , Lucas Rosenblatt , Apoorv Vikram Singh

Anomaly localization in images -- identifying regions that deviate from normal patterns -- is vital in applications such as medical diagnosis and industrial inspection. A recent trend is the use of image generation models in anomaly…

Machine Learning · Statistics 2026-04-28 Teruyuki Katsuoka , Tomohiro Shiraishi , Daiki Miwa , Vo Nguyen Le Duy , Ichiro Takeuchi

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

The maximum mean discrepancy and Wasserstein distance are popular distance measures between distributions and play important roles in many machine learning problems such as metric learning, generative modeling, domain adaption, and…

Machine Learning · Computer Science 2025-01-22 Dong Qiao , Jicong Fan

In order to detect unknown intrusions and runtime errors of computer programs, the cyber-security community has developed various detection techniques. Anomaly detection is an approach that is designed to profile the normal runtime behavior…

Cryptography and Security · Computer Science 2021-06-03 Byunggu Yu , Junwhan Kim

Detection of anomalies among a large number of processes is a fundamental task that has been studied in multiple research areas, with diverse applications spanning from spectrum access to cyber-security. Anomalous events are characterized…

Information Theory · Computer Science 2022-08-12 Benjamin Wolff , Tomer Gafni , Guy Revach , Nir Shlezinger , Kobi Cohen

Unsupervised anomaly detection (UAD) learns one-class classifiers exclusively with normal (i.e., healthy) images to detect any abnormal (i.e., unhealthy) samples that do not conform to the expected normal patterns. UAD has two main…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Yu Tian , Guansong Pang , Fengbei Liu , Yuanhong chen , Seon Ho Shin , Johan W. Verjans , Rajvinder Singh , Gustavo Carneiro

Among the variety of statistical intervals, highest-density regions (HDRs) stand out for their ability to effectively summarize a distribution or sample, unveiling its distinctive and salient features. An HDR represents the minimum size set…

Methodology · Statistics 2024-08-20 Nina Deliu , Brunero Liseo

In real-world applications, anomaly detection (AD) often operates without access to anomalous data, necessitating semi-supervised methods that rely solely on normal data. Among these methods, deep k-nearest neighbor (deep kNN) AD stands out…

Anomaly detection is defined as the problem of finding data points that do not follow the patterns of the majority. Among the various proposed methods for solving this problem, classification-based methods, including one-class Support…

Optimization and Control · Mathematics 2023-12-05 Amir Hossein Noormohammadia , Seyed Ali MirHassania , Farnaz Hooshmand Khaligh

Likelihood from a generative model is a natural statistic for detecting out-of-distribution (OoD) samples. However, generative models have been shown to assign higher likelihood to OoD samples compared to ones from the training…

Machine Learning · Computer Science 2019-10-22 Jiaming Song , Yang Song , Stefano Ermon

X-ray reflectivity (XRR) is widely used for thin-film structure analysis, and XRR data analysis involves minimizing the difference between an XRR curve calculated from model parameters describing the thin-film structure. This analysis takes…

Disordered Systems and Neural Networks · Physics 2022-03-31 Kook Tae Kim , Dong Ryeol Lee

The intrinsic dimensionality refers to the ``true'' dimensionality of the data, as opposed to the dimensionality of the data representation. For example, when attributes are highly correlated, the intrinsic dimensionality can be much lower…

Machine Learning · Statistics 2020-11-30 Erik Thordsen , Erich Schubert

Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typically lack a…

Machine Learning · Statistics 2022-06-09 Mingtian Zhang , Andi Zhang , Tim Z. Xiao , Yitong Sun , Steven McDonagh

We propose a completely unsupervised pixel-wise anomaly detection method for hyperspectral images. The proposed method consists of three steps called data preparation, reconstruction, and detection. In the data preparation step, we apply a…

Image and Video Processing · Electrical Eng. & Systems 2021-01-25 Sertac Arisoy , Nasser M. Nasrabadi , Koray Kayabol

We propose an anomaly detection technique for high-resolution X-ray spectroscopy. The method is based on the neural network architecture variational autoencoder, and requires only {\it normal} samples for training. We implement the network…

Instrumentation and Methods for Astrophysics · Physics 2019-06-12 Y. Ichinohe , S. Yamada