English
Related papers

Related papers: Probabilistic Outlier Detection and Generation

200 papers

This paper presents an automated approach for providing ranked lists of outliers in observed demand to support analysts in network revenue management. Such network revenue management, e.g. for railway itineraries, needs accurate demand…

Physics and Society · Physics 2023-02-27 Nicola Rennie , Catherine Cleophas , Adam M. Sykulski , Florian Dost

We study the change detection problem with an unknown post-change distribution. Under this constraint, the unknown change in the distribution of observations may occur in many ways without much structure on the observations, whereas, before…

Signal Processing · Electrical Eng. & Systems 2020-12-11 Deniz Sargun , C. Emre Koksal

Deep neural networks have achieved great success in classification tasks during the last years. However, one major problem to the path towards artificial intelligence is the inability of neural networks to accurately detect samples from…

Machine Learning · Computer Science 2021-03-16 Aristotelis-Angelos Papadopoulos , Mohammad Reza Rajati , Nazim Shaikh , Jiamian Wang

The paper proposes a new latent variable model for the simultaneous (two-way) detection of outlying individuals and items for item-response-type data. The proposed model is a synergy between a factor model for binary responses and…

Methodology · Statistics 2021-10-25 Yunxiao Chen , Yan Lu , Irini Moustaki

Matrix-variate distributions are a recent addition to the model-based clustering field, thereby making it possible to analyze data in matrix form with complex structure such as images and time series. Due to its recent appearance, there is…

Machine Learning · Statistics 2025-08-04 Katharine M. Clark , Paul D. McNicholas

Transformers excel in natural language processing and computer vision tasks. However, they still face challenges in generalizing to Out-of-Distribution (OOD) datasets, i.e. data whose distribution differs from that seen during training. OOD…

Machine Learning · Computer Science 2026-01-30 Yijin Zhou , Yutang Ge , Wenyuan Xie , Linqian Zeng , Xiaowen Dong , Yuguang Wang

Likelihood-based generative models are a promising resource to detect out-of-distribution (OOD) inputs which could compromise the robustness or reliability of a machine learning system. However, likelihoods derived from such models have…

Machine Learning · Computer Science 2020-01-20 Joan Serrà , David Álvarez , Vicenç Gómez , Olga Slizovskaia , José F. Núñez , Jordi Luque

Euclidean embedding from noisy observations containing outlier errors is an important and challenging problem in statistics and machine learning. Many existing methods would struggle with outliers due to a lack of detection ability. In this…

Machine Learning · Statistics 2020-12-24 Qian Zhang , Xinyuan Zhao , Chao Ding

Collections of probability distributions arise in a variety of applications ranging from user activity pattern analysis to brain connectomics. In practice these distributions can be defined over diverse domain types including finite…

Methodology · Statistics 2023-06-16 Raif Rustamov , Subhabrata Majumdar

Out-of-distribution (OOD) detection is important for machine learning models deployed in the wild. Recent methods use auxiliary outlier data to regularize the model for improved OOD detection. However, these approaches make a strong…

Machine Learning · Computer Science 2022-06-30 Julian Katz-Samuels , Julia Nakhleh , Robert Nowak , Yixuan Li

Deep learning provides a powerful tool for machine perception when the observations resemble the training data. However, real-world robotic systems must react intelligently to their observations even in unexpected circumstances. This…

Machine Learning · Computer Science 2018-12-31 Rowan McAllister , Gregory Kahn , Jeff Clune , Sergey Levine

In this paper, we propose a new and unified approach for nonparametric regression and conditional distribution learning. Our approach simultaneously estimates a regression function and a conditional generator using a generative learning…

Machine Learning · Statistics 2023-06-28 Shanshan Song , Tong Wang , Guohao Shen , Yuanyuan Lin , Jian Huang

Machine learning and data analysis have been used in many robotics fields, especially for modelling. Data are usually the result of sensor measurements and, as such, they might be subjected to noise and outliers. The presence of outliers…

Robotics · Computer Science 2019-08-26 Francesco Cursi , Guang-Zhong Yang

We propose two new outlier detection methods, for identifying and classifying different types of outliers in (big) functional data sets. The proposed methods are based on an existing method called Massive Unsupervised Outlier Detection…

Methodology · Statistics 2021-10-15 Oluwasegun Taiwo Ojo , Antonio Fernández Anta , Rosa E. Lillo , Carlo Sguera

A multivariate dataset consists of $n$ cases in $d$ dimensions, and is often stored in an $n$ by $d$ data matrix. It is well-known that real data may contain outliers. Depending on the situation, outliers may be (a) undesirable errors which…

Methodology · Statistics 2019-10-08 Peter J. Rousseeuw , Wannes Van den Bossche

Notwithstanding the popularity of conventional clustering algorithms such as K-means and probabilistic clustering, their clustering results are sensitive to the presence of outliers in the data. Even a few outliers can compromise the…

Machine Learning · Statistics 2015-05-27 Pedro A. Forero , Vassilis Kekatos , Georgios B. Giannakis

Out-of-distribution (OOD) detection is crucial for developing trustworthy and reliable machine learning systems. Recent advances in training with auxiliary OOD data demonstrate efficacy in enhancing detection capabilities. Nonetheless,…

Machine Learning · Computer Science 2025-02-06 Hengzhuang Li , Teng Zhang

The increased success of Deep Learning (DL) has recently sparked large-scale deployment of DL models in many diverse industry segments. Yet, a crucial weakness of supervised model is the inherent difficulty in handling out-of-distribution…

Machine Learning · Computer Science 2021-07-15 Lixuan Yang , Dario Rossi

In this paper, we propose a novel approach for outlier detection, called local projections, which is based on concepts of Local Outlier Factor (LOF) (Breunig et al., 2000) and RobPCA (Hubert et al., 2005). By using aspects of both methods,…

After an autoencoder (AE) has learnt to reconstruct one dataset, it might be expected that the likelihood on an out-of-distribution (OOD) input would be low. This has been studied as an approach to detect OOD inputs. Recent work showed this…

Machine Learning · Computer Science 2021-07-29 Bang Xiang Yong , Tim Pearce , Alexandra Brintrup