English
Related papers

Related papers: Test for non-negligible adverse shifts

200 papers

Explaining outliers occurrence and mechanism of their occurrence can be extremely important in a variety of domains. Malfunctions, frauds, threats, in addition to being correctly identified, oftentimes need a valid explanation in order to…

Datasets for training recommender systems are often subject to distribution shift induced by users' and recommenders' selection biases. In this paper, we study the impact of selection bias on datasets with different quantization. We then…

Information Retrieval · Computer Science 2022-12-29 Fengyu Li , Sarah Dean

Bayesian statistics emphasizes the importance of prior distributions, yet finding an appropriate one is practically challenging. When multiple sample results are taken regarding the frequency of the same event, these samples may be…

Methodology · Statistics 2024-11-27 Yu-Fu Shen

Outlier hypothesis testing is studied in a universal setting. Multiple sequences of observations are collected, a small subset of which are outliers. A sequence is considered an outlier if the observations in that sequence are distributed…

Information Theory · Computer Science 2014-04-02 Yun Li , Sirin Nitinawarat , Venugopal V. Veeravalli

Detecting test-time distribution shift has emerged as a key capability for safely deployed machine learning models, with the question being tackled under various guises in recent years. In this paper, we aim to provide a consolidated view…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Hongjun Wang , Sagar Vaze , Kai Han

Anomaly detection (AD) is the machine learning task of identifying highly discrepant abnormal samples by solely relying on the consistency of the normal training samples. Under the constraints of a distribution shift, the assumption that…

Machine Learning · Computer Science 2023-12-25 João B. S. Carvalho , Mengtao Zhang , Robin Geyer , Carlos Cotrini , Joachim M. Buhmann

Recent studies give more attention to the anomaly detection (AD) methods that can leverage a handful of labeled anomalies along with abundant unlabeled data. These existing anomaly-informed AD methods rely on manually predefined score…

Machine Learning · Computer Science 2023-06-27 Minqi Jiang , Songqiao Han , Hailiang Huang

Given data with label noise (i.e., incorrect data), deep neural networks would gradually memorize the label noise and impair model performance. To relieve this issue, curriculum learning is proposed to improve model performance and…

Machine Learning · Computer Science 2022-08-23 Tingting Wu , Xiao Ding , Hao Zhang , Jinglong Gao , Li Du , Bing Qin , Ting Liu

Outlying observations, which significantly deviate from other measurements, may distort the conclusions of data analysis. Therefore, identifying outliers is one of the important problems that should be solved to obtain reliable results.…

Computation · Statistics 2014-05-01 Soo-Heang Eo , Seung-Mo Hong , HyungJun Cho

The recent, counter-intuitive discovery that deep generative models (DGMs) can frequently assign a higher likelihood to outliers has implications for both outlier detection applications as well as our overall understanding of generative…

Machine Learning · Statistics 2020-10-27 Ziyu Wang , Bin Dai , David Wipf , Jun Zhu

Outlier detection aims to identify unusual data instances that deviate from expected patterns. The outlier detection is particularly challenging when outliers are context dependent and when they are defined by unusual combinations of…

Artificial Intelligence · Computer Science 2015-05-18 Charmgil Hong , Milos Hauskrecht

Deep unsupervised anomaly detection has seen improvements in a supervised binary classification paradigm in which auxiliary external data is included in the training set as anomalous data in a process referred to as outlier exposure, which…

Machine Learning · Computer Science 2025-03-26 Sean Gloumeau

Advances in sensor technology have enabled the collection of large-scale datasets. Such datasets can be extremely noisy and often contain a significant amount of outliers that result from sensor malfunction or human operation faults. In…

Machine Learning · Computer Science 2018-08-28 Yu-Hsuan Kuo , Zhenhui Li , Daniel Kifer

Adversarial detection aims to determine whether a given sample is an adversarial one based on the discrepancy between natural and adversarial distributions. Unfortunately, estimating or comparing two data distributions is extremely…

Machine Learning · Computer Science 2023-05-26 Shuhai Zhang , Feng Liu , Jiahao Yang , Yifan Yang , Changsheng Li , Bo Han , Mingkui Tan

Classical change point analysis aims at (1) detecting abrupt changes in the mean of a possibly non-stationary time series and at (2) identifying regions where the mean exhibits a piecewise constant behavior. In many applications however, it…

Statistics Theory · Mathematics 2020-02-17 Axel Bücher , Holger Dette , Florian Heinrichs

This paper investigates differentially private analysis of distance-based outliers. The problem of outlier detection is to find a small number of instances that are apparently distant from the remaining instances. On the other hand, the…

Machine Learning · Statistics 2015-07-28 Rina Okada , Kazuto Fukuchi , Kazuya Kakizaki , Jun Sakuma

Deep convolutional models often produce inadequate predictions for inputs foreign to the training distribution. Consequently, the problem of detecting outlier images has recently been receiving a lot of attention. Unlike most previous work,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Petra Bevandić , Ivan Krešo , Marin Oršić , Siniša Šegvić

We consider the problem of transfer learning in outlier detection where target abnormal data is rare. While transfer learning has been considered extensively in traditional balanced classification, the problem of transfer in outlier…

Machine Learning · Computer Science 2025-01-06 Mohammadreza M. Kalan , Eitan J. Neugut , Samory Kpotufe

State-space models (SSMs) provide a flexible framework for modelling time series data, but their reliance on Gaussian error assumptions makes them highly sensitive to outliers. We propose a robust estimation method, ROAMS, that mitigates…

Methodology · Statistics 2025-11-20 Rajan Shankar , Ines Wilms , Jakob Raymaekers , Garth Tarr

Most of the existing methods for anomaly detection use only positive data to learn the data distribution, thus they usually need a pre-defined threshold at the detection stage to determine whether a test instance is an outlier.…

Machine Learning · Computer Science 2019-03-19 Kai Tian , Shuigeng Zhou , Jianping Fan , Jihong Guan