English
Related papers

Related papers: Learning Representations for Outlier Detection on …

200 papers

Offline reinforcement learning (RL) faces a critical challenge of overestimating the value of out-of-distribution (OOD) actions. Existing methods mitigate this issue by penalizing unseen samples, yet they fail to accurately identify OOD…

Machine Learning · Computer Science 2026-05-12 Qingjun Wang , Hongtu Zhou , Hang Yu , Junqiao Zhao , Yanping Zhao , Chen Ye , Ziqiao Wang , Guang Chen

Large language models (LLMs) struggle in knowledge-intensive tasks, as retrievers often overfit to surface similarity and fail on queries involving complex logical relations. The capacity for logical analysis is inherent in model…

Computation and Language · Computer Science 2026-02-03 Wenxuan Zhang , Yuan-Hao Jiang , Changyong Qi , Rui Jia , Yonghe Wu

Unsupervised Outlier Detection (UOD) is an important data mining task. With the advance of deep learning, deep Outlier Detection (OD) has received broad interest. Most deep UOD models are trained exclusively on clean datasets to learn the…

Machine Learning · Computer Science 2024-07-02 Yihong Huang , Yuang Zhang , Liping Wang , Fan Zhang , Xuemin Lin

We consider the problem of learning a binary classifier from $n$ different data sources, among which at most an $\eta$ fraction are adversarial. The overhead is defined as the ratio between the sample complexity of learning in this setting…

Machine Learning · Computer Science 2018-05-15 Mingda Qiao

Recent studies have addressed the concern of detecting and rejecting the out-of-distribution (OOD) samples as a major challenge in the safe deployment of deep learning (DL) models. It is desired that the DL model should only be confident…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Umar Khalid , Ashkan Esmaeili , Nazmul Karim , Nazanin Rahnavard

Out-of-distribution (OOD) detection is essential for deploying deep learning models reliably, yet no single method performs consistently across architectures and datasets -- a scorer that leads on one benchmark often falters on another. We…

Artificial Intelligence · Computer Science 2026-03-20 Jin Mo Yang , Hyung-Sin Kim , Saewoong Bahk

Outlier detection is an essential capability in safety-critical applications of supervised visual recognition. Most of the existing methods deliver best results by encouraging standard closed-set models to produce low-confidence predictions…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Anja Delić , Matej Grcić , Siniša Šegvić

Outlier detection refers to the identification of data points that deviate from a general data distribution. Existing unsupervised approaches often suffer from high computational cost, complex hyperparameter tuning, and limited…

Machine Learning · Computer Science 2022-08-26 Zheng Li , Yue Zhao , Xiyang Hu , Nicola Botta , Cezar Ionescu , George H. Chen

Anomaly detection (AD), separating anomalies from normal data, has many applications across domains, from security to healthcare. While most previous works were shown to be effective for cases with fully or partially labeled data, that…

Machine Learning · Computer Science 2022-08-08 Jinsung Yoon , Kihyuk Sohn , Chun-Liang Li , Sercan O. Arik , Chen-Yu Lee , Tomas Pfister

Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails…

Machine Learning · Computer Science 2014-01-27 Nico Goernitz , Marius Micha Kloft , Konrad Rieck , Ulf Brefeld

Outlier detection amounts to finding data points that differ significantly from the norm. Classic outlier detection methods are largely designed for single data type such as continuous or discrete. However, real world data is increasingly…

Machine Learning · Statistics 2016-08-18 Kien Do , Truyen Tran , Dinh Phung , Svetha Venkatesh

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Outlier ensemble methods have shown outstanding performance on the discovery of instances that are significantly different from the majority of the data. However, without the awareness of fairness, their applicability in the ethical…

Machine Learning · Computer Science 2021-03-18 Haoyu Liu , Fenglong Ma , Shibo He , Jiming Chen , Jing Gao

The ubiquity of edge devices has led to a growing amount of unlabeled data produced at the edge. Deep learning models deployed on edge devices are required to learn from these unlabeled data to continuously improve accuracy. Self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jiahe Shi , Yawen Wu , Dewen Zeng , Jun Tao , Jingtong Hu , Yiyu Shi

This paper presents a fast methodology, called ROBOUT, to identify outliers in a response variable conditional on a set of linearly related predictors, retrieved from a large granular dataset. ROBOUT is shown to be effective and…

Methodology · Statistics 2021-04-27 Matteo Farnè , Angelos Vouldis

Anomalies (or outliers) are prevalent in real-world empirical observations and potentially mask important underlying structures. Accurate identification of anomalous samples is crucial for the success of downstream data analysis tasks. To…

Machine Learning · Computer Science 2022-08-25 Ofir Lindenbaum , Yariv Aizenbud , Yuval Kluger

Support Vector Machines have been successfully used for one-class classification (OCSVM, SVDD) when trained on clean data, but they work much worse on dirty data: outliers present in the training data tend to become support vectors, and are…

Machine Learning · Computer Science 2022-12-29 Daniel Boiar , Thomas Liebig , Erich Schubert

Unsupervised pretraining, which learns a useful representation using a large amount of unlabeled data to facilitate the learning of downstream tasks, is a critical component of modern large-scale machine learning systems. Despite its…

Machine Learning · Statistics 2023-03-06 Jiawei Ge , Shange Tang , Jianqing Fan , Chi Jin

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

Offline preference-based reinforcement learning (PbRL) provides an effective way to overcome the challenges of designing reward and the high costs of online interaction. However, since labeling preference needs real-time human feedback,…

Machine Learning · Computer Science 2026-02-10 Xiao-Yin Liu , Guotao Li , Xiao-Hu Zhou , Zeng-Guang Hou