中文
相关论文

相关论文: Understanding normalization in contrastive represe…

200 篇论文

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

机器学习 · 计算机科学 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

Recent object detectors have achieved impressive accuracy in identifying objects seen during training. However, real-world deployment often introduces novel and unexpected objects, referred to as out-of-distribution (OOD) objects, posing…

In supervised machine learning, the assumption that training data is labelled correctly is not always satisfied. In this paper, we investigate an instance of labelling error for classification tasks in which the dataset is corrupted with…

声音 · 计算机科学 2020-02-13 Turab Iqbal , Yin Cao , Qiuqiang Kong , Mark D. Plumbley , Wenwu Wang

Using the intuition that out-of-distribution data have lower likelihoods, a common approach for out-of-distribution detection involves estimating the underlying data distribution. Normalizing flows are likelihood-based generative models…

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

机器学习 · 计算机科学 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

We present a new methodology for detecting out-of-distribution (OOD) images by utilizing norms of the score estimates at multiple noise scales. A score is defined to be the gradient of the log density with respect to the input data. Our…

机器学习 · 计算机科学 2021-03-24 Ahsan Mahmood , Junier Oliva , Martin Styner

Likelihood from a generative model is a natural statistic for detecting out-of-distribution (OoD) samples. However, generative models have been shown to assign higher likelihood to OoD samples compared to ones from the training…

机器学习 · 计算机科学 2019-10-22 Jiaming Song , Yang Song , Stefano Ermon

Unsupervised out-of-distribution detection (OOD) seeks to identify out-of-domain data by learning only from unlabeled in-domain data. We present a novel approach for this task - Lift, Map, Detect (LMD) - that leverages recent advancement in…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Zhenzhen Liu , Jin Peng Zhou , Yufan Wang , Kilian Q. Weinberger

Even though auto-encoders (AEs) have the desirable property of learning compact representations without labels and have been widely applied to out-of-distribution (OoD) detection, they are generally still poorly understood and are used…

计算机视觉与模式识别 · 计算机科学 2023-02-09 Cosmin I. Bercea , Daniel Rueckert , Julia A. Schnabel

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

计算机视觉与模式识别 · 计算机科学 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

The task of out-of-distribution (OOD) detection is vital to realize safe and reliable operation for real-world applications. After the failure of likelihood-based detection in high dimensions had been shown, approaches based on the…

机器学习 · 计算机科学 2022-12-27 Genki Osada , Takahashi Tsubasa , Budrul Ahsan , Takashi Nishide

A serious problem in image classification is that a trained model might perform well for input data that originates from the same distribution as the data available for model training, but performs much worse for out-of-distribution (OOD)…

计算机视觉与模式识别 · 计算机科学 2021-12-07 Rajat Koner , Poulami Sinhamahapatra , Karsten Roscher , Stephan Günnemann , Volker Tresp

Detecting deepfakes has become a critical challenge in Computer Vision and Artificial Intelligence. Despite significant progress in detection techniques, generalizing them to open-set scenarios continues to be a persistent difficulty.…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Luca Maiano , Fabrizio Casadei , Irene Amerini

Out-of-distribution (OOD) detection can be used in deep learning-based applications to reject outlier samples from being unreliably classified by deep neural networks. Learning to classify between OOD and in-distribution samples is…

计算机视觉与模式识别 · 计算机科学 2023-01-31 Jaeyoung Kim , Seo Taek Kong , Dongbin Na , Kyu-Hwan Jung

As the use of machine learning continues to expand, the importance of ensuring its safety cannot be overstated. A key concern in this regard is the ability to identify whether a given sample is from the training distribution, or is an…

机器学习 · 计算机科学 2023-08-11 Nicola Franco , Daniel Korth , Jeanette Miriam Lorenz , Karsten Roscher , Stephan Guennemann

Existing out-of-distribution (OOD) detection methods are typically benchmarked on training sets with balanced class distributions. However, in real-world applications, it is common for the training sets to have long-tailed distributions. In…

计算机视觉与模式识别 · 计算机科学 2022-07-05 Haotao Wang , Aston Zhang , Yi Zhu , Shuai Zheng , Mu Li , Alex Smola , Zhangyang Wang

To facilitate reliable deployments of autonomous robots in the real world, Out-of-Distribution (OOD) detection capabilities are often required. A powerful approach for OOD detection is based on density estimation with Normalizing Flows…

机器人学 · 计算机科学 2023-11-14 Jianxiang Feng , Jongseok Lee , Simon Geisler , Stephan Gunnemann , Rudolph Triebel

Out-of-distribution (OOD) detection, crucial for reliable pattern classification, discerns whether a sample originates outside the training distribution. This paper concentrates on the high-dimensional features output by the final…

计算机视觉与模式识别 · 计算机科学 2024-05-06 Qiuyu Zhu , Yiwei He

This work addresses the task of self-supervised learning (SSL) on a long-tailed dataset that aims to learn balanced and well-separated representations for downstream tasks such as image classification. This task is crucial because the real…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Cuong Manh Hoang , Yeejin Lee , Byeongkeun Kang

For real-world language applications, detecting an out-of-distribution (OOD) sample is helpful to alert users or reject such unreliable samples. However, modern over-parameterized language models often produce overconfident predictions for…

计算与语言 · 计算机科学 2023-07-20 Jaeyoung Kim , Kyuheon Jung , Dongbin Na , Sion Jang , Eunbin Park , Sungchul Choi