中文
相关论文

相关论文: Understanding normalization in contrastive represe…

200 篇论文

Detecting out-of-distribution (OOD) samples is essential when deploying machine learning models in open-world scenarios. Zero-shot OOD detection, requiring no training on in-distribution (ID) data, has been possible with the advent of…

机器学习 · 计算机科学 2024-06-04 Chentao Cao , Zhun Zhong , Zhanke Zhou , Yang Liu , Tongliang Liu , Bo Han

Due to the intractability of characterizing everything that looks unlike the normal data, anomaly detection (AD) is traditionally treated as an unsupervised problem utilizing only normal samples. However, it has recently been found that…

计算机视觉与模式识别 · 计算机科学 2023-01-29 Philipp Liznerski , Lukas Ruff , Robert A. Vandermeulen , Billy Joe Franks , Klaus-Robert Müller , Marius Kloft

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability…

机器学习 · 统计学 2019-09-27 Nilesh A. Ahuja , Ibrahima Ndiour , Trushant Kalyanpur , Omesh Tickoo

Standard machine learning is unable to accommodate inputs which do not belong to the training distribution. The resulting models often give rise to confident incorrect predictions which may lead to devastating consequences. This problem is…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Matej Grcić , Petra Bevandić , Zoran Kalafatić , Siniša Šegvić

Most deep-learning-based image classification methods assume that all samples are generated under an independent and identically distributed (IID) setting. However, out-of-distribution (OOD) generalization is more common in practice, which…

机器学习 · 计算机科学 2022-02-24 Xin Guo , Zhengxu Yu , Chao Xiang , Zhongming Jin , Jianqiang Huang , Deng Cai , Xiaofei He , Xian-Sheng Hua

In recent years, there have been significant improvements in various forms of image outlier detection. However, outlier detection performance under adversarial settings lags far behind that in standard settings. This is due to the lack of…

To classify in-distribution samples, deep neural networks explore strongly label-related information and discard weakly label-related information according to the information bottleneck. Out-of-distribution samples drawn from distributions…

机器学习 · 计算机科学 2023-08-29 Zhilin Zhao , Longbing Cao

Most of the existing methods for anomaly detection use only positive data to learn the data distribution, thus they usually need a pre-defined threshold at the detection stage to determine whether a test instance is an outlier.…

机器学习 · 计算机科学 2019-03-19 Kai Tian , Shuigeng Zhou , Jianping Fan , Jihong Guan

Deep learning systems deployed in real-world applications often encounter data that is different from their in-distribution (ID). A reliable model should ideally abstain from making decisions in this out-of-distribution (OOD) setting.…

机器学习 · 计算机科学 2025-10-02 Berker Demirel , Marco Fumero , Francesco Locatello

In this paper, we present a novel approach that combines deep metric learning and synthetic data generation using diffusion models for out-of-distribution (OOD) detection. One popular approach for OOD detection is outlier exposure, where…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Assefa Seyoum Wahd

It is an important problem in trustworthy machine learning to recognize out-of-distribution (OOD) inputs which are inputs unrelated to the in-distribution task. Many out-of-distribution detection methods have been suggested in recent years.…

机器学习 · 计算机科学 2022-06-22 Julian Bitterwolf , Alexander Meinke , Maximilian Augustin , Matthias Hein

We demonstrate that L2 normalization over feature space can produce capable performance for Out-of-Distribution (OoD) detection for some models and datasets. Although it does not demonstrate outright state-of-the-art performance, this…

机器学习 · 计算机科学 2024-02-02 Jarrod Haas , William Yolland , Bernhard Rabus

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

机器学习 · 计算机科学 2023-10-11 Yiyou Sun

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

机器学习 · 计算机科学 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

In the problem of out-of-distribution (OOD) detection, the usage of auxiliary data as outlier data for fine-tuning has demonstrated encouraging performance. However, previous methods have suffered from a trade-off between classification…

机器学习 · 计算机科学 2023-08-03 Hyunjun Choi , JaeHo Chung , Hawook Jeong , Jin Young Choi

Out-of-distribution (OOD) detection is the task of identifying data sampled from distributions that were not used during training. This task is essential for reliable machine learning and a better understanding of their generalization…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Kohei Fukuda , Hiroaki Aizawa

Deep neural networks have achieved great success in classification tasks during the last years. However, one major problem to the path towards artificial intelligence is the inability of neural networks to accurately detect samples from…

机器学习 · 计算机科学 2021-03-16 Aristotelis-Angelos Papadopoulos , Mohammad Reza Rajati , Nazim Shaikh , Jiamian Wang

Out-of-distribution (OOD) detection is crucial for the reliable deployment of machine learning models in real-world scenarios, enabling the identification of unknown samples or objects. A prominent approach to enhance OOD detection…

机器学习 · 统计学 2025-08-05 Heng Gao , Jun Li

Out-of-distribution (OOD) detection is a critical task for safe deployment of learning systems in the open world setting. In this work, we investigate the use of feature density estimation via normalizing flows for OOD detection and present…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Evan D. Cook , Marc-Antoine Lavoie , Steven L. Waslander

Recent studies have addressed the concern of detecting and rejecting the out-of-distribution (OOD) samples as a major challenge in the safe deployment of deep learning (DL) models. It is desired that the DL model should only be confident…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Umar Khalid , Ashkan Esmaeili , Nazmul Karim , Nazanin Rahnavard