中文
相关论文

相关论文: Predicting Out-of-Distribution Error with Confiden…

200 篇论文

Neural networks have achieved impressive performance for data in the distribution which is the same as the training set but can produce an overconfident incorrect result for the data these networks have never seen. Therefore, it is…

机器学习 · 计算机科学 2022-08-22 Jinhong Lin

Pretrained Transformers achieve remarkable performance when training and test data are from the same distribution. However, in real-world scenarios, the model often faces out-of-distribution (OOD) instances that can cause severe semantic…

计算与语言 · 计算机科学 2022-01-24 Wenxuan Zhou , Fangyu Liu , Muhao Chen

We develop a statistical inference method for an optimal transport map between distributions on real numbers with uniform confidence bands. The concept of optimal transport (OT) is used to measure distances between distributions, and OT…

统计理论 · 数学 2024-02-16 Donlapark Ponnoprat , Ryo Okano , Masaaki Imaizumi

This paper addresses the limitations of standard uncertainty models, e.g., robust (norm-bounded) and stochastic (one fixed distribution, e.g., Gaussian), and proposes to model uncertainty via Optimal Transport (OT) ambiguity sets. These…

最优化与控制 · 数学 2023-09-08 Liviu Aolaritei , Nicolas Lanzetti , Hongruyu Chen , Florian Dörfler

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

机器学习 · 计算机科学 2023-12-05 Sergey Kolesnikov

Out-of-distribution (OOD) detection is a critical task for deploying machine learning models in the open world. Distance-based methods have demonstrated promise, where testing samples are detected as OOD if they are relatively far away from…

机器学习 · 计算机科学 2022-12-09 Yiyou Sun , Yifei Ming , Xiaojin Zhu , Yixuan Li

Out-of-distribution (OOD) learning often relies heavily on statistical approaches or predefined assumptions about OOD data distributions, hindering their efficacy in addressing multifaceted challenges of OOD generalization and OOD detection…

机器学习 · 计算机科学 2024-08-16 Haoyue Bai , Xuefeng Du , Katie Rainey , Shibin Parameswaran , Yixuan Li

Deep neural networks are known to be overconfident when applied to out-of-distribution (OOD) inputs which clearly do not belong to any class. This is a problem in safety-critical applications since a reliable assessment of the uncertainty…

机器学习 · 计算机科学 2021-03-11 Julian Bitterwolf , Alexander Meinke , Matthias Hein

In this work, we propose a novel machine learning approach to compute the optimal transport map between two continuous distributions from their unpaired samples, based on the DeepParticle methods. The proposed method leads to a min-min…

机器学习 · 统计学 2025-07-01 Yingyuan Li , Aokun Wang , Zhongjian Wang

Detecting Out-of-distribution (OOD) inputs have been a critical issue for neural networks in the open world. However, the unstable behavior of OOD detection along the optimization trajectory during training has not been explored clearly. In…

机器学习 · 计算机科学 2023-03-03 Zhen Cheng , Fei Zhu , Xu-Yao Zhang , Cheng-Lin Liu

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

机器学习 · 计算机科学 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

Identifying out-of-distribution (OOD) data at inference time is crucial for many machine learning applications, especially for automation. We present a novel unsupervised semi-parametric framework COMBOOD for OOD detection with respect to…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Magesh Rajasekaran , Md Saiful Islam Sajol , Frej Berglind , Supratik Mukhopadhyay , Kamalika Das

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

机器学习 · 计算机科学 2022-01-25 Jan Diers , Christian Pigorsch

Out-of-distribution (OOD) detection is crucial for deploying robust and reliable machine-learning systems in open-world settings. Despite steady advances in OOD detectors, their interplay with modern training pipelines that maximize…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Gerhard Krumpl , Henning Avenhaus , Horst Possegger

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

机器学习 · 计算机科学 2023-10-11 Yiyou Sun

Detecting out-of-distribution (OOD) data is crucial for ensuring the safe deployment of machine learning models in real-world applications. However, existing OOD detection approaches primarily rely on the feature maps or the full gradient…

计算机视觉与模式识别 · 计算机科学 2023-08-02 Sima Behpour , Thang Doan , Xin Li , Wenbin He , Liang Gou , Liu Ren

Being able to successfully determine whether the testing samples has similar distribution as the training samples is a fundamental question to address before we can safely deploy most of the machine learning models into practice. In this…

机器学习 · 计算机科学 2024-05-07 Zhaiming Shen , Menglun Wang , Guang Cheng , Ming-Jun Lai , Lin Mu , Ruihao Huang , Qi Liu , Hao Zhu

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

机器学习 · 计算机科学 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

Conditional Optimal Transport (COT) problem aims to find a transport map between conditional source and target distributions while minimizing the transport cost. Recently, these transport maps have been utilized in conditional generative…

机器学习 · 计算机科学 2026-03-13 Jiwoo Yoon , Kyumin Choi , Jaewoong Choi

Out-of-distribution (OOD) detection is crucial for the deployment of machine learning models in the open world. While existing OOD detectors are effective in identifying OOD samples that deviate significantly from in-distribution (ID) data,…

机器学习 · 计算机科学 2024-12-10 Hao Fu , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami