中文
相关论文

相关论文: Exploring Optimal Substructure for Out-of-distribu…

200 篇论文

Out-of-distribution (OOD) generalization is critical for machine learning models deployed in the real world. However, achieving this can be fundamentally challenging, as it requires the ability to learn invariant features across different…

机器学习 · 计算机科学 2024-11-05 Haoyue Bai , Yifei Ming , Julian Katz-Samuels , Yixuan Li

One of the challenges for neural networks in real-life applications is the overconfident errors these models make when the data is not from the original training distribution. Addressing this issue is known as Out-of-Distribution (OOD)…

计算机视觉与模式识别 · 计算机科学 2024-07-24 Sina Sharifi , Taha Entesari , Bardia Safaei , Vishal M. Patel , Mahyar Fazlyab

In this paper, we focus on the out-of-distribution (OOD) generalization of self-supervised learning (SSL). By analyzing the mini-batch construction during the SSL training phase, we first give one plausible explanation for SSL having OOD…

机器学习 · 计算机科学 2025-05-23 Wenwen Qiang , Jingyao Wang , Zeen Song , Jiangmeng Li , Changwen Zheng

Out-of-distribution (OOD) detection is committed to delineating the classification boundaries between in-distribution (ID) and OOD images. Recent advances in vision-language models (VLMs) have demonstrated remarkable OOD detection…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Zhixia He , Chen Zhao , Minglai Shao , Xintao Wu , Xujiang Zhao , Dong Li , Qin Tian , Linlin Yu

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Out-of-distribution (OOD) detection is essential when deploying neural networks in the real world. One main challenge is that neural networks often make overconfident predictions on OOD data. In this study, we propose an effective post-hoc…

计算机视觉与模式识别 · 计算机科学 2023-10-30 Zhuohao Sun , Yiqiao Qiu , Zhijun Tan , Weishi Zheng , Ruixuan Wang

Out-of-distribution (OOD) detection is essential for model trustworthiness which aims to sensitively identify semantic OOD samples and robustly generalize for covariate-shifted OOD samples. However, we discover that the superior OOD…

机器学习 · 计算机科学 2024-10-16 Qingyang Zhang , Qiuxuan Feng , Joey Tianyi Zhou , Yatao Bian , Qinghua Hu , Changqing Zhang

Harnessing the power of diffusion models to synthesize auxiliary training data based on latent space features has proven effective in enhancing out-of-distribution (OOD) detection performance. However, extracting effective features outside…

机器学习 · 计算机科学 2025-11-25 Qilin Liao , Shuo Yang , Bo Zhao , Ping Luo , Hengshuang Zhao

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

机器学习 · 计算机科学 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

Out-of-distribution (OOD) detection ensures safe and reliable model deployment. Contemporary OOD algorithms using geometry projection can detect OOD or adversarial samples from clean in-distribution (ID) samples. However, this setting…

机器学习 · 计算机科学 2025-08-26 Jeng-Lin Li , Ming-Ching Chang , Wei-Chao Chen

Few-shot Out-of-Distribution (OOD) detection has emerged as a critical research direction in machine learning for practical deployment. Most existing Few-shot OOD detection methods suffer from insufficient generalization capability for the…

计算机视觉与模式识别 · 计算机科学 2025-08-11 Pinxuan Li , Bing Cao , Changqing Zhang , Qinghua Hu

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

机器学习 · 计算机科学 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

Estimating the generalization performance is practically challenging on out-of-distribution (OOD) data without ground-truth labels. While previous methods emphasize the connection between distribution difference and OOD accuracy, we show…

机器学习 · 计算机科学 2023-10-24 Renchunzi Xie , Hongxin Wei , Lei Feng , Yuzhou Cao , Bo An

Out-of-Distribution (OOD) detection is critical for safely deploying deep models in open-world environments, where inputs may lie outside the training distribution. During inference on a model trained exclusively with In-Distribution (ID)…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Jiawei Gu , Ziyue Qiao , Zechao Li

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

机器学习 · 计算机科学 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

We expect the generalization error to improve with more samples from a similar task, and to deteriorate with more samples from an out-of-distribution (OOD) task. In this work, we show a counter-intuitive phenomenon: the generalization error…

机器学习 · 计算机科学 2023-07-20 Ashwin De Silva , Rahul Ramesh , Carey E. Priebe , Pratik Chaudhari , Joshua T. Vogelstein

Time-series forecasting (TSF) finds broad applications in real-world scenarios. Due to the dynamic nature of time-series data, it is crucial to equip TSF models with out-of-distribution (OOD) generalization abilities, as historical training…

机器学习 · 计算机科学 2024-06-14 Haoxin Liu , Harshavardhan Kamarthi , Lingkai Kong , Zhiyuan Zhao , Chao Zhang , B. Aditya Prakash

Deep learning models are increasingly deployed in safety-critical applications, where reliable out-of-distribution (OOD) detection is essential to ensure robustness. Existing methods predominantly rely on the penultimate-layer activations…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Shreen Gul , Mohamed Elmahallawy , Ardhendu Tripathy , Sanjay Madria

Deep neural networks (DNNs) are often constructed under the closed-world assumption, which may fail to generalize to the out-of-distribution (OOD) data. This leads to DNNs producing overconfident wrong predictions and can result in…

机器学习 · 统计学 2024-12-31 Yang Chen , Chih-Li Sung , Arpan Kusari , Xiaoyang Song , Wenbo Sun

Out-of-distribution (OOD) detection is essential to prevent anomalous inputs from causing a model to fail during deployment. While improved OOD detection methods have emerged, they often rely on the final layer outputs and require a full…

计算机视觉与模式识别 · 计算机科学 2021-05-03 Ziqian Lin , Sreya Dutta Roy , Yixuan Li