中文
相关论文

相关论文: Domain Feature Collapse: Implications for Out-of-D…

200 篇论文

A neural network trained on a classification dataset often exhibits a higher vector norm of hidden layer features for in-distribution (ID) samples, while producing relatively lower norm values on unseen instances from out-of-distribution…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Jaewoo Park , Jacky Chen Long Chai , Jaeho Yoon , Andrew Beng Jin Teoh

In this paper, we focus on the out-of-distribution (OOD) generalization of self-supervised learning (SSL). By analyzing the mini-batch construction during the SSL training phase, we first give one plausible explanation for SSL having OOD…

机器学习 · 计算机科学 2025-05-23 Wenwen Qiang , Jingyao Wang , Zeen Song , Jiangmeng Li , Changwen Zheng

Identifying unexpected domain-shifted instances in natural language processing is crucial in real-world applications. Previous works identify the out-of-distribution (OOD) instance by leveraging a single global feature embedding to…

计算与语言 · 计算机科学 2024-03-20 Jinan Zou , Maihao Guo , Yu Tian , Yuhao Lin , Haiyao Cao , Lingqiao Liu , Ehsan Abbasnejad , Javen Qinfeng Shi

The recent achievements of Deep Learning rely on the test data being similar in distribution to the training data. In an ideal case, Deep Learning models would achieve Out-of-Distribution (OoD) Generalization, i.e. reliably make predictions…

图像与视频处理 · 电气工程与系统科学 2021-09-07 Antoine Sanner , Camila Gonzalez , Anirban Mukhopadhyay

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

机器学习 · 计算机科学 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Out-of-distribution (OOD) detection is a critical task for safe deployment of learning systems in the open world setting. In this work, we investigate the use of feature density estimation via normalizing flows for OOD detection and present…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Evan D. Cook , Marc-Antoine Lavoie , Steven L. Waslander

Out-of-distribution (OOD) detection is crucial for deploying robust and reliable machine-learning systems in open-world settings. Despite steady advances in OOD detectors, their interplay with modern training pipelines that maximize…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Gerhard Krumpl , Henning Avenhaus , Horst Possegger

A common explanation for the failure of out-of-distribution (OOD) generalization is that the model trained with empirical risk minimization (ERM) learns spurious features instead of invariant features. However, several recent studies…

机器学习 · 计算机科学 2023-10-31 Yongqiang Chen , Wei Huang , Kaiwen Zhou , Yatao Bian , Bo Han , James Cheng

We study the problem of out-of-distribution (o.o.d.) generalization where spurious correlations of attributes vary across training and test domains. This is known as the problem of correlation shift and has posed concerns on the reliability…

机器学习 · 计算机科学 2023-03-17 Yuhui Li , Zejia Wu , Chao Zhang , Hongyang Zhang

Object counting models suffer when deployed across domains with differing density variety, since density shifts are inherently task-relevant and violate standard domain adaptation assumptions. To address this, we propose a theoretical…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Zhuonan Liang , Dongnan Liu , Jianan Fan , Yaxuan Song , Qiang Qu , Runnan Chen , Yu Yao , Peng Fu , Weidong Cai

In self-supervised representation learning, a common idea behind most of the state-of-the-art approaches is to enforce the robustness of the representations to predefined augmentations. A potential issue of this idea is the existence of…

机器学习 · 计算机科学 2021-08-26 Tianyu Hua , Wenxiao Wang , Zihui Xue , Sucheng Ren , Yue Wang , Hang Zhao

Out-of-domain (OOD) detection for low-resource text classification is a realistic but understudied task. The goal is to detect the OOD cases with limited in-domain (ID) training data, since we observe that training data is often…

计算与语言 · 计算机科学 2019-09-13 Ming Tan , Yang Yu , Haoyu Wang , Dakuo Wang , Saloni Potdar , Shiyu Chang , Mo Yu

Machine learning models are commonly tested in-distribution (same dataset); performance almost always drops in out-of-distribution settings. For HRI research, the goal is often to develop generalized models. This makes domain generalization…

Out-of-distribution (OOD) detection methods have recently become more prominent, serving as a core element in safety-critical autonomous systems. One major purpose of OOD detection is to reject invalid inputs that could lead to…

机器学习 · 计算机科学 2025-10-08 Hong Yang , Qi Yu , Travis Desell

Deep detection approaches are powerful in controlled conditions, but appear brittle and fail when source models are used off-the-shelf on unseen domains. Most of the existing works on domain adaptation simplify the setting and access…

计算机视觉与模式识别 · 计算机科学 2022-09-02 F. Cappio Borlino , S. Polizzotto , B. Caputo , T. Tommasi

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Out-of-distribution (OOD) generalization poses a serious challenge for modern deep learning (DL). OOD data consists of test data that is significantly different from the model's training data. DL models that perform well on in-domain test…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Skylar E. Stolte , Kyle Volle , Aprinda Indahlastari , Alejandro Albizu , Adam J. Woods , Kevin Brink , Matthew Hale , Ruogu Fang

Out-of-distribution (OOD) detection is essential for determining when a supervised model encounters inputs that differ meaningfully from its training distribution. While widely studied in classification, OOD detection for regression and…

机器学习 · 统计学 2025-12-16 Min Lu , Hemant Ishwaran

Multimodal fusion, leveraging data like vision and language, is rapidly gaining traction. This enriched data representation improves performance across various tasks. Existing methods for out-of-distribution (OOD) detection, a critical area…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Jinglun Li , Xinyu Zhou , Kaixun Jiang , Lingyi Hong , Pinxue Guo , Zhaoyu Chen , Weifeng Ge , Wenqiang Zhang

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

机器学习 · 计算机科学 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo