中文
相关论文

相关论文: Guide the Learner: Controlling Product of Experts …

200 篇论文

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

机器学习 · 计算机科学 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Detecting out-of-distribution (OOD) instances is crucial for the reliable deployment of machine learning models in real-world scenarios. OOD inputs are commonly expected to cause a more uncertain prediction in the primary task; however,…

机器学习 · 计算机科学 2024-05-22 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Cinà

Out-of-distribution (OOD) detection is a critical task for ensuring the reliability and safety of deep neural networks in real-world scenarios. Different from most previous OOD detection methods that focus on designing OOD scores or…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Yao Zhu , YueFeng Chen , Chuanlong Xie , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , bolun zheng , Yaowu Chen

Deep neural classifiers trained with cross-entropy loss (CE loss) often suffer from poor calibration, necessitating the task of out-of-distribution (OOD) detection. Traditional supervised OOD detection methods require expensive manual…

计算与语言 · 计算机科学 2023-05-25 Dheeraj Mekala , Adithya Samavedhi , Chengyu Dong , Jingbo Shang

Out-of-distribution (OOD) detection is an essential approach to robustifying deep learning models, enabling them to identify inputs that fall outside of their trained distribution. Existing OOD detection methods usually depend on crafted…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Yifan Wu , Xichen Ye , Songmin Dai , Dengye Pan , Xiaoqiang Li , Weizhong Zhang , Yifan Chen

Due to the heterogeneity of real-world data, the widely accepted independent and identically distributed (IID) assumption has been criticized in recent studies on causality. In this paper, we argue that instead of being a questionable…

机器学习 · 计算机科学 2022-03-02 Jiqing Wu , Inti Zlobec , Maxime Lafarge , Yukun He , Viktor H. Koelzer

Deep Learning models possess two key traits that, in combination, make their use in the real world a risky prospect. One, they do not typically generalize well outside of the distribution for which they were trained, and two, they tend to…

机器学习 · 计算机科学 2021-09-29 Jonathan S. Kent , Bo Li

Deep learning models are increasingly deployed in safety-critical applications, where reliable out-of-distribution (OOD) detection is essential to ensure robustness. Existing methods predominantly rely on the penultimate-layer activations…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Shreen Gul , Mohamed Elmahallawy , Ardhendu Tripathy , Sanjay Madria

Out-of-distribution (OOD) detection is essential for determining when a supervised model encounters inputs that differ meaningfully from its training distribution. While widely studied in classification, OOD detection for regression and…

机器学习 · 统计学 2025-12-16 Min Lu , Hemant Ishwaran

Out-of-distribution (OOD) detection is critical to ensuring the reliability of deep learning applications and has attracted significant attention in recent years. A rich body of literature has emerged to develop efficient score functions…

机器学习 · 计算机科学 2025-07-22 Yuhang Liu , Yuefei Wu , Bin Shi , Bo Dong

Despite multiple efforts made towards robust machine learning (ML) models, their vulnerability to adversarial examples remains a challenging problem that calls for rethinking the defense strategy. In this paper, we take a step back and…

机器学习 · 计算机科学 2022-02-21 Abderrahmen Amich , Birhanu Eshete

This paper is concerned with self-supervised learning for small models. The problem is motivated by our empirical studies that while the widely used contrastive self-supervised learning method has shown great progress on large model…

计算机视觉与模式识别 · 计算机科学 2021-04-19 Zhiyuan Fang , Jianfeng Wang , Lijuan Wang , Lei Zhang , Yezhou Yang , Zicheng Liu

Real-world datasets often encode stereotypes and societal biases. Such biases can be implicitly captured by trained models, leading to biased predictions and exacerbating existing societal preconceptions. Existing debiasing methods, such as…

机器学习 · 计算机科学 2022-05-06 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Haoyue Bai

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Recent large vision-language models such as CLIP have shown remarkable out-of-distribution (OOD) detection and generalization performance. However, their zero-shot in-distribution (ID) accuracy is often limited for downstream datasets.…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Yifei Ming , Yixuan Li

Despite machine learning models' success in Natural Language Processing (NLP) tasks, predictions from these models frequently fail on out-of-distribution (OOD) samples. Prior works have focused on developing state-of-the-art methods for…

计算与语言 · 计算机科学 2021-11-30 Dyah Adila , Dongyeop Kang

While pretrained language models have exhibited impressive generalization capabilities, they still behave unpredictably under certain domain shifts. In particular, a model may learn a reasoning process on in-domain training data that does…

计算与语言 · 计算机科学 2022-10-14 Prasann Singhal , Jarad Forristal , Xi Ye , Greg Durrett

Several data augmentation methods deploy unlabeled-in-distribution (UID) data to bridge the gap between the training and inference of neural networks. However, these methods have clear limitations in terms of availability of UID data and…

机器学习 · 计算机科学 2021-11-23 Saehyung Lee , Changhwa Park , Hyungyu Lee , Jihun Yi , Jonghyun Lee , Sungroh Yoon

In offline reinforcement learning, the challenge of out-of-distribution (OOD) is pronounced. To address this, existing methods often constrain the learned policy through policy regularization. However, these methods often suffer from the…

机器学习 · 计算机科学 2024-07-16 Tenglong Liu , Yang Li , Yixing Lan , Hao Gao , Wei Pan , Xin Xu