中文
相关论文

相关论文: Pseudo-OOD training for robust language models

200 篇论文

For a machine learning model deployed in real world scenarios, the ability of detecting out-of-distribution (OOD) samples is indispensable and challenging. Most existing OOD detection methods focused on exploring advanced training skills or…

机器学习 · 计算机科学 2024-02-16 Chao Chen , Zhihang Fu , Kai Liu , Ze Chen , Mingyuan Tao , Jieping Ye

The quantification of uncertainty is important for the adoption of machine learning, especially to reject out-of-distribution (OOD) data back to human experts for review. Yet progress has been slow, as a balance must be struck between…

机器学习 · 计算机科学 2022-09-12 Derek Everett , Andre T. Nguyen , Luke E. Richards , Edward Raff

Out-of-distribution (OOD) detection is essential for determining when a supervised model encounters inputs that differ meaningfully from its training distribution. While widely studied in classification, OOD detection for regression and…

机器学习 · 统计学 2025-12-16 Min Lu , Hemant Ishwaran

In the realm of task-oriented dialogue systems, a robust intent detection mechanism must effectively handle malformed utterances encountered in real-world scenarios. This study presents a novel fine-tuning framework for large language…

计算与语言 · 计算机科学 2024-09-23 Bo Liu , Liming Zhan , Yujie Feng , Zexin Lu , Chengqiang Xie , Lei Xue , Albert Y. S. Lam , Xiao-Ming Wu

Detecting out-of-distribution (OOD) instances is crucial for the reliable deployment of machine learning models in real-world scenarios. OOD inputs are commonly expected to cause a more uncertain prediction in the primary task; however,…

机器学习 · 计算机科学 2024-05-22 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Cinà

Out-of-distribution (OOD) detection is indispensable for deploying reliable machine learning systems in real-world scenarios. Recent works, using auxiliary outliers in training, have shown good potential. However, they seldom concern the…

机器学习 · 计算机科学 2024-12-17 Yutian Lei , Luping Ji , Pei Liu

Detecting anomalies or out-of-distribution (OOD) samples is critical for maintaining the reliability and trustworthiness of machine learning systems. Recently, Large Language Models (LLMs) have demonstrated their effectiveness not only in…

机器学习 · 计算机科学 2025-02-17 Ruiyao Xu , Kaize Ding

Out-of-Distribution (OOD) detection is a crucial problem for the safe deployment of machine learning models identifying samples that fall outside of the training distribution, i.e. in-distribution data (ID). Most OOD works focus on the…

机器学习 · 计算机科学 2023-10-04 Soroush Seifi , Daniel Olmeda Reino , Nikolay Chumerin , Rahaf Aljundi

Accurate and explainable out-of-distribution (OOD) detection is required to use machine learning systems safely. Previous work has shown that feature distance to decision boundaries can be used to identify OOD data effectively. In this…

机器学习 · 计算机科学 2025-08-15 Maria Stoica , Francesco Leofante , Alessio Lomuscio

Detecting out-of-distribution (OOD) data is crucial in real-world machine learning applications, particularly in safety-critical domains. Existing methods often leverage language information from vision-language models (VLMs) to enhance OOD…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Shu Zou , Xinyu Tian , Qinyu Zhao , Zhaoyuan Yang , Jing Zhang

\noindent Out-of-distribution (OOD) detection is essential for the safe deployment of machine learning models. Extensive work has focused on devising various scoring functions for detecting OOD samples, while only a few studies focus on…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Yifan Ding , Xixi Liu , Jonas Unger , Gabriel Eilertsen

The application of machine learning in safety-critical systems requires a reliable assessment of uncertainty. However, deep neural networks are known to produce highly overconfident predictions on out-of-distribution (OOD) data. Even if…

机器学习 · 计算机科学 2022-10-19 Alexander Meinke , Julian Bitterwolf , Matthias Hein

Standard recognition approaches are unable to deal with novel categories at test time. Their overconfidence on the known classes makes the predictions unreliable for safety-critical applications such as healthcare or autonomous driving.…

计算机视觉与模式识别 · 计算机科学 2023-07-13 Lorenzo Li Lu , Giulia D'Ascenzi , Francesco Cappio Borlino , Tatiana Tommasi

We revisit the likelihood ratio between a pretrained large language model (LLM) and its finetuned variant as a criterion for out-of-distribution (OOD) detection. The intuition behind such a criterion is that, the pretrained LLM has the…

计算与语言 · 计算机科学 2025-03-07 Andi Zhang , Tim Z. Xiao , Weiyang Liu , Robert Bamler , Damon Wischik

Modern neural networks are known to give overconfident prediction for out-of-distribution inputs when deployed in the open world. It is common practice to leverage a surrogate outlier dataset to regularize the model during training, and…

机器学习 · 计算机科学 2024-02-27 Wenyu Jiang , Hao Cheng , Mingcai Chen , Chongjun Wang , Hongxin Wei

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

机器学习 · 计算机科学 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

机器学习 · 计算机科学 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Out-of-distribution (OOD) detection aims at identifying samples from unknown classes, playing a crucial role in trustworthy models against errors on unexpected inputs. Extensive research has been dedicated to exploring OOD detection in the…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Xue Jiang , Feng Liu , Zhen Fang , Hong Chen , Tongliang Liu , Feng Zheng , Bo Han

Detecting Out-of-distribution (OOD) inputs have been a critical issue for neural networks in the open world. However, the unstable behavior of OOD detection along the optimization trajectory during training has not been explored clearly. In…

机器学习 · 计算机科学 2023-03-03 Zhen Cheng , Fei Zhu , Xu-Yao Zhang , Cheng-Lin Liu

By design, discriminatively trained neural network classifiers produce reliable predictions only for in-distribution samples. For their real-world deployments, detecting out-of-distribution (OOD) samples is essential. Assuming OOD to be…

机器学习 · 计算机科学 2019-10-11 Sachin Vernekar , Ashish Gaurav , Vahdat Abdelzad , Taylor Denouden , Rick Salay , Krzysztof Czarnecki