中文
相关论文

相关论文: How Language Models Process Out-of-Distribution In…

200 篇论文

Implementing effective control mechanisms to ensure the proper functioning and security of deployed NLP models, from translation to chatbots, is essential. A key ingredient to ensure safe system behaviour is Out-Of-Distribution (OOD)…

计算与语言 · 计算机科学 2024-03-04 Maxime Darrin , Pablo Piantanida , Pierre Colombo

Out-of-distribution (OOD) detection is essential for building reliable AI systems, as models that produce outputs for invalid inputs cannot be trusted. Although deep learning (DL) is often assumed to outperform traditional machine learning…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Jihyeon Baek , Seunghoon Lee , Gitaek Kwon , Doohyun Park

Out-of-distribution (OOD) detection is crucial in many real-world applications. However, intelligent models are often trained solely on in-distribution (ID) data, leading to overconfidence when misclassifying OOD data as ID classes. In this…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Jiankang Chen , Tong Zhang , Wei-Shi Zheng , Ruixuan Wang

Accurate trajectory prediction is essential for the safe operation of autonomous vehicles in real-world environments. Even well-trained machine learning models may produce unreliable predictions due to discrepancies between training data…

机器人学 · 计算机科学 2025-04-24 Tongfe Guo , Taposh Banerjee , Rui Liu , Lili Su

Out of distribution (OOD) detection remains a critical challenge in malware classification due to the substantial intra family variability introduced by polymorphic and metamorphic malware variants. Most existing deep learning based malware…

密码学与安全 · 计算机科学 2025-12-22 Tosin Ige , Christopher Kiekintveld , Aritran Piplai , Asif Rahman , Olukunle Kolade , Sasidhar Kunapuli

Despite machine learning models' success in Natural Language Processing (NLP) tasks, predictions from these models frequently fail on out-of-distribution (OOD) samples. Prior works have focused on developing state-of-the-art methods for…

计算与语言 · 计算机科学 2021-11-30 Dyah Adila , Dongyeop Kang

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks. To mitigate these risks, existing detection methods are essential, yet they face two major challenges: generalization and…

密码学与安全 · 计算机科学 2026-01-28 Shuang Liang , Zhihao Xu , Jiaqi Weng , Jialing Tao , Hui Xue , Xiting Wang

Hallucination detection in large language models (LLMs) requires balancing accu racy, efficiency, and robustness to distribution shift. Black-box consistency methods are effective but demand repeated inference; single-pass white-box probes…

机器学习 · 计算机科学 2026-05-15 Siyang Yao , Erhu Feng , Yubin Xia

Diffusion large language models (dLLMs) offer a promising paradigm for parallel text generation, but in practice they face an accuracy-parallelism trade-off, where increasing tokens per forward (TPF) often degrades generation quality.…

计算与语言 · 计算机科学 2026-05-12 Haoyang Zhou , Li Kong , Shijie Ren , Xiting Wang , Shuang Liang , Guowei Wang , Zhenxuan Pan

Out-of-distribution (OOD) object detection is a critical task focused on detecting objects that originate from a data distribution different from that of the training data. In this study, we investigate to what extent state-of-the-art…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Sadia Ilyas , Ido Freeman , Matthias Rottmann

Out-of-distribution (OOD) detection in graphs is critical for ensuring model robustness in open-world and safety-sensitive applications. Existing graph OOD detection approaches typically train an in-distribution (ID) classifier on ID data…

机器学习 · 计算机科学 2025-05-20 Haoyan Xu , Zhengtao Yao , Ziyi Wang , Zhan Cheng , Xiyang Hu , Mengyuan Li , Yue Zhao

Machine learning algorithms typically assume independent and identically distributed samples in training and at test time. Much work has shown that high-performing ML classifiers can degrade significantly and provide overly-confident, wrong…

计算与语言 · 计算机科学 2023-03-09 Jie Ren , Jiaming Luo , Yao Zhao , Kundan Krishna , Mohammad Saleh , Balaji Lakshminarayanan , Peter J. Liu

Word embedding learning methods require a large number of occurrences of a word to accurately learn its embedding. However, out-of-vocabulary (OOV) words which do not appear in the training corpus emerge frequently in the smaller downstream…

计算与语言 · 计算机科学 2021-02-25 Gordon Buck , Andreas Vlachos

Applying machine learning to increasingly high-dimensional problems with sparse or biased training data increases the risk that a model is used on inputs outside its training domain. For such out-of-distribution (OOD) inputs, the model can…

机器学习 · 计算机科学 2025-03-10 Juniper Tyree , Andreas Rupp , Petri S. Clusius , Michael H. Boy

Natural Language Understanding (NLU) is a vital component of dialogue systems, and its ability to detect Out-of-Domain (OOD) inputs is critical in practical applications, since the acceptance of the OOD input that is unsupported by the…

计算与语言 · 计算机科学 2022-05-25 Yinhe Zheng , Guanyi Chen , Minlie Huang

Out-of-distribution (OOD) detection identifies test samples that differ from the training data, which is critical to ensuring the safety and reliability of machine learning (ML) systems. While a plethora of methods have been developed to…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Viet Duong , Qiong Wu , Zhengyi Zhou , Eric Zavesky , Jiahe Chen , Xiangzhou Liu , Wen-Ling Hsu , Huajie Shao

The reliability of artificial intelligence (AI) systems in open-world settings depends heavily on their ability to flag out-of-distribution (OOD) inputs unseen during training. Recent advances in large-scale vision-language models (VLMs)…

机器学习 · 计算机科学 2025-10-14 Faizul Rakib Sayem , Shahana Ibrahim

Detecting deepfakes has become a critical challenge in Computer Vision and Artificial Intelligence. Despite significant progress in detection techniques, generalizing them to open-set scenarios continues to be a persistent difficulty.…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Luca Maiano , Fabrizio Casadei , Irene Amerini

Out-of-distribution (OOD) detection is essential to prevent anomalous inputs from causing a model to fail during deployment. While improved OOD detection methods have emerged, they often rely on the final layer outputs and require a full…

计算机视觉与模式识别 · 计算机科学 2021-05-03 Ziqian Lin , Sreya Dutta Roy , Yixuan Li

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…