中文
相关论文

相关论文: How Language Models Process Out-of-Distribution In…

200 篇论文

Deep neural networks (DNN) have outstanding performance in various applications. Despite numerous efforts of the research community, out-of-distribution (OOD) samples remain a significant limitation of DNN classifiers. The ability to…

机器学习 · 计算机科学 2023-03-27 Bartlomiej Olber , Krystian Radlak , Adam Popowicz , Michal Szczepankiewicz , Krystian Chachuła

It is an important problem in trustworthy machine learning to recognize out-of-distribution (OOD) inputs which are inputs unrelated to the in-distribution task. Many out-of-distribution detection methods have been suggested in recent years.…

机器学习 · 计算机科学 2022-06-22 Julian Bitterwolf , Alexander Meinke , Maximilian Augustin , Matthias Hein

Out-of-distribution (OOD) detection is a task that detects OOD samples during inference to ensure the safety of deployed models. However, conventional benchmarks have reached performance saturation, making it difficult to compare recent OOD…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Shiho Noda , Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

机器学习 · 计算机科学 2023-10-11 Yiyou Sun

Advancements in synthesized speech have created a growing threat of impersonation, making it crucial to develop deepfake algorithm recognition. One significant aspect is out-of-distribution (OOD) detection, which has gained notable…

音频与语音处理 · 电气工程与系统科学 2024-06-05 Renmingyue Du , Jixun Yao , Qiuqiang Kong , Yin Cao

Safety-critical applications like autonomous driving use Deep Neural Networks (DNNs) for object detection and segmentation. The DNNs fail to predict when they observe an Out-of-Distribution (OOD) input leading to catastrophic consequences.…

计算机视觉与模式识别 · 计算机科学 2022-11-14 Lokesh Veeramacheneni , Matias Valdenegro-Toro

Out-of-distribution (OOD) detection is committed to delineating the classification boundaries between in-distribution (ID) and OOD images. Recent advances in vision-language models (VLMs) have demonstrated remarkable OOD detection…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Zhixia He , Chen Zhao , Minglai Shao , Xintao Wu , Xujiang Zhao , Dong Li , Qin Tian , Linlin Yu

When deploying a trained machine learning model in the real world, it is inevitable to receive inputs from out-of-distribution (OOD) sources. For instance, in continual learning settings, it is common to encounter OOD samples due to the…

机器学习 · 计算机科学 2024-01-23 Chuanwen Feng , Wenlong Chen , Ao Ke , Yilong Ren , Xike Xie , S. Kevin Zhou

Small language models (SLMs) have been increasingly deployed in edge devices and other resource-constrained settings. However, these models make confident mispredictions and produce unstable output, making them risky for factual and…

人工智能 · 计算机科学 2026-04-07 Adeyemi Adeseye , Aisvarya Adeseye , Hannu Tenhunen , Jouni Isoaho

Transformers excel in natural language processing and computer vision tasks. However, they still face challenges in generalizing to Out-of-Distribution (OOD) datasets, i.e. data whose distribution differs from that seen during training. OOD…

机器学习 · 计算机科学 2026-01-30 Yijin Zhou , Yutang Ge , Wenyuan Xie , Linqian Zeng , Xiaowen Dong , Yuguang Wang

Detecting hallucinations in large language models is a critical open problem with significant implications for safety and reliability. While existing hallucination detection methods achieve strong performance in question-answering tasks,…

人工智能 · 计算机科学 2026-02-10 Litian Liu , Reza Pourreza , Yubing Jian , Yao Qin , Roland Memisevic

Current Transformer-based natural language understanding (NLU) models heavily rely on dataset biases, while failing to handle real-world out-of-distribution (OOD) instances. Many methods have been proposed to deal with this issue, but they…

计算与语言 · 计算机科学 2023-06-06 Xiaoyue Wang , Lijie Wang , Xin Liu , Suhang Wu , Jinsong Su , Hua Wu

Pre-trained vision-language models have exhibited remarkable abilities in detecting out-of-distribution (OOD) samples. However, some challenging OOD samples, which lie close to in-distribution (InD) data in image feature space, can still…

计算机视觉与模式识别 · 计算机科学 2025-08-22 Jinglun Li , Kaixun Jiang , Zhaoyu Chen , Bo Lin , Yao Tang , Weifeng Ge , Wenqiang Zhang

Robust prediction of molecular properties under extreme out-of-distribution (OOD) scenarios is a pivotal bottleneck in AI-driven drug discovery. Current scaffold-splitting protocols fail to obstruct microscopic semantic overlap,…

机器学习 · 计算机科学 2026-05-15 Zhuohao Lin , Kun Li , Jiameng Chen , Jiajun Yu , Duanhua Cao , Yizhen Zheng , Wenbin Hu

Understanding how latent representations evolve during generation is a central open problem in large language model interpretability. We introduce \textbf{Dynamical Manifold Evolution Theory} (DMET), a phenomenological framework that models…

计算与语言 · 计算机科学 2026-05-05 Yukun Zhang , Qi Dong , Mengkang Li

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

机器学习 · 计算机科学 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

In safety-critical Cyber-Physical Systems (CPS), accurate trajectory prediction provides vital guidance for downstream planning and control, yet although deep learning models achieve high-fidelity forecasts on validation data, their…

机器人学 · 计算机科学 2026-03-17 Tongfei Guo , Lili Su

Distinguishing in- and out-of-distribution (OOD) inputs is crucial for reliable deployment of classification systems. However, OOD data is typically unavailable or difficult to collect, posing a significant challenge for accurate OOD…

计算与语言 · 计算机科学 2025-10-03 Momin Abbas , Muneeza Azmat , Raya Horesh , Mikhail Yurochkin

Out-of-Distribution (OOD) detection is a cornerstone for the safe deployment of AI systems in the open world. However, existing methods treat OOD detection as a binary classification problem, a cognitive flattening that fails to distinguish…

机器学习 · 统计学 2025-10-16 Ningkang Peng , Yuzhe Mao , Yuhao Zhang , Linjin Qian , Qianfeng Yu , Yanhui Gu , Yi Chen , Li Kong

Learning with noisy labels (LNL) is typically benchmarked by closed-set classification accuracy, yet deployment often requires classifiers to reject out-of-distribution (OOD) inputs. We present a learner-agnostic ACC-OOD benchmark that…

机器学习 · 计算机科学 2026-05-19 Ningkang Peng , Jingyang Mao , Runhan Zhou , Peirong Ma , Yanhui Gu