English
Related papers

Related papers: Enhanced OoD Detection through Cross-Modal Alignme…

200 papers

Fine-tuned pre-trained language models can suffer from severe miscalibration for both in-distribution and out-of-distribution (OOD) data due to over-parameterization. To mitigate this issue, we propose a regularized fine-tuning method. Our…

Computation and Language · Computer Science 2020-10-23 Lingkai Kong , Haoming Jiang , Yuchen Zhuang , Jie Lyu , Tuo Zhao , Chao Zhang

Out-of-Distribution (OOD) detection is essential in real-world applications, which has attracted increasing attention in recent years. However, most existing OOD detection methods require many labeled In-Distribution (ID) data, causing a…

Machine Learning · Computer Science 2022-10-14 Yi-Xuan Sun , Wei Wang

Open-set semi-supervised learning (open-set SSL) investigates a challenging but practical scenario where out-of-distribution (OOD) samples are contained in the unlabeled data. While the mainstream technique seeks to completely filter out…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Junkai Huang , Chaowei Fang , Weikai Chen , Zhenhua Chai , Xiaolin Wei , Pengxu Wei , Liang Lin , Guanbin Li

Out-of-distribution (OOD) detection is a task that detects OOD samples during inference to ensure the safety of deployed models. However, conventional benchmarks have reached performance saturation, making it difficult to compare recent OOD…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Shiho Noda , Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Semantic communication is a promising technology for next-generation wireless networks. However, the out-of-distribution (OOD) problem, where a pre-trained machine learning (ML) model is applied to unseen tasks that are outside the…

Signal Processing · Electrical Eng. & Systems 2024-07-23 Feifan Zhang , Yuyang Du , Kexin Chen , Yulin Shao , Soung Chang Liew

We revisit the likelihood ratio between a pretrained large language model (LLM) and its finetuned variant as a criterion for out-of-distribution (OOD) detection. The intuition behind such a criterion is that, the pretrained LLM has the…

Computation and Language · Computer Science 2025-03-07 Andi Zhang , Tim Z. Xiao , Weiyang Liu , Robert Bamler , Damon Wischik

Large code datasets have become increasingly accessible for pre-training source code models. However, for the fine-tuning phase, obtaining representative training data that fully covers the code distribution for specific downstream tasks…

Software Engineering · Computer Science 2023-10-31 Hossein Hajipour , Ning Yu , Cristian-Alexandru Staicu , Mario Fritz

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

Machine Learning · Computer Science 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

Improving the accuracy of deep neural networks (DNNs) on out-of-distribution (OOD) data is critical to an acceptance of deep learning (DL) in real world applications. It has been observed that accuracies on in-distribution (ID) versus OOD…

Machine Learning · Computer Science 2022-07-12 Sara Fridovich-Keil , Brian R. Bartoldson , James Diffenderfer , Bhavya Kailkhura , Peer-Timo Bremer

Accurate de novo molecular and materials design requires structure-property models that generalize beyond known regimes. Although pretrained atomistic models achieve strong in-distribution accuracy after fine-tuning, their reliability under…

Computational Physics · Physics 2026-01-14 Chengqian Zhang , Duo Zhang , Anyang Peng , Mingyu Guo , Yuzhi Zhang , Lei Wang , Guolin Ke , Linfeng Zhang , Tiejun Li , Han Wang

Deep Learning models perform unreliably when the data comes from a distribution different from the training one. In critical applications such as medical imaging, out-of-distribution (OOD) detection methods help to identify such data…

Image and Video Processing · Electrical Eng. & Systems 2023-06-26 Anton Vasiliuk , Daria Frolova , Mikhail Belyaev , Boris Shirokikh

Detecting out-of-distribution (OOD) instances is significant for the safe deployment of NLP models. Among recent textual OOD detection works based on pretrained language models (PLMs), distance-based methods have shown superior performance.…

Computation and Language · Computer Science 2022-10-17 Sishuo Chen , Xiaohan Bi , Rundong Gao , Xu Sun

Biomedical segmentation networks easily suffer from the unexpected misclassification between foreground and background objects when learning on limited and imperfect medical datasets. Inspired by the strong power of Out-of-Distribution…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Yiquan Gao , Duohui Xu

Detecting out-of-distribution (OOD) data is a task that is receiving an increasing amount of research attention in the domain of deep learning for computer vision. However, the performance of detection methods is generally evaluated on the…

Machine Learning · Computer Science 2023-03-15 Guoxuan Xia , Christos-Savvas Bouganis

Out-of-distribution (OOD) detection is critical to ensure the safe deployment of deep learning models in critical applications. Deep learning models can often misidentify OOD samples as in-distribution (ID) samples. This vulnerability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Sudarshan Regmi

Applying machine learning to increasingly high-dimensional problems with sparse or biased training data increases the risk that a model is used on inputs outside its training domain. For such out-of-distribution (OOD) inputs, the model can…

Machine Learning · Computer Science 2025-03-10 Juniper Tyree , Andreas Rupp , Petri S. Clusius , Michael H. Boy

Out-of-distribution detection is a common issue in deploying vision models in practice and solving it is an essential building block in safety critical applications. Most of the existing OOD detection solutions focus on improving the OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Tomas Vojir , Jan Sochman , Rahaf Aljundi , Jiri Matas

Out-of-distribution (OOD) detection is crucial for the safe deployment of neural networks. Existing CLIP-based approaches perform OOD detection by devising novel scoring functions or sophisticated fine-tuning methods. In this work, we…

Computation and Language · Computer Science 2024-11-06 Yixia Li , Boya Xiong , Guanhua Chen , Yun Chen

LiDAR-based 3D object detection plays a critical role for reliable and safe autonomous driving systems. However, existing detectors often produce overly confident predictions for objects not belonging to known categories, posing significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Michael Kösel , Marcel Schreiber , Michael Ulrich , Claudius Gläser , Klaus Dietmayer