English
Related papers

Related papers: Combining pre-trained Vision Transformers and CIDE…

200 papers

Out-of-distribution (OOD) detection has recently gained substantial attention due to the importance of identifying out-of-domain samples in reliability and safety. Although OOD detection methods have advanced by a great deal, they are still…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Mohammad Azizmalayeri , Arshia Soltani Moakhar , Arman Zarei , Reihaneh Zohrabi , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

When evaluating the performance of a pre-trained model transferred to a downstream task, it is imperative to assess not only the in-distribution (ID) accuracy of the downstream model but also its capacity to generalize and identify…

Machine Learning · Computer Science 2024-04-02 Andrew Geng , Pin-Yu Chen

Out-of-distribution (OOD) detection is critical to ensure the safe deployment of deep learning models in critical applications. Deep learning models can often misidentify OOD samples as in-distribution (ID) samples. This vulnerability…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Sudarshan Regmi

During the forward pass of Deep Neural Networks (DNNs), inputs gradually transformed from low-level features to high-level conceptual labels. While features at different layers could summarize the important factors of the inputs at varying…

Machine Learning · Computer Science 2022-03-02 Haoliang Wang , Chen Zhao , Xujiang Zhao , Feng Chen

This paper introduces a novel method leveraging bi-encoder-based detectors along with a comprehensive study comparing different out-of-distribution (OOD) detection methods in NLP using different feature extractors. The feature extraction…

Computation and Language · Computer Science 2024-03-14 Louis Owen , Biddwan Ahmed , Abhay Kumar

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

Detecting Out-of-Distribution (OOD) inputs is crucial for improving the reliability of deep neural networks in the real-world deployment. In this paper, inspired by the inherent distribution shift between ID and OOD data, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Ao Ke , Wenlong Chen , Chuanwen Feng , Yukun Cao , Xike Xie , S. Kevin Zhou , Lei Feng

Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models. However, existing methods largely ignore the reprogramming property of deep models and thus may not fully…

Machine Learning · Computer Science 2022-10-28 Qizhou Wang , Feng Liu , Yonggang Zhang , Jing Zhang , Chen Gong , Tongliang Liu , Bo Han

Out-of-Distribution (OOD) detection is critical for safely deploying deep models in open-world environments, where inputs may lie outside the training distribution. During inference on a model trained exclusively with In-Distribution (ID)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jiawei Gu , Ziyue Qiao , Zechao Li

Non-cooperative communications, where a receiver can automatically distinguish and classify transmitted signal formats prior to detection, are desirable for low-cost and low-latency systems. This work focuses on the deep learning enabled…

Signal Processing · Electrical Eng. & Systems 2019-11-15 Tongyang Xu , Izzat Darwazeh

LiDAR-based perception is critical for autonomous driving due to its robustness to poor lighting and visibility conditions. Yet, current models operate under the closed-set assumption and often fail to recognize unexpected…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Zizhao Li , Zhengkang Xiang , Jiayang Ao , Feng Liu , Joseph West , Kourosh Khoshelham

Learning robust vision models that perform well in out-of-distribution (OOD) situations is an important task for model deployment in real-world settings. Despite extensive research in this field, many proposed methods have only shown minor…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Gyuseong Lee , Wooseok Jang , Jinhyeon Kim , Jaewoo Jung , Seungryong Kim

Runtime monitoring provides a more realistic and applicable alternative to verification in the setting of real neural networks used in industry. It is particularly useful for detecting out-of-distribution (OOD) inputs, for which the network…

Machine Learning · Computer Science 2022-12-21 Vahid Hashemi , Jan Křetínsky , Sabine Rieder , Jessica Schmidt

Accessing machine learning models through remote APIs has been gaining prevalence following the recent trend of scaling up model parameters for increased performance. Even though these models exhibit remarkable ability, detecting…

Machine Learning · Computer Science 2024-08-20 Heeyoung Lee , Hoyoon Byun , Changdae Oh , JinYeong Bak , Kyungwoo Song

Out-of-distribution (OOD) detection has emerged as a popular technique to enhance the reliability of machine learning models by identifying unexpected inputs from unknown classes. Recent progress in pre-trained vision-language models (VLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yuanwei Hu , Bo Peng , Yadan Luo , Zhen Fang , Ling Chen , Jie Lu

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

Convolutional neural networks (CNNs) can learn directly from raw data, resulting in exceptional performance across various research areas. However, factors present in non-controllable environments such as unlabeled datasets with varying…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Lucas Fernando Alvarenga e Silva , Samuel Felipe dos Santos , Nicu Sebe , Jurandy Almeida

Machine learning (ML) has become increasingly popular in network intrusion detection. However, ML-based solutions always respond regardless of whether the input data reflects known patterns, a common issue across safety-critical…

Machine Learning · Computer Science 2023-08-29 Andrea Corsini , Shanchieh Jay Yang

By design, discriminatively trained neural network classifiers produce reliable predictions only for in-distribution samples. For their real-world deployments, detecting out-of-distribution (OOD) samples is essential. Assuming OOD to be…

Machine Learning · Computer Science 2019-10-11 Sachin Vernekar , Ashish Gaurav , Vahdat Abdelzad , Taylor Denouden , Rick Salay , Krzysztof Czarnecki

Deploying machine learning in open environments presents the challenge of encountering diverse test inputs that differ significantly from the training data. These out-of-distribution samples may exhibit shifts in local or global features…

Machine Learning · Computer Science 2024-03-19 Jiawei Li , Sitong Li , Shanshan Wang , Yicheng Zeng , Falong Tan , Chuanlong Xie