English
Related papers

Related papers: CRoFT: Robust Fine-Tuning with Concurrent Optimiza…

200 papers

Out-of-distribution (OOD) detection is critical for ensuring the reliability of open-world intelligent systems. Despite the notable advancements in existing OOD detection methodologies, our study identifies a significant performance drop…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jiuqing Dong , Yongbin Gao , Heng Zhou , Jun Cen , Yifan Yao , Sook Yoon , Park Dong Sun

Open-vocabulary object detection (OVD) aims to scale up vocabulary size to detect objects of novel categories beyond the training vocabulary. Recent work resorts to the rich knowledge in pre-trained vision-language models. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Peixian Chen , Kekai Sheng , Mengdan Zhang , Mingbao Lin , Yunhang Shen , Shaohui Lin , Bo Ren , Ke Li

Two prevalent types of distributional shifts in machine learning are the covariate shift (as observed across different domains) and the semantic shift (as seen across different classes). Traditional OOD detection techniques typically…

Artificial Intelligence · Computer Science 2023-09-20 Haoliang Wang , Chen Zhao , Yunhui Guo , Kai Jiang , Feng Chen

In the context of modern machine learning, models deployed in real-world scenarios often encounter diverse data shifts like covariate and semantic shifts, leading to challenges in both out-of-distribution (OOD) generalization and detection.…

Machine Learning · Computer Science 2024-09-30 Han Wang , Yixuan Li

With the availability of large pre-trained models, a modern workflow for building real-world machine learning solutions is to fine-tune such models on a downstream task with a relatively small domain-specific dataset. In such applications,…

Machine Learning · Computer Science 2024-05-28 Lu Tan , Huei Zhou , Yinxiang Huang , Zeming Zheng , Yujiu Yang

Out-of-distribution (OOD) detection remains challenging for deep learning models, particularly when test-time OOD samples differ significantly from training outliers. We propose OODD, a novel test-time OOD detection method that dynamically…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yifeng Yang , Lin Zhu , Zewen Sun , Hengyu Liu , Qinying Gu , Nanyang Ye

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

Machine Learning · Computer Science 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen

The task of out-of-distribution (OOD) detection is notoriously ill-defined. Earlier works focused on new-class detection, aiming to identify label-altering data distribution shifts, also known as "semantic shift." However, recent works…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 William Yang , Byron Zhang , Olga Russakovsky

Out-of-distribution (OOD) detection plays a vital role in enhancing the reliability of machine learning (ML) models. The emergence of large language models (LLMs) has catalyzed a paradigm shift within the ML community, showcasing their…

Computation and Language · Computer Science 2024-04-17 Bo Liu , Liming Zhan , Zexin Lu , Yujie Feng , Lei Xue , Xiao-Ming Wu

Vision-language models (VLMs) such as CLIP exhibit strong Out-of-distribution (OOD) detection capabilities by aligning visual and textual representations. Recent CLIP-based test-time adaptation methods further improve detection performance…

Computation and Language · Computer Science 2026-04-20 Jinlun Ye , Jiang Liao , Runhe Lai , Xinhua Lu , Jiaxin Zhuang , Zhiyong Gan , Ruixuan Wang

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

Machine Learning · Computer Science 2023-11-07 Reza Averly , Wei-Lun Chao

Out-of-distribution (OOD) detection plays a crucial role in ensuring the safety and reliability of deep neural networks in various applications. While there has been a growing focus on OOD detection in visual data, the field of textual OOD…

Computation and Language · Computer Science 2024-04-10 Li-Ming Zhan , Bo Liu , Xiao-Ming Wu

Accurate de novo molecular and materials design requires structure-property models that generalize beyond known regimes. Although pretrained atomistic models achieve strong in-distribution accuracy after fine-tuning, their reliability under…

Computational Physics · Physics 2026-01-14 Chengqian Zhang , Duo Zhang , Anyang Peng , Mingyu Guo , Yuzhi Zhang , Lei Wang , Guolin Ke , Linfeng Zhang , Tiejun Li , Han Wang

In the realm of task-oriented dialogue systems, a robust intent detection mechanism must effectively handle malformed utterances encountered in real-world scenarios. This study presents a novel fine-tuning framework for large language…

Computation and Language · Computer Science 2024-09-23 Bo Liu , Liming Zhan , Yujie Feng , Zexin Lu , Chengqiang Xie , Lei Xue , Albert Y. S. Lam , Xiao-Ming Wu

Inspired by the success of vision-language methods (VLMs) in zero-shot classification, recent works attempt to extend this line of work into object detection by leveraging the localization ability of pre-trained VLMs and generating pseudo…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Yanxin Long , Jianhua Han , Runhui Huang , Xu Hang , Yi Zhu , Chunjing Xu , Xiaodan Liang

Aiming at identifying unexpected inputs from unknown classes, out-of-distribution (OOD) detection has emerged as a pivotal approach to enhancing the reliability of machine learning models. This paper focuses on the burgeoning paradigm of…

Machine Learning · Computer Science 2026-05-25 Bo Peng , Jie Lu , Guangquan Zhang , Zhen Fang

Out-of-distribution (OOD) detection is committed to delineating the classification boundaries between in-distribution (ID) and OOD images. Recent advances in vision-language models (VLMs) have demonstrated remarkable OOD detection…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhixia He , Chen Zhao , Minglai Shao , Xintao Wu , Xujiang Zhao , Dong Li , Qin Tian , Linlin Yu

A straightforward pipeline for zero-shot out-of-distribution (OOD) detection involves selecting potential OOD labels from an extensive semantic pool and then leveraging a pre-trained vision-language model to perform classification on both…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Mengyuan Chen , Junyu Gao , Changsheng Xu

Detecting out-of-distribution (OOD) samples is crucial for ensuring the safety of machine learning systems and has shaped the field of OOD detection. Meanwhile, several other problems are closely related to OOD detection, including anomaly…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Atsuyuki Miyai , Jingkang Yang , Jingyang Zhang , Yifei Ming , Yueqian Lin , Qing Yu , Go Irie , Shafiq Joty , Yixuan Li , Hai Li , Ziwei Liu , Toshihiko Yamasaki , Kiyoharu Aizawa

Out-of-distribution (OOD) detection has seen significant advancements with zero-shot approaches by leveraging the powerful Vision-Language Models (VLMs) such as CLIP. However, prior research works have predominantly focused on enhancing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Pei-Kang Lee , Jun-Cheng Chen , Ja-Ling Wu