English
Related papers

Related papers: CRoFT: Robust Fine-Tuning with Concurrent Optimiza…

200 papers

Vision-Language Models (VLMs), such as CLIP, have demonstrated remarkable zero-shot out-of-distribution (OOD) detection capabilities, vital for reliable AI systems. Despite this promising capability, a comprehensive understanding of (1) why…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuxiao Lee , Xiaofeng Cao , Wei Ye , Jiangchao Yao , Jingkuan Song , Heng Tao Shen

Large code datasets have become increasingly accessible for pre-training source code models. However, for the fine-tuning phase, obtaining representative training data that fully covers the code distribution for specific downstream tasks…

Software Engineering · Computer Science 2023-10-31 Hossein Hajipour , Ning Yu , Cristian-Alexandru Staicu , Mario Fritz

Standard recognition approaches are unable to deal with novel categories at test time. Their overconfidence on the known classes makes the predictions unreliable for safety-critical applications such as healthcare or autonomous driving.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Lorenzo Li Lu , Giulia D'Ascenzi , Francesco Cappio Borlino , Tatiana Tommasi

In autonomous driving and robotics, ensuring road safety and reliable decision-making critically depends on out-of-distribution (OOD) segmentation. While numerous methods have been proposed to detect anomalous objects on the road,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Seungheon Song , Jaekoo Lee

Out-of-distribution (OOD) detection is crucial for ensuring the reliability of deep learning models in real-world applications. Existing methods typically focus on feature representations or output-space analysis, often assuming a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Mostafa ElAraby , Sabyasachi Sahoo , Yann Pequignot , Paul Novello , Liam Paull

Vision-language models (VLMs), such as CLIP, have demonstrated impressive zero-shot capabilities for various downstream tasks. Their performance can be further enhanced through few-shot prompt tuning methods. However, current studies…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zhi Zhou , Ming Yang , Jiang-Xin Shi , Lan-Zhe Guo , Yu-Feng Li

The advancement of object detection (OD) in open-vocabulary and open-world scenarios is a critical challenge in computer vision. This work introduces OmDet, a novel language-aware object detection architecture, and an innovative training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Tiancheng Zhao , Peng Liu , Kyusong Lee

Detecting out-of-distribution (OOD) data is crucial in real-world machine learning applications, particularly in safety-critical domains. Existing methods often leverage language information from vision-language models (VLMs) to enhance OOD…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Shu Zou , Xinyu Tian , Qinyu Zhao , Zhaoyuan Yang , Jing Zhang

Fine-tuning is becoming widely used for leveraging the power of pre-trained foundation models in new downstream tasks. While there are many successes of fine-tuning on various tasks, recent studies have observed challenges in the…

Machine Learning · Computer Science 2024-06-21 Yuji Roh , Qingyun Liu , Huan Gui , Zhe Yuan , Yujin Tang , Steven Euijong Whang , Liang Liu , Shuchao Bi , Lichan Hong , Ed H. Chi , Zhe Zhao

We focus on the challenge of out-of-distribution (OOD) detection in deep learning models, a crucial aspect in ensuring reliability. Despite considerable effort, the problem remains significantly challenging in deep learning models due to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yunhao Ge , Jie Ren , Jiaping Zhao , Kaifeng Chen , Andrew Gallagher , Laurent Itti , Balaji Lakshminarayanan

Vision-language models (VLMs) struggle in open-world applications, where out-of-distribution (OOD) concepts often trigger cross-modal alignment collapse and severely degrade zero-shot performance. We identify the root cause as modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jensen Zhang , Ningyuan Liu , Keze Wang

Recognizing out-of-distribution (OOD) samples is critical for machine learning systems deployed in the open world. The vast majority of OOD detection methods are driven by a single modality (e.g., either vision or language), leaving the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Yifei Ming , Ziyang Cai , Jiuxiang Gu , Yiyou Sun , Wei Li , Yixuan Li

Open-vocabulary object detection (OVD) models are considered to be Large Multi-modal Models (LMM), due to their extensive training data and a large number of parameters. Mainstream OVD models prioritize object coarse-grained category rather…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yuqi Ma , Mengyin Liu , Chao Zhu , Xu-Cheng Yin

With the emergence of pretrained vision-language models (VLMs), considerable efforts have been devoted to fine-tuning them for downstream tasks. Despite the progress made in designing efficient fine-tuning methods, such methods require…

Machine Learning · Computer Science 2024-06-04 Zhengbo Wang , Jian Liang , Ran He , Zilei Wang , Tieniu Tan

Supervised Fine-Tuning (SFT) followed by Reinforcement Learning (RL) is a standard post-training recipe for improving Large Language Models (LLM) reasoning, but why it works remains unclear. We revisit the common claim that ``SFT memorizes,…

Machine Learning · Computer Science 2026-05-12 Hangzhan Jin , Sitao Luan , Tianwei Ni , Sicheng Lyu , Guillaume Rabusseau , Reihaneh Rabbany , Doina Precup , Mohammad Hamdaqa

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

Out-of-distribution (OOD) detection represents a critical challenge in remote sensing applications, where reliable identification of novel or anomalous patterns is essential for autonomous monitoring, disaster response, and environmental…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Chenhao Wang , Yingrui Ji , Yu Meng , Yunjian Zhang , Yao Zhu

Out-of-distribution (OOD) detection is critical for safety-sensitive machine learning applications and has been extensively studied, yielding a plethora of methods developed in the literature. However, most studies for OOD detection did not…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Out-of-distribution (OOD) detection is essential for reliable and trustworthy machine learning. Recent multi-modal OOD detection leverages textual information from in-distribution (ID) class names for visual OOD detection, yet it currently…

Computation and Language · Computer Science 2023-10-13 Yi Dai , Hao Lang , Kaisheng Zeng , Fei Huang , Yongbin Li

Out-of-Distribution (OOD) detection is a critical task that has garnered significant attention. The emergence of CLIP has spurred extensive research into zero-shot OOD detection, often employing a training-free approach. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Haoran Xu , Yanlin Liu , Zizhao Tong , Jiaze Li , Kexue Fu , Yuyang Zhang , Longxiang Gao , Shuaiguang Li , Xingyu Li , Yanran Xu , Changwei Wang