English
Related papers

Related papers: Defect-aware Hybrid Prompt Optimization via Progre…

200 papers

Anomaly detection (AD) identifies outliers for applications like defect and lesion detection. While CLIP shows promise for zero-shot AD tasks due to its strong generalization capabilities, its inherent Anomaly-Unawareness leads to limited…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Wenxin Ma , Xu Zhang , Qingsong Yao , Fenghe Tang , Chenxu Wu , Yingtai Li , Rui Yan , Zihang Jiang , S. Kevin Zhou

Test-time prompt tuning enhances zero-shot generalization of vision-language models but tends to ignore the relatedness among test samples during inference. Online test-time prompt tuning provides a simple way to leverage the information in…

Machine Learning · Computer Science 2025-01-29 Zehao Xiao , Shilin Yan , Jack Hong , Jiayin Cai , Xiaolong Jiang , Yao Hu , Jiayi Shen , Qi Wang , Cees G. M. Snoek

The performance of Visio-Language Transformers drops sharply when an input modality (e.g., image) is missing, because the model is forced to make predictions using incomplete information. Existing missing-aware prompt methods help reduce…

Machine Learning · Computer Science 2025-11-18 Jueqing Lu , Yuanyuan Qi , Xiaohao Yang , Shuaicheng Niu , Fucai Ke , Shujie Zhou , Wei Tan , Jionghao Lin , Wray Buntine , Hamid Rezatofighi , Lan Du

Zero-shot anomaly detection (ZSAD) aims to identify anomalies in unseen categories by leveraging CLIP's zero-shot capabilities to match text prompts with visual features. A key challenge in ZSAD is learning general prompts stably and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Donghyeong Kim , Chaewon Park , Suhwan Cho , Hyeonjeong Lim , Minseok Kang , Jungho Lee , Sangyoun Lee

Large-scale vision-language models (VLMs), e.g., CLIP, learn broad visual concepts from tedious training data, showing superb generalization ability. Amount of prompt learning methods have been proposed to efficiently adapt the VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Hongyu Hu , Tiancheng Lin , Jie Wang , Zhenbang Sun , Yi Xu

Prompt learning has been widely adopted to efficiently adapt vision-language models (VLMs), e.g. CLIP, for few-shot image classification. Despite their success, most prompt learning methods trade-off between classification accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Marc Lafon , Elias Ramzi , Clément Rambour , Nicolas Audebert , Nicolas Thome

Contrastive vision-language models like CLIP have shown great progress in transfer learning. In the inference stage, the proper text description, also known as prompt, needs to be carefully designed to correctly classify the given images.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Tony Huang , Jack Chu , Fangyun Wei

Vision-language models (VLMs), such as CLIP, have shown strong generalization under zero-shot settings, yet adapting them to downstream tasks with limited supervision remains a significant challenge. Existing multi-modal prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Silin Cheng , Kai Han

Prompt learning is an effective way to exploit the potential of large-scale pre-trained foundational models. Continuous prompts parameterize context tokens in prompts by turning them into differentiable vectors. Deep continuous prompts…

Machine Learning · Computer Science 2025-01-03 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Jianxi Gao

Pre-trained vision-language models (e.g., CLIP) have shown promising zero-shot generalization in many downstream tasks with properly designed text prompts. Instead of relying on hand-engineered prompts, recent works learn prompts using the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Manli Shu , Weili Nie , De-An Huang , Zhiding Yu , Tom Goldstein , Anima Anandkumar , Chaowei Xiao

Precise optical inspection in industrial applications is crucial for minimizing scrap rates and reducing the associated costs. Besides merely detecting if a product is anomalous or not, it is crucial to know the distinct type of defect,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Ylli Sadikaj , Hongkuan Zhou , Lavdim Halilaj , Stefan Schmid , Steffen Staab , Claudia Plant

Anomaly detection (AD) in 3D point clouds is crucial in a wide range of industrial applications, especially in various forms of precision manufacturing. Considering the industrial demand for reliable 3D AD, several methods have been…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Jiaxiang Wang , Haote Xu , Xiaolu Chen , Haodi Xu , Yue Huang , Xinghao Ding , Xiaotong Tu

Prompt learning has become one of the most efficient paradigms for adapting large pre-trained vision-language models to downstream tasks. Current state-of-the-art methods, like CoOp and ProDA, tend to adopt soft prompts to learn an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Sifan Long , Zhen Zhao , Junkun Yuan , Zichang Tan , Jiangjiang Liu , Luping Zhou , Shengsheng Wang , Jingdong Wang

Adapting vision-language models to remote sensing imagery presents a fundamental challenge: both the visual and linguistic distributions of satellite data lie far outside natural image pretraining corpora. Despite this, prompting remains…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Harshith Kethavath , Weiming Hu

Monocular 3D object detection typically relies on pseudo-labeling techniques to reduce dependency on real-world annotations. Recent advances demonstrate that deterministic linguistic cues can serve as effective auxiliary weak supervision…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chupeng Liu , Jiyong Rao , Shangquan Sun , Runkai Zhao , Weidong Cai

Pretrained vision-language models (VLMs) such as CLIP have shown impressive generalization capability in downstream vision tasks with appropriate text prompts. Instead of designing prompts manually, Context Optimization (CoOp) has been…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Chengcheng Ma , Yang Liu , Jiankang Deng , Lingxi Xie , Weiming Dong , Changsheng Xu

Prompt engineering can significantly improve the performance of large language models (LLMs), with automated prompt optimization (APO) gaining significant attention due to the time-consuming and laborious nature of manual prompt design.…

Computation and Language · Computer Science 2025-02-27 Wenxin Luo , Weirui Wang , Xiaopeng Li , Weibo Zhou , Pengyue Jia , Xiangyu Zhao

The zero-shot performance of object detectors degrades when tested on different modalities, such as infrared and depth. While recent work has explored image translation techniques to adapt detectors to new modalities, these methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Heitor R. Medeiros , Atif Belal , Srikanth Muralidharan , Eric Granger , Marco Pedersoli

Pre-trained vision-language models like CLIP have remarkably adapted to various downstream tasks. Nonetheless, their performance heavily depends on the specificity of the input text prompts, which requires skillful prompt template…

Machine Learning · Computer Science 2024-10-22 Yingjun Du , Wenfang Sun , Cees G. M. Snoek

Vision language foundation models such as CLIP exhibit impressive zero-shot generalization yet remain vulnerable to spurious correlations across visual and textual modalities. Existing debiasing approaches often address a single modality…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Sunny Gupta , Shounak Das , Amit Sethi