中文
相关论文

相关论文: Defect-aware Hybrid Prompt Optimization via Progre…

200 篇论文

Anomaly detection (AD) identifies outliers for applications like defect and lesion detection. While CLIP shows promise for zero-shot AD tasks due to its strong generalization capabilities, its inherent Anomaly-Unawareness leads to limited…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Wenxin Ma , Xu Zhang , Qingsong Yao , Fenghe Tang , Chenxu Wu , Yingtai Li , Rui Yan , Zihang Jiang , S. Kevin Zhou

Test-time prompt tuning enhances zero-shot generalization of vision-language models but tends to ignore the relatedness among test samples during inference. Online test-time prompt tuning provides a simple way to leverage the information in…

机器学习 · 计算机科学 2025-01-29 Zehao Xiao , Shilin Yan , Jack Hong , Jiayin Cai , Xiaolong Jiang , Yao Hu , Jiayi Shen , Qi Wang , Cees G. M. Snoek

The performance of Visio-Language Transformers drops sharply when an input modality (e.g., image) is missing, because the model is forced to make predictions using incomplete information. Existing missing-aware prompt methods help reduce…

Zero-shot anomaly detection (ZSAD) aims to identify anomalies in unseen categories by leveraging CLIP's zero-shot capabilities to match text prompts with visual features. A key challenge in ZSAD is learning general prompts stably and…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Donghyeong Kim , Chaewon Park , Suhwan Cho , Hyeonjeong Lim , Minseok Kang , Jungho Lee , Sangyoun Lee

Large-scale vision-language models (VLMs), e.g., CLIP, learn broad visual concepts from tedious training data, showing superb generalization ability. Amount of prompt learning methods have been proposed to efficiently adapt the VLMs to…

计算机视觉与模式识别 · 计算机科学 2023-09-11 Hongyu Hu , Tiancheng Lin , Jie Wang , Zhenbang Sun , Yi Xu

Prompt learning has been widely adopted to efficiently adapt vision-language models (VLMs), e.g. CLIP, for few-shot image classification. Despite their success, most prompt learning methods trade-off between classification accuracy and…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Marc Lafon , Elias Ramzi , Clément Rambour , Nicolas Audebert , Nicolas Thome

Contrastive vision-language models like CLIP have shown great progress in transfer learning. In the inference stage, the proper text description, also known as prompt, needs to be carefully designed to correctly classify the given images.…

计算机视觉与模式识别 · 计算机科学 2022-08-23 Tony Huang , Jack Chu , Fangyun Wei

Vision-language models (VLMs), such as CLIP, have shown strong generalization under zero-shot settings, yet adapting them to downstream tasks with limited supervision remains a significant challenge. Existing multi-modal prompt learning…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Silin Cheng , Kai Han

Prompt learning is an effective way to exploit the potential of large-scale pre-trained foundational models. Continuous prompts parameterize context tokens in prompts by turning them into differentiable vectors. Deep continuous prompts…

机器学习 · 计算机科学 2025-01-03 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Jianxi Gao

Pre-trained vision-language models (e.g., CLIP) have shown promising zero-shot generalization in many downstream tasks with properly designed text prompts. Instead of relying on hand-engineered prompts, recent works learn prompts using the…

计算机视觉与模式识别 · 计算机科学 2022-09-16 Manli Shu , Weili Nie , De-An Huang , Zhiding Yu , Tom Goldstein , Anima Anandkumar , Chaowei Xiao

Precise optical inspection in industrial applications is crucial for minimizing scrap rates and reducing the associated costs. Besides merely detecting if a product is anomalous or not, it is crucial to know the distinct type of defect,…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Ylli Sadikaj , Hongkuan Zhou , Lavdim Halilaj , Stefan Schmid , Steffen Staab , Claudia Plant

Anomaly detection (AD) in 3D point clouds is crucial in a wide range of industrial applications, especially in various forms of precision manufacturing. Considering the industrial demand for reliable 3D AD, several methods have been…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Jiaxiang Wang , Haote Xu , Xiaolu Chen , Haodi Xu , Yue Huang , Xinghao Ding , Xiaotong Tu

Prompt learning has become one of the most efficient paradigms for adapting large pre-trained vision-language models to downstream tasks. Current state-of-the-art methods, like CoOp and ProDA, tend to adopt soft prompts to learn an…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Sifan Long , Zhen Zhao , Junkun Yuan , Zichang Tan , Jiangjiang Liu , Luping Zhou , Shengsheng Wang , Jingdong Wang

Adapting vision-language models to remote sensing imagery presents a fundamental challenge: both the visual and linguistic distributions of satellite data lie far outside natural image pretraining corpora. Despite this, prompting remains…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Harshith Kethavath , Weiming Hu

Monocular 3D object detection typically relies on pseudo-labeling techniques to reduce dependency on real-world annotations. Recent advances demonstrate that deterministic linguistic cues can serve as effective auxiliary weak supervision…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Chupeng Liu , Jiyong Rao , Shangquan Sun , Runkai Zhao , Weidong Cai

Pretrained vision-language models (VLMs) such as CLIP have shown impressive generalization capability in downstream vision tasks with appropriate text prompts. Instead of designing prompts manually, Context Optimization (CoOp) has been…

计算机视觉与模式识别 · 计算机科学 2023-02-15 Chengcheng Ma , Yang Liu , Jiankang Deng , Lingxi Xie , Weiming Dong , Changsheng Xu

Prompt engineering can significantly improve the performance of large language models (LLMs), with automated prompt optimization (APO) gaining significant attention due to the time-consuming and laborious nature of manual prompt design.…

计算与语言 · 计算机科学 2025-02-27 Wenxin Luo , Weirui Wang , Xiaopeng Li , Weibo Zhou , Pengyue Jia , Xiangyu Zhao

The zero-shot performance of object detectors degrades when tested on different modalities, such as infrared and depth. While recent work has explored image translation techniques to adapt detectors to new modalities, these methods are…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Heitor R. Medeiros , Atif Belal , Srikanth Muralidharan , Eric Granger , Marco Pedersoli

Pre-trained vision-language models like CLIP have remarkably adapted to various downstream tasks. Nonetheless, their performance heavily depends on the specificity of the input text prompts, which requires skillful prompt template…

机器学习 · 计算机科学 2024-10-22 Yingjun Du , Wenfang Sun , Cees G. M. Snoek

Vision language foundation models such as CLIP exhibit impressive zero-shot generalization yet remain vulnerable to spurious correlations across visual and textual modalities. Existing debiasing approaches often address a single modality…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Sunny Gupta , Shounak Das , Amit Sethi