English
Related papers

Related papers: Beyond Human-prompting: Adaptive Prompt Tuning wit…

200 papers

Despite the impressive zero-shot capabilities of Vision-Language Models (VLMs), they often struggle in downstream tasks with distribution shifts from the pre-training data. Few-Shot Adaptation (FSA-VLM) has emerged as a key solution,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 SuBeen Lee , GilHan Park , WonJun Moon , Hyun Seok Seong , Jae-Pil Heo

To bridge the gap between vision and language modalities, Multimodal Large Language Models (MLLMs) usually learn an adapter that converts visual inputs to understandable tokens for Large Language Models (LLMs). However, most adapters…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Yue Zhang , Hehe Fan , Yi Yang

Vision-language models (VLMs) have made significant progress in image classification by training with large-scale paired image-text data. Their performances largely depend on the prompt quality. While recent methods show that visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Xiangyan Qu , Gaopeng Gou , Jiamin Zhuang , Jing Yu , Kun Song , Qihao Wang , Yili Li , Gang Xiong

Prompt tuning (PT), a parameter-efficient technique that only tunes the additional prompt embeddings while keeping the backbone pre-trained language model (PLM) frozen, has shown promising results in language understanding tasks, especially…

Computation and Language · Computer Science 2023-08-08 Mathieu Ravaut , Hailin Chen , Ruochen Zhao , Chengwei Qin , Shafiq Joty , Nancy Chen

Generating rare compositional concepts in text-to-image synthesis remains a challenge for diffusion models, particularly for attributes that are uncommon in the training data. While recent approaches, such as R2F, address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Kwanyoung Lee , Hyunwoo Oh , SeungJu Cha , Sungho Koh , Dong-Jin Kim

Large pre-trained vision-language models (VLMs), such as CLIP, demonstrate impressive generalization but remain highly vulnerable to adversarial examples (AEs). Previous work has explored robust text prompts through adversarial training,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Xiaojun Jia , Sensen Gao , Simeng Qin , Ke Ma , Xinfeng Li , Yihao Huang , Wei Dong , Yang Liu , Xiaochun Cao

The complexity and scale of IT systems are increasing dramatically, posing many challenges to real-world anomaly detection. Deep learning anomaly detection has emerged, aiming at feature learning and anomaly scoring, which has gained…

Machine Learning · Computer Science 2023-12-05 Xue Yang , Enda Howley , Micheal Schukat

Anomaly segmentation is essential for industrial quality, maintenance, and stability. Existing text-guided zero-shot anomaly segmentation models are effective but rely on fixed prompts, limiting adaptability in diverse industrial scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 SoYoung Park , Hyewon Lee , Mingyu Choi , Seunghoon Han , Jong-Ryul Lee , Sungsu Lim , Tae-Ho Kim

Anomaly detection (AD) in 3D point clouds is crucial in a wide range of industrial applications, especially in various forms of precision manufacturing. Considering the industrial demand for reliable 3D AD, several methods have been…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Jiaxiang Wang , Haote Xu , Xiaolu Chen , Haodi Xu , Yue Huang , Xinghao Ding , Xiaotong Tu

With growing public safety demands, text-based person anomaly search has emerged as a critical task, aiming to retrieve individuals with abnormal behaviors via natural language descriptions. Unlike conventional person search, this task…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Hao Ju , Hu Zhang , Zhedong Zheng

Prompt engineering is crucial for achieving reliable and effective outputs from large language models (LLMs), but its design requires specialized knowledge of prompting techniques and a deep understanding of target tasks. To address this…

Computation and Language · Computer Science 2025-10-22 Yohei Ikenoue , Hitomi Tashiro , Shigeru Kuroyanagi

Prompt learning has become a prevalent strategy for adapting vision-language foundation models (VLMs) such as CLIP to downstream tasks. With the emergence of large language models (LLMs), recent studies have explored the potential of using…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Yubin Wang , Xinyang Jiang , De Cheng , Wenli Sun , Dongsheng Li , Cairong Zhao

Prompt tuning, a recently emerging paradigm, enables the powerful vision-language pre-training models to adapt to downstream tasks in a parameter -- and data -- efficient way, by learning the ``soft prompts'' to condition frozen…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Juncheng Li , Minghe Gao , Longhui Wei , Siliang Tang , Wenqiao Zhang , Mengze Li , Wei Ji , Qi Tian , Tat-Seng Chua , Yueting Zhuang

Pretrained large language models (LLMs) are increasingly utilized across a wide range of natural language processing (NLP) tasks due to their impressive capabilities as few-shot learners. Recent techniques, such as chain-of-thought (CoT)…

Machine Learning · Computer Science 2024-12-02 Kamesh R

Automatic Speech Recognition (ASR) systems have found their use in numerous industrial applications in very diverse domains. Since domain-specific systems perform better than their generic counterparts on in-domain evaluation, the need for…

Computation and Language · Computer Science 2021-10-26 Saket Dingliwal , Ashish Shenoy , Sravan Bodapati , Ankur Gandhe , Ravi Teja Gadde , Katrin Kirchhoff

Prompt tuning (PT), as an emerging resource-efficient fine-tuning paradigm, has showcased remarkable effectiveness in improving the task-specific transferability of vision-language models. This paper delves into a previously overlooked…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Fei Zhang , Tianfei Zhou , Jiangchao Yao , Ya Zhang , Ivor W. Tsang , Yanfeng Wang

Recently, test-time adaptation has garnered attention as a method for tuning models without labeled data. The conventional modus operandi for adapting pre-trained vision-language models (VLMs) during test-time primarily focuses on tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Raza Imam , Asif Hanif , Jian Zhang , Khaled Waleed Dawoud , Yova Kementchedjhieva , Mohammad Yaqub

Prompt learning has become a prevalent strategy for adapting vision-language foundation models to downstream tasks. As large language models (LLMs) have emerged, recent studies have explored the use of category-related descriptions as input…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yubin Wang , Xinyang Jiang , De Cheng , Dongsheng Li , Cairong Zhao

Continual learning (CL) enables models to adapt to evolving data streams. A major challenge of CL is catastrophic forgetting, where new knowledge will overwrite previously acquired knowledge. Traditional methods usually retain the past data…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Baocai Yin , Ji Zhao , Huajie Jiang , Ningning Hou , Yongli Hu , Amin Beheshti , Ming-Hsuan Yang , Yuankai Qi

Recently, forecasting future abnormal events has emerged as an important scenario to tackle real-world necessities. However, the solution of predicting specific future time points when anomalies will occur, known as Anomaly Prediction (AP),…

Machine Learning · Computer Science 2025-07-01 Min-Yeong Park , Won-Jeong Lee , Seong Tae Kim , Gyeong-Moon Park