English
Related papers

Related papers: Class-Aware Prototype Learning with Negative Contr…

200 papers

Vision Transformer (ViT) is becoming more popular in image processing. Specifically, we investigate the effectiveness of test-time adaptation (TTA) on ViT, a technique that has emerged to correct its prediction during test-time by itself.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Takeshi Kojima , Yutaka Matsuo , Yusuke Iwasawa

Test-time adaptation with pre-trained vision-language models (VLMs) has attracted increasing attention for tackling the issue of distribution shift during the test phase. While prior methods have shown effectiveness in addressing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Baoshun Tong , Kaiyu Song , Hanjiang Lai

Test-time adaptation (TTA) methods have gained significant attention for enhancing the performance of vision-language models (VLMs) such as CLIP during inference, without requiring additional labeled data. However, current TTA researches…

Machine Learning · Computer Science 2025-10-14 Lijun Sheng , Jian Liang , Ran He , Zilei Wang , Tieniu Tan

Vision-language foundation models (VLMs), such as CLIP, exhibit remarkable performance across a wide range of tasks. However, deploying these models can be unreliable when significant distribution gaps exist between training and test data,…

Machine Learning · Computer Science 2025-09-29 Zongbo Han , Jialong Yang , Guangyu Wang , Junfan Li , Qianli Xu , Mike Zheng Shou , Changqing Zhang

Zero-shot learning (ZSL) has received increasing attention in recent years especially in areas of fine-grained object recognition, retrieval, and image captioning. The key to ZSL is to transfer knowledge from the seen to the unseen classes…

Machine Learning · Computer Science 2020-02-12 Zhizhe Liu , Xingxing Zhang , Zhenfeng Zhu , Shuai Zheng , Yao Zhao , Jian Cheng

The potential for zero-shot generalization in vision-language (V-L) models such as CLIP has spurred their widespread adoption in addressing numerous downstream tasks. Previous methods have employed test-time prompt tuning to adapt the model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Anant Khandelwal

Prompt tuning is a new few-shot transfer learning technique that only tunes the learnable prompt for pre-trained vision and language models such as CLIP. However, existing prompt tuning methods tend to learn spurious or entangled…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Xuehai He , Diji Yang , Weixi Feng , Tsu-Jui Fu , Arjun Akula , Varun Jampani , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Prompt learning has become one of the most efficient paradigms for adapting large pre-trained vision-language models to downstream tasks. Current state-of-the-art methods, like CoOp and ProDA, tend to adopt soft prompts to learn an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Sifan Long , Zhen Zhao , Junkun Yuan , Zichang Tan , Jiangjiang Liu , Luping Zhou , Shengsheng Wang , Jingdong Wang

Vision-Language Models (VLMs) have become prominent in open-world image recognition for their strong generalization abilities. Yet, their effectiveness in practical applications is compromised by domain shifts and distributional changes,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Qiyuan Dai , Sibei Yang

Vision-Language Pre-Trained (VLP) models, such as CLIP, have demonstrated remarkable effectiveness in learning generic visual representations. Several approaches aim to efficiently adapt VLP models to downstream tasks with limited…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Yi Zhang , Ce Zhang

Although deep learning-based segmentation models have achieved impressive performance on public benchmarks, generalizing well to unseen environments remains a major challenge. To improve the model's generalization ability to the new domain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Yunlong Zhang , Yuxuan Sun , Sunyi Zheng , Zhongyi Shui , Chenglu Zhu , Lin Yang

Vision-Language Models (VLMs) are essential for multimodal tasks, especially compositional reasoning (CR) tasks, which require distinguishing fine-grained semantic differences between visual and textual embeddings. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Xin Huang , Ruibin Li , Tong Jia , Wei Zheng , Ya Wang

Deep learning models have demonstrated exceptional performance across a wide range of computer vision tasks. However, their performance often degrades significantly when faced with distribution shifts, such as domain or dataset changes.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Samuel Barbeau , Pedram Fekri , David Osowiechi , Ali Bahri , Moslem Yazdanpanah , Masih Aminbeidokhti , Christian Desrosiers

Real-world application models are commonly deployed in dynamic environments, where the target domain distribution undergoes temporal changes. Continual Test-Time Adaptation (CTTA) has recently emerged as a promising technique to gradually…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Shilei Cao , Juepeng Zheng , Yan Liu , Baoquan Zhao , Ziqi Yuan , Weijia Li , Runmin Dong , Haohuan Fu

In this paper, we study a practical but less-touched problem in Vision-Language Models (VLMs), \ie, negation understanding. Specifically, many real-world applications require models to explicitly identify what is false or non-existent, \eg,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Haochen Han , Alex Jinpeng Wang , Fangming Liu , Jun Zhu

Large-scale vision-language models (LVLMs) pretrained on massive image-text pairs have achieved remarkable success in visual representations. However, existing paradigms to transfer LVLMs to downstream tasks encounter two primary…

Multimedia · Computer Science 2023-08-01 Chunjin Yang , Fanman Meng , Shuai Chen , Mingyu Liu , Runtong Zhang

In Zero-Shot Learning (ZSL), embedding-based methods enable knowledge transfer from seen to unseen classes by learning a visual-semantic mapping from seen-class images to class-level semantic prototypes (e.g., attributes). However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Lei Wang , Shiming Chen , Guo-Sen Xie , Ziming Hong , Chaojian Yu , Qinmu Peng , Xinge You

Vision-language models (VLMs) encounter considerable challenges when adapting to domain shifts stemming from changes in data distribution. Test-time adaptation (TTA) has emerged as a promising approach to enhance VLM performance under such…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chenyu Zhang , Kunlun Xu , Zichen Liu , Yuxin Peng , Jiahuan Zhou

Text understanding often suffers from domain shifts. To handle testing domains, domain adaptation (DA) is trained to adapt to a fixed and observed testing domain; a more challenging paradigm, test-time adaptation (TTA), cannot access the…

Computation and Language · Computer Science 2026-01-05 Tianlun Liu , Zhiliang Tian , Zhen Huang , Xingzhi Zhou , Wanlong Yu , Tianle Liu , Feng Liu , Dongsheng Li

Vision-language models (VLMs) like CLIP have demonstrated remarkable applicability across a variety of downstream tasks, including zero-shot image classification. Recently, the use of prompts or adapters for efficient transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Yongjin Yang , Jongwoo Ko , Se-Young Yun