English
Related papers

Related papers: Test-Time Adaptation with CLIP Reward for Zero-Sho…

200 papers

Test-time adaptation paradigm provides flexibility towards domain shifts by performing immediate adaptation on unlabeled target data from the source model. Vision-Language Models (VLMs) leverage their generalization capabilities for diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Jisu Han , Wonjun Hwang

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations using large-scale image-text pairs. It shows impressive performance on downstream tasks by zero-shot knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Renrui Zhang , Zhang Wei , Rongyao Fang , Peng Gao , Kunchang Li , Jifeng Dai , Yu Qiao , Hongsheng Li

Recent strides in large language models (LLMs) have yielded remarkable performance, leveraging reinforcement learning from human feedback (RLHF) to significantly enhance generation and alignment capabilities. However, RLHF encounters…

Computation and Language · Computer Science 2024-05-31 Kuo Liao , Shuang Li , Meng Zhao , Liqun Liu , Mengge Xue , Zhenyu Hu , Honglin Han , Chengguo Yin

We consider the problem of zero-shot one-class visual classification, extending traditional one-class classification to scenarios where only the label of the target class is available. This method aims to discriminate between positive and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yassir Bendou , Giulia Lioi , Bastien Pasdeloup , Lukas Mauch , Ghouthi Boukli Hacene , Fabien Cardinaux , Vincent Gripon

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations by using large-scale contrastive image-text pairs. It shows impressive performance on zero-shot knowledge transfer to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Renrui Zhang , Rongyao Fang , Wei Zhang , Peng Gao , Kunchang Li , Jifeng Dai , Yu Qiao , Hongsheng Li

In this work, we present an unsupervised method for enhancing an image captioning model (in our case, BLIP2) using reinforcement learning and vision-language models like CLIP and BLIP2-ITM as reward models. The RL-tuned model is able to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Maksim Dzabraev , Alexander Kunitsyn , Andrei Ivaniuta

This study presents a control framework leveraging vision language models (VLMs) for multiple tasks and robots. Notably, existing control methods using VLMs have achieved high performance in various tasks and robots in the training…

Robotics · Computer Science 2024-01-19 Kazuki Shibata , Hideki Deguchi , Shun Taguchi

Gaze estimation methods often experience significant performance degradation when evaluated across different domains, due to the domain gap between the testing and training data. Existing methods try to address this issue using various…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Pengwei Yin , Guanzhong Zeng , Jingjing Wang , Di Xie

Generative vision-language models (VLMs) have shown impressive performance in zero-shot vision-language tasks like image captioning and visual question answering. However, improving their zero-shot reasoning typically requires second-stage…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Rongjie Li , Yu Wu , Xuming He

Large-scale vision-language models (VLMs), such as CLIP, have achieved remarkable success in zero-shot learning (ZSL) by leveraging large-scale visual-text pair datasets. However, these methods often lack interpretability, as they compute…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shiming Chen , Bowen Duan , Salman Khan , Fahad Shahbaz Khan

Vision-Language-Action (VLA) models have demonstrated remarkable capabilities and generalization in embodied manipulation. However, their decision-making relies on a fast, instinctive process that lacks deliberation. This strategy often…

Robotics · Computer Science 2026-05-29 Wenhao Li , Xiu Su , Yichao Cao , Hongyan Xu , Xiaobo Xia , Shan You , Yi Chen , Chang Xu

The performance of vision-language models (VLMs), such as CLIP, in visual classification tasks, has been enhanced by leveraging semantic knowledge from large language models (LLMs), including GPT. Recent studies have shown that in zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Hankyeol Lee , Gawon Seo , Wonseok Choi , Geunyoung Jung , Kyungwoo Song , Jiyoung Jung

Foundation Vision-Language Models (VLMs) like CLIP exhibit strong generalization capabilities due to large-scale pretraining on diverse image-text pairs. However, their performance often degrades when applied to target datasets with…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Debarshi Brahma , Soma Biswas

In natural language processing tasks, pure reinforcement learning (RL) fine-tuning methods often suffer from inefficient exploration and slow convergence; while supervised fine-tuning (SFT) methods, although efficient in training, have…

Computation and Language · Computer Science 2025-09-17 Min Zeng , Jingfei Sun , Xueyou Luo , Caiquan Liu , Shiqi Zhang , Li Xie , Xiaoxin Chen

One of the essential missions in the AI research community is to build an autonomous embodied agent that can achieve high-level performance across a wide spectrum of tasks. However, acquiring or manually designing rewards for all open-ended…

Machine Learning · Computer Science 2024-08-06 Haobin Jiang , Junpeng Yue , Hao Luo , Ziluo Ding , Zongqing Lu

Recent advancements in large-scale pre-training of visual-language models on paired image-text data have demonstrated impressive generalization capabilities for zero-shot tasks. Building on this success, efforts have been made to adapt…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Shahzad Ahmad , Sukalpa Chanda , Yogesh S Rawat

Visual language models (VLMs) rapidly progressed with the recent success of large language models. There have been growing efforts on visual instruction tuning to extend the LLM with visual inputs, but lacks an in-depth study of the visual…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Ji Lin , Hongxu Yin , Wei Ping , Yao Lu , Pavlo Molchanov , Andrew Tao , Huizi Mao , Jan Kautz , Mohammad Shoeybi , Song Han

In deep learning, test-time adaptation has gained attention as a method for model fine-tuning without the need for labeled data. A prime exemplification is the recently proposed test-time prompt tuning for large-scale vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Hee Suk Yoon , Eunseop Yoon , Joshua Tian Jin Tee , Mark Hasegawa-Johnson , Yingzhen Li , Chang D. Yoo

In this work, we propose a training-free method to inject visual prompts into Multimodal Large Language Models (MLLMs) through test-time optimization of a learnable latent variable. We observe that attention, as the core module of MLLMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Mingrui Wu , Xinyue Cai , Jiayi Ji , Jiale Li , Oucheng Huang , Gen Luo , Hao Fei , Guannan Jiang , Xiaoshuai Sun , Rongrong Ji

Accurate video moment retrieval (VMR) requires universal visual-textual correlations that can handle unknown vocabulary and unseen scenes. However, the learned correlations are likely either biased when derived from a limited amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Dezhao Luo , Jiabo Huang , Shaogang Gong , Hailin Jin , Yang Liu