English
Related papers

Related papers: VLOD-TTA: Test-Time Adaptation of Vision-Language …

200 papers

Test-Time Adaptation (TTA) has emerged as a promising solution for adapting a source model to unseen medical sites using unlabeled test data, due to the high cost of data annotation. Existing TTA methods consider scenarios where data from…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Wei Li , Jingyang Zhang , Lihao Liu , Guoan Wang , Junjun He , Yang Chen , Lixu Gu

Vision-language models (VLMs) have gained widespread attention for their strong zero-shot capabilities across numerous downstream tasks. However, these models assume that each test image's class label is drawn from a predefined label set…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Yongguang Li , Jindong Li , Qi Wang , Qianli Xing , Runliang Niu , Shengsheng Wang , Menglin Yang

The development of large vision-language models, notably CLIP, has catalyzed research into effective adaptation techniques, with a particular focus on soft prompt tuning. Conjointly, test-time augmentation, which utilizes multiple augmented…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Maxime Zanella , Ismail Ben Ayed

The challenge of Out-Of-Distribution (OOD) robustness remains a critical hurdle towards deploying deep vision models. Vision-Language Models (VLMs) have recently achieved groundbreaking results. VLM-based open-vocabulary object detection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Prakash Chandra Chhipa , Kanjar De , Meenakshi Subhash Chippa , Rajkumar Saini , Marcus Liwicki

Language-based object detection (LOD) aims to align visual objects with language expressions. A large amount of paired data is utilized to improve LOD model generalizations. During the training process, recent studies leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuming Chen , Jiangyan Feng , Haodong Zhang , Lijun Gong , Feng Zhu , Rui Zhao , Qibin Hou , Ming-Ming Cheng , Yibing Song

Test-time adaptation (TTA) has increasingly been an important topic to efficiently tackle the cross-domain distribution shift at test time for medical images from different institutions. Previous TTA methods have a common limitation of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Hongzheng Yang , Cheng Chen , Meirui Jiang , Quande Liu , Jianfeng Cao , Pheng Ann Heng , Qi Dou

Domain adaptation has been extensively investigated in computer vision but still requires access to target data at the training time, which might be difficult to obtain in some uncommon conditions. In this paper, we present a new framework…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Mohammad Fahes , Tuan-Hung Vu , Andrei Bursuc , Patrick Pérez , Raoul de Charette

Enabling models to recognize vast open-world categories has been a longstanding pursuit in object detection. By leveraging the generalization capabilities of vision-language models, current open-world detectors can recognize a broader range…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yitong Chen , Wenhao Yao , Lingchen Meng , Sihong Wu , Zuxuan Wu , Yu-Gang Jiang

Prompt learning has been widely adopted to efficiently adapt vision-language models (VLMs), e.g. CLIP, for few-shot image classification. Despite their success, most prompt learning methods trade-off between classification accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Marc Lafon , Elias Ramzi , Clément Rambour , Nicolas Audebert , Nicolas Thome

Open-vocabulary object detection models allow users to freely specify a class vocabulary in natural language at test time, guiding the detection of desired objects. However, vocabularies can be overly broad or even mis-specified, hampering…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Mingxuan Liu , Tyler L. Hayes , Massimiliano Mancini , Elisa Ricci , Riccardo Volpi , Gabriela Csurka

Continual Test-Time Adaptation (CTTA) is crucial for deploying models in real-world applications with unseen, evolving target domains. Existing CTTA methods, however, often rely on source data or prototypes, limiting their applicability in…

As object detectors are increasingly deployed as black-box cloud services or pre-trained models with restricted access to the original training data, the challenge of zero-shot object-level out-of-distribution (OOD) detection arises. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Bin Zhang , Xiaoyang Qu , Guokuan Li , Jiguang Wan , Jianzong Wang

The promising zero-shot generalization of vision-language models such as CLIP has led to their adoption using prompt learning for numerous downstream tasks. Previous works have shown test-time prompt tuning using entropy minimization to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Jameel Hassan , Hanan Gani , Noor Hussein , Muhammad Uzair Khattak , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan

Test-time alignment (TTA) aims to adapt models to specific rewards during inference. However, existing methods tend to either under-optimise or over-optimise (reward hack) the target reward function. We propose Null-Text Test-Time Alignment…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Taehoon Kim , Henry Gouk , Timothy Hospedales

The goal of the challenge is to develop a test-time adaptation (TTA) method, which could adapt the model to gradually changing domains in video sequences for semantic segmentation task. It is based on a synthetic driving video dataset -…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Damian Sójka , Yuyang Liu , Dipam Goswami , Sebastian Cygert , Bartłomiej Twardowski , Joost van de Weijer

Despite weakly supervised object detection (WSOD) being a promising step toward evading strong instance-level annotations, its capability is confined to closed-set categories within a single training dataset. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jianghang Lin , Yunhang Shen , Bingquan Wang , Shaohui Lin , Ke Li , Liujuan Cao

Test-time adaptation (TTA) for large language models (LLMs) updates model parameters at inference time using signals available at deployment. This paper focuses on a common yet under-explored regime: unsupervised, sample-specific TTA, where…

Computation and Language · Computer Science 2026-02-11 Longhuan Xu , Cunjian Chen , Feng Yin

The integration of Vision-Language-Action (VLA) models into autonomous driving systems offers a unified framework for interpreting complex scenes and executing control commands. However, the necessity to incorporate historical multi-view…

Robotics · Computer Science 2026-03-30 Yiru Wang , Anqing Jiang , Shuo Wang , Yuwen Heng , Zichong Gu , Hao Sun

Segmenting images is critical for visual understanding but demands extensive pixel-level annotations. Foundational models have enabled new paradigms for predicting new classes guided by textual prompts, without annotations from the target…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Gabriele Rosi , Fabio Cermelli , Carlo Masone , Barbara Caputo

Test-Time Adaptation (TTA) methods are often computationally expensive, require a large amount of data for effective adaptation, or are brittle to hyperparameters. Based on a theoretical foundation of the geometry of the latent space, we…

Machine Learning · Computer Science 2026-05-12 Alexander Murphy , Michal Danilowski , Soumyajit Chatterjee , Abhirup Ghosh