English
Related papers

Related papers: Diffusion-Enhanced Test-time Adaptation with Text …

200 papers

Vision-language models (VLMs) such as CLIP exhibit strong zero-shot generalization but remain sensitive to domain shifts at test time. Test-time prompt tuning (TPT) mitigates this issue by adapting prompts with fixed augmentations, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yuqing Lei , Yingjun Du , Yawen Huang , Xiantong Zhen , Ling Shao

The development of large vision-language models, notably CLIP, has catalyzed research into effective adaptation techniques, with a particular focus on soft prompt tuning. Conjointly, test-time augmentation, which utilizes multiple augmented…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Maxime Zanella , Ismail Ben Ayed

Test-Time Prompt Tuning (TPT) adapts vision-language models using augmented views, but its effectiveness is hindered by the challenge of determining which views are beneficial. Standard entropy-based filtering relies on the internal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Jungwon Choi , Eunwoo Kim

We investigate a general approach for improving user prompts in text-to-image (T2I) diffusion models by finding prompts that maximize a reward function specified at test-time. Although diverse reward models are used for evaluating image…

Machine Learning · Computer Science 2025-09-30 Semin Kim , Yeonwoo Cha , Jaehoon Yoo , Seunghoon Hong

We introduce Train/Test-Time Adaptation with Retrieval (${\rm T^3AR}$), a method to adapt models both at train and test time by means of a retrieval module and a searchable pool of external samples. Before inference, ${\rm T^3AR}$ adapts a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Luca Zancato , Alessandro Achille , Tian Yu Liu , Matthew Trager , Pramuditha Perera , Stefano Soatto

Convolutional Neural Networks (ConvNets) are trained offline using the few available data and may therefore suffer from substantial accuracy loss when ported on the field, where unseen input patterns received under unpredictable external…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Luca Mocerino , Roberto G. Rizzo , Valentino Peluso , Andrea Calimera , Enrico Macii

Text-to-image generative models, specifically those based on diffusion models like Imagen and Stable Diffusion, have made substantial advancements. Recently, there has been a surge of interest in the delicate refinement of text prompts.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Wenyi Mo , Tianyu Zhang , Yalong Bai , Bing Su , Ji-Rong Wen , Qing Yang

Test-time adaptation with pre-trained vision-language models (VLMs) has attracted increasing attention for tackling the issue of distribution shift during the test phase. While prior methods have shown effectiveness in addressing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Baoshun Tong , Kaiyu Song , Hanjiang Lai

Data augmentation has been established as an efficacious approach to supplement useful information for low-resource datasets. Traditional augmentation techniques such as noise injection and image transformations have been widely used. In…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Yuwei Yin , Jean Kaddour , Xiang Zhang , Yixin Nie , Zhenguang Liu , Lingpeng Kong , Qi Liu

Distribution shift widely exists in medical images acquired from different medical centres and poses a significant obstacle to deploying the pre-trained semantic segmentation model in real-world applications. Test-time adaptation has proven…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Ziyang Chen , Yongsheng Pan , Yiwen Ye , Mengkang Lu , Yong Xia

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jaeseok Lee , Jaekoo Lee

An unresolved problem in Deep Learning is the ability of neural networks to cope with domain shifts during test-time, imposed by commonly fixing network parameters after training. Our proposed method Meta Test-Time Training (MT3), however,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Alexander Bartler , Andre Bühler , Felix Wiewel , Mario Döbler , Bin Yang

Test-Time Adaptation (TTA) methods improve the robustness of deep neural networks to domain shift on a variety of tasks such as image classification or segmentation. This work explores adapting segmentation models to a single unlabelled…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Klara Janouskova , Tamir Shor , Chaim Baskin , Jiri Matas

Vision-language models have showcased impressive zero-shot classification capabilities when equipped with suitable text prompts. Previous studies have shown the effectiveness of test-time prompt tuning; however, these methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Yuhan Zhu , Guozhen Zhang , Chen Xu , Haocheng Shen , Xiaoxin Chen , Gangshan Wu , Limin Wang

We consider the problem of improving the human instance segmentation mask quality for a given test image using keypoints estimation. We compare two alternative approaches. The first approach is a test-time adaptation (TTA) method, where we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Kambiz Azarian , Debasmit Das , Hyojin Park , Fatih Porikli

Test-time adaptation (TTA) allows a model to be adapted to an unseen domain without accessing the source data. Due to the nature of practical environments, TTA has a limited amount of data for adaptation. Recent TTA methods further restrict…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Younggeol Cho , Youngrae Kim , Junho Yoon , Seunghoon Hong , Dongman Lee

Data augmentation is a powerful technique to enhance the performance of a deep learning task but has received less attention in 3D deep learning. It is well known that when 3D shapes are sparsely represented with low point density, the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Tuan-Anh Vu , Srinjay Sarkar , Zhiyuan Zhang , Binh-Son Hua , Sai-Kit Yeung

Text-to-3D modelling has seen exciting progress by combining generative text-to-image models with image-to-3D methods like Neural Radiance Fields. DreamFusion recently achieved high-quality results but requires a lengthy, per-prompt…

Recent advancements in diffusion models have showcased their impressive capacity to generate visually striking images. Nevertheless, ensuring a close match between the generated image and the given prompt remains a persistent challenge. In…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Yupeng Zhou , Daquan Zhou , Zuo-Liang Zhu , Yaxing Wang , Qibin Hou , Jiashi Feng

Recently large-scale language-image models (e.g., text-guided diffusion models) have considerably improved the image generation capabilities to generate photorealistic images in various domains. Based on this success, current image editing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Wenkai Dong , Song Xue , Xiaoyue Duan , Shumin Han