English
Related papers

Related papers: Diffusion-Enhanced Test-time Adaptation with Text …

200 papers

In text-to-image generation tasks, the advancements of diffusion models have facilitated the fidelity of generated results. However, these models encounter challenges when processing text prompts containing multiple entities and attributes.…

Computation and Language · Computer Science 2024-04-23 Yihang Wu , Xiao Cao , Kaixin Li , Zitan Chen , Haonan Wang , Lei Meng , Zhiyong Huang

Test-time prompt tuning for vision-language models (VLMs) is getting attention because of their ability to learn with unlabeled data without fine-tuning. Although test-time prompt tuning methods for VLMs can boost accuracy, the resulting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ashshak Sharifdeen , Muhammad Akhtar Munir , Sanoojan Baliah , Salman Khan , Muhammad Haris Khan

Test-time adaptation (TTA) adapts the pre-trained models to test distributions during the inference phase exclusively employing unlabeled test data streams, which holds great value for the deployment of models in real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shuang Li , Longhui Yuan , Binhui Xie , Tao Yang

Vision-language models (VLM) have demonstrated impressive performance in image recognition by leveraging self-supervised training on large datasets. Their performance can be further improved by adapting to the test sample using test-time…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Ramya Hebbalaguppe , Tamoghno Kandar , Abhinav Nagpal , Chetan Arora

Adapting pre-trained models to open classes is a challenging problem in machine learning. Vision-language models fully explore the knowledge of text modality, demonstrating strong zero-shot recognition performance, which is naturally suited…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Zhengqing Gao , Xiang Ao , Xu-Yao Zhang , Cheng-Lin Liu

Recent advances in data augmentation enable one to translate images by learning the mapping between a source domain and a target domain. Existing methods tend to learn the distributions by training a model on a variety of datasets, with…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Boyi Li , Yin Cui , Tsung-Yi Lin , Serge Belongie

Domain adaptation of 3D portraits has gained more and more attention. However, the transfer mechanism of existing methods is mainly based on vision or language, which ignores the potential of vision-language combined guidance. In this…

Multimedia · Computer Science 2023-12-12 Xiangwen Deng , Yufeng Wang , Yuanhao Cai , Jingxiang Sun , Yebin Liu , Haoqian Wang

Recent advancements in pre-trained Vision-Language Models (VLMs) have highlighted the significant potential of prompt tuning for adapting these models to a wide range of downstream tasks. However, existing prompt tuning methods typically…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Xinyang Wang , Yi Yang , Minfeng Zhu , Kecheng Zheng , Shi Liu , Wei Chen

Text-to-3D synthesis has recently emerged as a new approach to sampling 3D models by adopting pretrained text-to-image models as guiding visual priors. An intriguing but underexplored problem with existing text-to-3D methods is that 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Uy Dieu Tran , Minh Luu , Phong Ha Nguyen , Khoi Nguyen , Binh-Son Hua

Text-to-image (T2I) diffusion models have demonstrated impressive image generation capabilities. Still, their computational intensity prohibits resource-constrained organizations from deploying T2I models after fine-tuning them on their…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Alireza Ganjdanesh , Reza Shirkavand , Shangqian Gao , Heng Huang

Pretrained vision-language models (VLMs) like CLIP show strong zero-shot performance but struggle with generalization under distribution shifts. Test-Time Adaptation (TTA) addresses this by adapting VLMs to unlabeled test data in new…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Hamidreza Dastmalchi , Aijun An , Ali cheraghian

Affordable 3D scanners often produce sparse and non-uniform point clouds that negatively impact downstream applications in robotic systems. While existing point cloud upsampling architectures have demonstrated promising results on standard…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Ahmed Hatem , Yiming Qian , Yang Wang

Test-time adaptation paradigm provides flexibility towards domain shifts by performing immediate adaptation on unlabeled target data from the source model. Vision-Language Models (VLMs) leverage their generalization capabilities for diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Jisu Han , Wonjun Hwang

With the emergence of large pre-trained vison-language model like CLIP, transferable representations can be adapted to a wide range of downstream tasks via prompt tuning. Prompt tuning tries to probe the beneficial information for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Yinghui Xing , Qirui Wu , De Cheng , Shizhou Zhang , Guoqiang Liang , Peng Wang , Yanning Zhang

This paper introduces a simple and scalable approach to improve the data efficiency of large language model (LLM) training by augmenting existing text data with thinking trajectories. The compute for pre-training LLMs has been growing at an…

Computation and Language · Computer Science 2025-10-20 Liang Wang , Nan Yang , Shaohan Huang , Li Dong , Furu Wei

This paper introduces ITA-MDT, the Image-Timestep-Adaptive Masked Diffusion Transformer Framework for Image-Based Virtual Try-On (IVTON), designed to overcome the limitations of previous approaches by leveraging the Masked Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ji Woo Hong , Tri Ton , Trung X. Pham , Gwanhyeong Koo , Sunjae Yoon , Chang D. Yoo

Test-time adaptation (TTA) has emerged as a promising paradigm to handle the domain shifts at test time for medical images from different institutions without using extra training data. However, existing TTA solutions for segmentation tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Chuyan Zhang , Hao Zheng , Xin You , Yefeng Zheng , Yun Gu

The field of text-to-image (T2I) generation has garnered significant attention both within the research community and among everyday users. Despite the advancements of T2I models, a common issue encountered by users is the need for…

Computation and Language · Computer Science 2023-10-31 Wanrong Zhu , Xinyi Wang , Yujie Lu , Tsu-Jui Fu , Xin Eric Wang , Miguel Eckstein , William Yang Wang

Multi-modal test-time adaptation (MM-TTA) adapts models to an unlabeled target domain by leveraging the complementary multi-modal inputs in an online manner. While previous MM-TTA methods for 3D segmentation offer a promising solution by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Haozhi Cao , Yuecong Xu , Pengyu Yin , Xingyu Ji , Shenghai Yuan , Jianfei Yang , Lihua Xie

Data augmentation is widely used to enhance generalization in visual classification tasks. However, traditional methods struggle when source and target domains differ, as in domain adaptation, due to their inability to address domain gaps.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Khawar Islam , Muhammad Zaigham Zaheer , Arif Mahmood , Karthik Nandakumar , Naveed Akhtar