中文
相关论文

相关论文: Subspace Alignment for Vision-Language Model Test-…

200 篇论文

Despite progress in end-to-end ASR, real-world domain mismatches still cause performance drops, which Test-Time Adaptation (TTA) aims to mitigate by adjusting models during inference. Recent work explores combining TTA with external…

计算与语言 · 计算机科学 2025-06-16 Wei-Ping Huang , Guan-Ting Lin , Hung-yi Lee

Domain adaptation (DA) techniques help deep learning models generalize across data shifts for point cloud semantic segmentation (PCSS). Test-time adaptation (TTA) allows direct adaptation of a pre-trained model to unlabeled data during…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Puzuo Wang , Wei Yao , Jie Shao , Zhiyi He

Medical vision-language alignment through cross-modal contrastive learning shows promising performance in image-text matching tasks, such as retrieval and zero-shot classification. However, conventional cross-modal contrastive learning…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Chenyu Lian , Hong-Yu Zhou , Dongyun Liang , Jing Qin , Liansheng Wang

Current visual detectors, though impressive within their training distribution, often fail to parse out-of-distribution scenes into their constituent entities. Recent test-time adaptation methods use auxiliary self-supervised losses to…

Continual Test-Time Adaptation (CTTA) aims to adapt the source model to continually changing unlabeled target domains without access to the source data. Existing methods mainly focus on model-based adaptation in a self-training manner, such…

计算机视觉与模式识别 · 计算机科学 2023-02-14 Yulu Gan , Yan Bai , Yihang Lou , Xianzheng Ma , Renrui Zhang , Nian Shi , Lin Luo

Visual Place Recognition (VPR) has evolved from handcrafted descriptors to deep learning approaches, yet significant challenges remain. Current approaches, including Vision Foundation Models (VFMs) and Multimodal Large Language Models…

机器学习 · 计算机科学 2025-09-03 Jintao Cheng , Weibin Li , Jiehao Luo , Xiaoyu Tang , Zhijian He , Jin Wu , Yao Zou , Wei Zhang

Vision-language foundation models (VLMs), such as CLIP, exhibit remarkable performance across a wide range of tasks. However, deploying these models can be unreliable when significant distribution gaps exist between training and test data,…

机器学习 · 计算机科学 2025-09-29 Zongbo Han , Jialong Yang , Guangyu Wang , Junfan Li , Qianli Xu , Mike Zheng Shou , Changqing Zhang

Pre-trained vision-language models (VLMs), exemplified by CLIP, demonstrate remarkable adaptability across zero-shot classification tasks without additional training. However, their performance diminishes in the presence of domain shifts.…

Deep learning models often struggle under natural distribution shifts, a common challenge in real-world deployments. Test-Time Adaptation (TTA) addresses this by adapting models during inference without labeled source data. We present the…

计算机视觉与模式识别 · 计算机科学 2026-03-23 John Turnbull , Shivam Grover , Amin Jalali , Ali Etemad

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

机器学习 · 计算机科学 2025-02-06 Minguk Jang , Hye Won Chung

Recently, adapting Vision Language Models (VLMs) to zero-shot visual classification by tuning class embedding with a few prompts (Test-time Prompt Tuning, TPT) or replacing class names with generated visual samples (support-set) has shown…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Rui Yan , Jin Wang , Hongyu Qu , Xiaoyu Du , Dong Zhang , Jinhui Tang , Tieniu Tan

Large vision language models (VLMs) combine large language models with vision encoders, demonstrating promise across various tasks. However, they often underperform in task-specific applications due to domain gaps between pre-training and…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Yang Bai , Yang Zhou , Jun Zhou , Rick Siow Mong Goh , Daniel Shu Wei Ting , Yong Liu

Unsupervised domain adaptation (UDA) enables models trained on a labeled source domain to handle new unlabeled domains. Recently, pre-trained vision-language models (VLMs) have demonstrated promising zero-shot performance by leveraging…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Xinyao Li , Jingjing Li , Zhekai Du , Lei Zhu , Heng Tao Shen

Test-Time Adaptation (TTA) methods improve the robustness of deep neural networks to domain shift on a variety of tasks such as image classification or segmentation. This work explores adapting segmentation models to a single unlabelled…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Klara Janouskova , Tamir Shor , Chaim Baskin , Jiri Matas

Test-Time Adaptation (TTA) has emerged as a crucial solution to the domain shift challenge, wherein the target environment diverges from the original training environment. A prime exemplification is TTA for Automatic Speech Recognition…

计算与语言 · 计算机科学 2024-08-13 Eunseop Yoon , Hee Suk Yoon , John Harvill , Mark Hasegawa-Johnson , Chang D. Yoo

Small Vision-Language Models (VLMs) provide a computationally efficient alternative to larger models, at the cost of weaker generalization abilities and downstream task performance. These shortcomings could be addressed by test-time scaling…

机器学习 · 计算机科学 2026-02-17 Mehmet Onurcan Kaya , Desmond Elliott , Dim P. Papadopoulos

Test-time adaptation (TTA) refers to adapting neural networks to distribution shifts, with access to only the unlabeled test samples from the new domain at test-time. Prior TTA methods optimize over unsupervised objectives such as the…

机器学习 · 计算机科学 2022-11-24 Sachin Goyal , Mingjie Sun , Aditi Raghunathan , Zico Kolter

Video editing is a critical component of content creation that transforms raw footage into coherent works aligned with specific visual and narrative objectives. Existing approaches face two major challenges: temporal inconsistencies due to…

计算机视觉与模式识别 · 计算机科学 2025-07-30 Jianhui Wang , Yinda Chen , Yangfan He , Xinyuan Song , Yi Xin , Dapeng Zhang , Zhongwei Wan , Bin Li , Rongchao Zhang

Test-Time Adaptation (TTA) aims to tackle distribution shifts using unlabeled test data without access to the source data. In the context of multimodal data, there are more complex noise patterns than unimodal data such as simultaneous…

机器学习 · 计算机科学 2025-03-05 Zirun Guo , Tao Jin

Large pre-trained vision-language models (VLMs), such as CLIP, have shown unprecedented zero-shot performance across a wide range of tasks. Nevertheless, these models may be unreliable under distributional shifts, as their performance is…

计算机视觉与模式识别 · 计算机科学 2026-01-05 Shambhavi Mishra , Julio Silva-Rodriguez , Ismail Ben Ayed , Marco Pedersoli , Jose Dolz