English
Related papers

Related papers: Test-time Alignment-Enhanced Adapter for Vision-La…

200 papers

Distribution shifts between training and test data are inevitable over the lifecycle of a deployed model, leading to performance decay. Adapting a model on test samples can help mitigate this drop in performance. However, most test-time…

Machine Learning · Computer Science 2025-11-18 Mona Schirmer , Dan Zhang , Eric Nalisnick

Vision-Language Models (VLMs) have demonstrated remarkable generalization capabilities across a wide range of tasks. However, their performance often remains suboptimal when directly applied to specific downstream scenarios without…

Machine Learning · Computer Science 2025-08-08 Hao Dong , Lijun Sheng , Jian Liang , Ran He , Eleni Chatzi , Olga Fink

Vision-language temporal alignment is a crucial capability for human dynamic recognition and cognition in real-world scenarios. While existing research focuses on capturing vision-language relevance, it faces limitations due to biased…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Hao Du , Bo Wu , Yan Lu , Zhendong Mao

Textual prompt tuning has demonstrated significant performance improvements in adapting natural language processing models to a variety of downstream tasks by treating hand-engineered prompts as trainable parameters. Inspired by the success…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Jiachen Sun , Mark Ibrahim , Melissa Hall , Ivan Evtimov , Z. Morley Mao , Cristian Canton Ferrer , Caner Hazirbas

Test-time training adapts to a new test distribution on the fly by optimizing a model for each test input using self-supervision. In this paper, we use masked autoencoders for this one-sample learning problem. Empirically, our simple method…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Yossi Gandelsman , Yu Sun , Xinlei Chen , Alexei A. Efros

Existing large language models (LLMs) that mainly focus on Standard American English (SAE) often lead to significantly worse performance when being applied to other English dialects. While existing mitigations tackle discrepancies for…

Computation and Language · Computer Science 2023-12-07 Yanchen Liu , William Held , Diyi Yang

Multiple Object Tracking (MOT) has long been a fundamental task in computer vision, with broad applications in various real-world scenarios. However, due to distribution shifts in appearance, motion pattern, and catagory between the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wen Guo , Pengfei Zhao , Zongmeng Wang , Yufan Hu , Junyu Gao

Data augmentation has been actively studied for robust neural networks. Most of the recent data augmentation methods focus on augmenting datasets during the training phase. At the testing phase, simple transformations are still widely used…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Ildoo Kim , Younghoon Kim , Sungwoong Kim

Domain adaptation helps generalizing object detection models to target domain data with distribution shift. It is often achieved by adapting with access to the whole target domain data. In a more realistic scenario, target distribution is…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Yijin Chen , Xun Xu , Yongyi Su , Kui Jia

In this study, we introduce an intelligent Test Time Augmentation (TTA) algorithm designed to enhance the robustness and accuracy of image classification models against viewpoint variations. Unlike traditional TTA methods that…

Image and Video Processing · Electrical Eng. & Systems 2024-06-14 Efe Ozturk , Mohit Prabhushankar , Ghassan AlRegib

Test-time adaptation methods have been gaining attention recently as a practical solution for addressing source-to-target domain gaps by gradually updating the model without requiring labels on the target data. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Taeyeop Lee , Jonathan Tremblay , Valts Blukis , Bowen Wen , Byeong-Uk Lee , Inkyu Shin , Stan Birchfield , In So Kweon , Kuk-Jin Yoon

Textual adapter-based tuning methods have shown significant potential in transferring knowledge from pre-trained Vision-Language Models (VLMs) to downstream tasks. Existing works generally employ the deterministic textual feature adapter to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Bo Jiang , Xueyang Ze , Beibei Wang , Xixi Wang , Xixi Wan , Bin Luo

Time-series anomaly detection (TSAD) has played a vital role in a variety of fields, including healthcare, finance, and sensor-based condition monitoring. Prior methods, which mainly focus on training domain-specific models on numerical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Zelin He , Sarah Alnegheimish , Matthew Reimherr

Given the inevitability of domain shifts during inference in real-world applications, test-time adaptation (TTA) is essential for model adaptation after deployment. However, the real-world scenario of continuously changing target…

Machine Learning · Computer Science 2023-11-28 Junyoung Park , Jin Kim , Hyeongjun Kwon , Ilhoon Yoon , Kwanghoon Sohn

Test-time adaptation (TTA) addresses the unforeseen distribution shifts occurring during test time. In TTA, performance, memory consumption, and time consumption are crucial considerations. A recent diffusion-based TTA approach for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yeongtak Oh , Jonghyun Lee , Jooyoung Choi , Dahuin Jung , Uiwon Hwang , Sungroh Yoon

Vision-language models (VLMs) seamlessly integrate visual and textual data to perform tasks such as image classification, caption generation, and visual question answering. However, adversarial images often struggle to deceive all prompts…

Multimedia · Computer Science 2024-06-21 Xikang Yang , Xuehai Tang , Fuqing Zhu , Jizhong Han , Songlin Hu

Vision-Language Models (VLMs) have achieved impressive performance across a wide range of multimodal tasks, yet they often exhibit inconsistent behavior when faced with semantically equivalent inputs, undermining their reliability and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Shih-Han Chou , Shivam Chandhok , James J. Little , Leonid Sigal

The integration of large language models (LLMs) with vision-language (VL) tasks has been a transformative development in the realm of artificial intelligence, highlighting the potential of LLMs as a versatile general-purpose chatbot.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Vedanshu , MM Tripathi , Bhavnesh Jaint

Efficient transfer learning (ETL) is receiving increasing attention to adapt large pre-trained language-vision models on downstream tasks with a few labeled samples. While significant progress has been made, we reveal that state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Julio Silva-Rodríguez , Sina Hajimiri , Ismail Ben Ayed , Jose Dolz

Real-world deployment often exposes models to distribution shifts, making test-time adaptation (TTA) critical for robustness. Yet most TTA methods are unfriendly to edge deployment, as they rely on backpropagation, activation buffering, or…

Machine Learning · Computer Science 2026-05-08 Xinyu Luo , Jie Liu , Kecheng Chen , Junyi Yang , Bo Ding , Arindam Basu , Haoliang Li