English
Related papers

Related papers: Flatness Guided Test-Time Adaptation for Vision-La…

200 papers

Deep learning models often struggle under natural distribution shifts, a common challenge in real-world deployments. Test-Time Adaptation (TTA) addresses this by adapting models during inference without labeled source data. We present the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 John Turnbull , Shivam Grover , Amin Jalali , Ali Etemad

Pre-trained vision-language models (VLMs) are highly adaptable to various downstream tasks through few-shot learning, making prompt-based anomaly detection a promising approach. Traditional methods depend on human-crafted prompts that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Pi-Wei Chen , Jerry Chun-Wei Lin , Jia Ji , Feng-Hao Yeh , Zih-Ching Chen , Chao-Chun Chen

Deep neural networks have achieved remarkable success in a variety of computer vision applications. However, there is a problem of degrading accuracy when the data distribution shifts between training and testing. As a solution of this…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Shohei Enomoto , Naoya Hasegawa , Kazuki Adachi , Taku Sasaki , Shin'ya Yamaguchi , Satoshi Suzuki , Takeharu Eda

Vision-Language Models (VLMs) like CLIP have demonstrated remarkable generalization in zero- and few-shot settings, but adapting them efficiently to decentralized, heterogeneous data remains a challenge. While prompt tuning has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Sajjad Ghiasvand , Mahnoosh Alizadeh , Ramtin Pedarsani

Explorations in fine-tuning Vision-Language Models (VLMs), such as Low-Rank Adaptation (LoRA) from Parameter Efficient Fine-Tuning (PEFT), have made impressive progress. However, most approaches rely on explicit weight updates, overlooking…

Machine Learning · Computer Science 2025-12-30 Mingyuan Zhang , Yue Bai , Yifan Wang , Yiyang Huang , Yun Fu

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu

Pre-trained gaze models learn to identify useful patterns commonly found across users, but subtle user-specific variations (i.e., eyelid shape or facial structure) can degrade model performance. Test-time personalization (TTP) adapts…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 He-Yen Hsieh , Wei-Te Mark Ting , H. T. Kung

Fully test-time adaptation (FTTA) adapts a model that is trained on a source domain to a target domain during the testing phase, where the two domains follow different distributions and source data is unavailable during the training phase.…

Artificial Intelligence · Computer Science 2023-12-15 Houcheng Su , Daixian Liu , Mengzhu Wang , Wei Wang

Visual Prompt Tuning (VPT) is an effective tuning method for adapting pretrained Vision Transformers (ViTs) to downstream tasks. It leverages extra learnable tokens, known as prompts, which steer the frozen pretrained ViTs. Although VPT has…

Machine Learning · Computer Science 2023-06-09 Seungryong Yoo , Eunji Kim , Dahuin Jung , Jungbeom Lee , Sungroh Yoon

Real-world deployment often exposes models to distribution shifts, making test-time adaptation (TTA) critical for robustness. Yet most TTA methods are unfriendly to edge deployment, as they rely on backpropagation, activation buffering, or…

Machine Learning · Computer Science 2026-05-08 Xinyu Luo , Jie Liu , Kecheng Chen , Junyi Yang , Bo Ding , Arindam Basu , Haoliang Li

Recently, Sharpness-Aware Minimization (SAM) algorithm has shown state-of-the-art generalization abilities in vision tasks. It demonstrates that flat minima tend to imply better generalization abilities. However, it has some difficulty…

Machine Learning · Computer Science 2022-10-14 Zhiyuan Zhang , Ruixuan Luo , Qi Su , Xu Sun

We consider the problem of improving the human instance segmentation mask quality for a given test image using keypoints estimation. We compare two alternative approaches. The first approach is a test-time adaptation (TTA) method, where we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Kambiz Azarian , Debasmit Das , Hyojin Park , Fatih Porikli

Vision-Language (V-L) models trained with contrastive learning to align the visual and language modalities have been shown to be strong few-shot learners. Soft prompt learning is the method of choice for few-shot downstream adaptation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yassine Ouali , Adrian Bulat , Brais Martinez , Georgios Tzimiropoulos

Vision-language models (VLMs) exhibit remarkable zero-shot capabilities but struggle with distribution shifts in downstream tasks when labeled data is unavailable, which has motivated the development of Test-Time Adaptation (TTA) to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Yiwen Liang , Hui Chen , Yizhe Xiong , Zihan Zhou , Mengyao Lyu , Zijia Lin , Shuaicheng Niu , Sicheng Zhao , Jungong Han , Guiguang Ding

Test-time adaptation (TTA) offers a compelling remedy for machine learning (ML) models that degrade under domain shifts, improving generalisation on-the-fly with only unlabelled samples. This flexibility suits real deployments, yet…

Machine Learning · Computer Science 2026-02-09 Sudarshan Sreeram , Young D. Kwon , Cecilia Mascolo

Reliable long-term decoding of surface electromyography (EMG) is hindered by signal drift caused by electrode shifts, muscle fatigue, and posture changes. While state-of-the-art models achieve high intra-session accuracy, their performance…

Machine Learning · Computer Science 2026-01-08 Nia Touko , Matthew O A Ellis , Cristiano Capone , Alessio Burrello , Elisa Donati , Luca Manneschi

Fully Test-Time Adaptation (FTTA) addresses domain shifts without access to source data and training protocols of the pre-trained models. Traditional strategies that align source and target feature distributions are infeasible in FTTA due…

Machine Learning · Computer Science 2025-11-18 Ponhvoan Srey , Yaxin Shi , Hangwei Qian , Jing Li , Ivor W. Tsang

Vision-language foundation models (VLMs), such as CLIP, exhibit remarkable performance across a wide range of tasks. However, deploying these models can be unreliable when significant distribution gaps exist between training and test data,…

Machine Learning · Computer Science 2025-09-29 Zongbo Han , Jialong Yang , Guangyu Wang , Junfan Li , Qianli Xu , Mike Zheng Shou , Changqing Zhang

Given the inevitability of domain shifts during inference in real-world applications, test-time adaptation (TTA) is essential for model adaptation after deployment. However, the real-world scenario of continuously changing target…

Machine Learning · Computer Science 2023-11-28 Junyoung Park , Jin Kim , Hyeongjun Kwon , Ilhoon Yoon , Kwanghoon Sohn

With the increasing attention to pre-trained vision-language models (VLMs), \eg, CLIP, substantial efforts have been devoted to many downstream tasks, especially in test-time adaptation (TTA). However, previous works focus on learning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xingyu Zhu , Shuo Wang , Beier Zhu , Miaoge Li , Yunfan Li , Junfeng Fang , Zhicai Wang , Dongsheng Wang , Hanwang Zhang