English
Related papers

Related papers: Accurate Parameter-Efficient Test-Time Adaptation …

200 papers

Test-time domain adaptation effectively adjusts the source domain model to accommodate unseen domain shifts in a target domain during inference. However, the model performance can be significantly impaired by continuous distribution changes…

Machine Learning · Computer Science 2024-01-29 Xingzhi Zhou , Zhiliang Tian , Ka Chun Cheung , Simon See , Nevin L. Zhang

The past decade has witnessed significant advances in time series modeling with deep learning. While achieving state-of-the-art results, the best-performing architectures vary highly across applications and domains. Meanwhile, for natural…

Machine Learning · Computer Science 2024-04-03 Defu Cao , Furong Jia , Sercan O Arik , Tomas Pfister , Yixiang Zheng , Wen Ye , Yan Liu

Test-time adaptation (TTA) aims to fine-tune a trained model online using unlabeled testing data to adapt to new environments or out-of-distribution data, demonstrating broad application potential in real-world scenarios. However, in this…

Machine Learning · Computer Science 2024-12-24 Qi Deng , Shuaicheng Niu , Ronghao Zhang , Yaofo Chen , Runhao Zeng , Jian Chen , Xiping Hu

Speech Foundation Models encounter significant performance degradation when deployed in real-world scenarios involving acoustic domain shifts, such as background noise and speaker accents. Test-time adaptation (TTA) has recently emerged as…

Machine Learning · Computer Science 2026-02-24 Jiaheng Dong , Hong Jia , Soumyajit Chatterjee , Abhirup Ghosh , James Bailey , Ting Dang

Intraoperative hypotension (IOH) poses significant surgical risks, but accurate prediction remains challenging due to patient-specific variability. While test-time adaptation (TTA) offers a promising approach for personalized prediction,…

Machine Learning · Computer Science 2026-03-25 Kanxue Li , Yibing Zhan , Hua Jin , Chongchong Qi , Xu Lin , Baosheng Yu

Test-time adaptation (TTA) refers to adapting a trained model to a new domain during testing. Existing TTA techniques rely on having multiple test images from the same domain, yet this may be impractical in real-world applications such as…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Haoyu Dong , Nicholas Konz , Hanxue Gu , Maciej A. Mazurowski

We investigate parameter-efficient fine-tuning (PEFT) methods that can provide good accuracy under limited computational and memory budgets in the context of large language models (LLMs). We present a new PEFT method called Robust…

Computation and Language · Computer Science 2024-06-04 Mahdi Nikdan , Soroush Tabesh , Elvir Crnčević , Dan Alistarh

We present MetaTT, a Tensor Train (TT) adapter framework for fine-tuning of pre-trained transformers. MetaTT enables flexible and parameter-efficient model adaptation by using a single shared TT to factorize transformer sub-modules. This…

Machine Learning · Computer Science 2025-11-18 Javier Lopez-Piqueres , Pranav Deshpande , Archan Ray , Mattia J. Villani , Marco Pistoia , Niraj Kumar

Conventional time-series forecasting methods typically aim to minimize overall prediction error, without accounting for the varying importance of different forecast ranges in downstream applications. We propose a training methodology that…

Machine Learning · Computer Science 2025-08-15 Luca-Andrei Fechete , Mohamed Sana , Fadhel Ayed , Nicola Piovesan , Wenjie Li , Antonio De Domenico , Tareq Si Salem

We consider the problem of improving the human instance segmentation mask quality for a given test image using keypoints estimation. We compare two alternative approaches. The first approach is a test-time adaptation (TTA) method, where we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Kambiz Azarian , Debasmit Das , Hyojin Park , Fatih Porikli

Time-series anomaly detection (TSAD) is a critical component in monitoring complex systems, yet modern deep learning-based detectors are often highly sensitive to localized input corruptions and structured noise. We propose ARTA…

Machine Learning · Computer Science 2026-05-07 Hadi Hojjati , Narges Armanfard

Continual Test-Time Adaptation (CTTA) aims to adapt the source model to continually changing unlabeled target domains without access to the source data. Existing methods mainly focus on model-based adaptation in a self-training manner, such…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Yulu Gan , Yan Bai , Yihang Lou , Xianzheng Ma , Renrui Zhang , Nian Shi , Lin Luo

Wearable human activity recognition (WHAR) models often suffer from performance degradation under real-world cross-user distribution shifts. Test-time adaptation (TTA) mitigates this degradation by adapting models online using unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zishu Zhou , Zaipeng Xie , Xuanyao Jie

Time-series forecasting is a critical challenge in various domains and has witnessed substantial progress in recent years. Many real-life scenarios, such as public health, economics, and social applications, involve feedback loops where…

Machine Learning · Computer Science 2025-06-04 Zhiyuan Zhao , Haoxin Liu , Alexander Rodriguez , B. Aditya Prakash

Continual Test-Time Adaptation (CTTA) enables pre-trained models to adapt to continuously evolving domains. Existing methods have improved robustness but typically rely on fixed or batch-level thresholds, which cannot account for varying…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Seunghwan Lee , Inyoung Jung , Hojoon Lee , Eunil Park , Sungeun Hong

Audio-visual continual test-time adaptation involves continually adapting a source audio-visual model at test-time, to unlabeled non-stationary domains, where either or both modalities can be distributionally shifted, which hampers online…

Machine Learning · Computer Science 2026-02-24 Sarthak Kumar Maharana , Akshay Mehra , Bhavya Ramakrishna , Yunhui Guo , Guan-Ming Su

Automatic speech recognition (ASR) models are frequently exposed to data distribution shifts in many real-world scenarios, leading to erroneous predictions. To tackle this issue, an existing test-time adaptation (TTA) method has recently…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Changhun Kim , Joonhyung Park , Hajin Shim , Eunho Yang

In the arena of language model fine-tuning, the traditional approaches, such as Domain-Adaptive Pretraining (DAPT) and Task-Adaptive Pretraining (TAPT), although effective, but computational intensive. This research introduces a novel…

Computation and Language · Computer Science 2024-05-10 Keyu Chen , Yuan Pang , Zi Yang

Sleep staging models often degrade when deployed on patients with unseen physiology or recording conditions. We propose a streaming, source-free test-time adaptation (TTA) recipe that combines entropy minimization (Tent) with Batch-Norm…

Machine Learning · Computer Science 2025-09-04 Hritik Arasu , Faisal R Jahangiri

Time series forecasting is prevalent in extensive real-world applications, such as financial analysis and energy planning. Previous studies primarily focus on time series modality, endeavoring to capture the intricate variations and…

Machine Learning · Computer Science 2024-10-08 Jiaxiang Dong , Haixu Wu , Yuxuan Wang , Li Zhang , Jianmin Wang , Mingsheng Long