English
Related papers

Related papers: Layer-wise Auto-Weighting for Non-Stationary Test-…

200 papers

Acoustic foundation models, fine-tuned for Automatic Speech Recognition (ASR), suffer from performance degradation in wild acoustic test settings when deployed in real-world scenarios. Stabilizing online Test-Time Adaptation (TTA) under…

Sound · Computer Science 2024-10-08 Hongfu Liu , Hengguan Huang , Ye Wang

Wearable human activity recognition (WHAR) models often suffer from performance degradation under real-world cross-user distribution shifts. Test-time adaptation (TTA) mitigates this degradation by adapting models online using unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zishu Zhou , Zaipeng Xie , Xuanyao Jie

Deep neural networks are typically trained in a single shot for a specific task and data distribution, but in real world settings both the task and the domain of application can change. The problem becomes even more challenging in dense…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Donald Shenaj , Francesco Barbato , Umberto Michieli , Pietro Zanuttigh

This article presents a comprehensive survey of online test-time adaptation (OTTA), focusing on effectively adapting machine learning models to distributionally different target data upon batch arrival. Despite the recent proliferation of…

Artificial Intelligence · Computer Science 2024-07-19 Zixin Wang , Yadan Luo , Liang Zheng , Zhuoxiao Chen , Sen Wang , Zi Huang

Test-time adaptation (TTA) refers to adapting neural networks to distribution shifts, with access to only the unlabeled test samples from the new domain at test-time. Prior TTA methods optimize over unsupervised objectives such as the…

Machine Learning · Computer Science 2022-11-24 Sachin Goyal , Mingjie Sun , Aditi Raghunathan , Zico Kolter

Test-time adaptation (TTA) enhances model robustness by enabling adaptation to target distributions that differ from training distributions, improving real-world generalizability. However, most existing TTA approaches focus on adjusting the…

Machine Learning · Computer Science 2026-05-05 Yewon Han , Seoyun Yang , Taesup Kim

This paper presents a simple yet effective approach that improves continual test-time adaptation (TTA) in a memory-efficient manner. TTA may primarily be conducted on edge devices with limited memory, so reducing memory is crucial but has…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Junha Song , Jungsoo Lee , In So Kweon , Sungha Choi

Vision-language models (VLMs) such as CLIP achieve strong zero-shot recognition but degrade significantly under \textit{temporally evolving distribution shifts} common in real-world scenarios (e.g., gradual illumination or seasonal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Shuang Cui , Jinglin Xu , Yi Li , Xiongxin Tang , Jiangmeng Li , Jiahuan Zhou , Fanjiang Xu , Fuchun Sun , Hui Xiong

3D Vision-Language Foundation Models (VLFMs) have shown strong generalization and zero-shot recognition capabilities in open-world point cloud processing tasks. However, these models often underperform in practical scenarios where data are…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Mehran Tamjidi , Hamidreza Dastmalchi , Mohammadreza Alimoradijazi , Ali Cheraghian , Aijun An , Morteza Saberi

Convolutional Neural Networks (ConvNets) are trained offline using the few available data and may therefore suffer from substantial accuracy loss when ported on the field, where unseen input patterns received under unpredictable external…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Luca Mocerino , Roberto G. Rizzo , Valentino Peluso , Andrea Calimera , Enrico Macii

Deep Learning-based end-to-end Automatic Speech Recognition (ASR) has made significant strides but still struggles with performance on out-of-domain samples due to domain shifts in real-world scenarios. Test-Time Adaptation (TTA) methods…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-04 Guan-Ting Lin , Wei-Ping Huang , Hung-yi Lee

Test-time adaptation (TTA) of 3D point clouds is crucial for mitigating discrepancies between training and testing samples in real-world scenarios, particularly when handling corrupted point clouds. LiDAR data, for instance, can be affected…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Hamidreza Dastmalchi , Aijun An , Ali Cheraghian , Shafin Rahman , Sameera Ramasinghe

Continuous Domain Adaptation (CDA) effectively bridges significant domain shifts by progressively adapting from the source domain through intermediate domains to the target domain. However, selecting intermediate domains without explicit…

Machine Learning · Computer Science 2025-10-14 Hanbing Liu , Huaze Tang , Yanru Wu , Yang Li , Xiao-Ping Zhang

This paper studies continual test-time adaptation (CTTA), the task of adapting a model to constantly changing unseen domains in testing while preserving previously learned knowledge. Existing CTTA methods mostly focus on adaptation to the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Sohyun Lee , Nayeong Kim , Juwon Kang , Seong Joon Oh , Suha Kwak

Reliable uncertainty estimates are an important tool for helping autonomous agents or human decision makers understand and leverage predictive models. However, existing approaches to estimating uncertainty largely ignore the possibility of…

Machine Learning · Computer Science 2020-05-22 Sangdon Park , Osbert Bastani , James Weimer , Insup Lee

Domain adaptation is the supervised learning setting in which the training and test data are sampled from different distributions: training data is sampled from a source domain, whilst test data is sampled from a target domain. This paper…

Machine Learning · Statistics 2016-10-21 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog , Laurens J. P. van der Maaten

Recent advancements in dense out-of-distribution (OOD) detection have primarily focused on scenarios where the training and testing datasets share a similar domain, with the assumption that no domain shift exists between them. However, in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhitong Gao , Shipeng Yan , Xuming He

Few-shot classification aims to learn a classifier to recognize unseen classes during training, where the learned model can easily become over-fitted based on the biased distribution formed by only a few training examples. A recent solution…

Machine Learning · Computer Science 2022-10-11 Dandan Guo , Long Tian , He Zhao , Mingyuan Zhou , Hongyuan Zha

Deep learning models often struggle with generalization when deploying on real-world data, due to the common distributional shift to the training data. Test-time adaptation (TTA) is an emerging scheme used at inference time to address this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Mingxi Lei , Chunwei Ma , Meng Ding , Yufan Zhou , Ziyun Huang , Jinhui Xu

Online test-time adaptation aims to dynamically adjust a network model in real-time based on sequential input samples during the inference stage. In this work, we find that, when applying a transformer network model to a new target domain,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yushun Tang , Ziqiong Liu , Jiyuan Jia , Yi Zhang , Zhihai He