English
Related papers

Related papers: Beyond One-Size-Fits-All: Adaptive Test-Time Augme…

200 papers

Data augmentation is widely used for machine learning; however, an effective method to apply data augmentation has not been established even though it includes several factors that should be tuned carefully. One such factor is sample…

Machine Learning · Computer Science 2020-10-30 Tomoumi Takase , Ryo Karakida , Hideki Asoh

Data augmentation, by the introduction of auxiliary variables, has become an ubiquitous technique to improve convergence properties, simplify the implementation or reduce the computational time of inference methods such as Markov chain…

Methodology · Statistics 2020-09-30 Maxime Vono , Nicolas Dobigeon , Pierre Chainais

Domain shift is a common problem in the realistic world, where training data and test data follow different data distributions. To deal with this problem, fully test-time adaptation (TTA) leverages the unlabeled data encountered during test…

Artificial Intelligence · Computer Science 2024-04-29 Guoliang Lin , Hanjiang Lai , Yan Pan , Jian Yin

This paper introduces ReservoirTTA, a novel plug-in framework designed for prolonged test-time adaptation (TTA) in scenarios where the test domain continuously shifts over time, including cases where domains recur or evolve gradually. At…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Guillaume Vray , Devavrat Tomar , Xufeng Gao , Jean-Philippe Thiran , Evan Shelhamer , Behzad Bozorgtabar

Long-term test-time adaptation (TTA) is a challenging task due to error accumulation. Recent approaches tackle this issue by actively labeling a small proportion of samples in each batch, yet the annotation burden quickly grows as the batch…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Guowei Wang , Changxing Ding

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model…

Machine Learning · Computer Science 2023-01-12 Taesik Gong , Jongheon Jeong , Taewon Kim , Yewon Kim , Jinwoo Shin , Sung-Ju Lee

Data augmentation aims to enrich training samples for alleviating the overfitting issue in low-resource or class-imbalanced situations. Traditional methods first devise task-specific operations such as Synonym Substitute, then preset the…

Computation and Language · Computer Science 2021-09-03 Shuhuai Ren , Jinchao Zhang , Lei Li , Xu Sun , Jie Zhou

Convolutional neural networks (CNNs) often suffer from poor performance when tested on target data that differs from the training (source) data distribution, particularly in medical imaging applications where variations in imaging protocols…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jingjie Guo , Weitong Zhang , Matthew Sinclair , Daniel Rueckert , Chen Chen

Test-time adaptation (TTA) refers to adapting a classifier for the test data when the probability distribution of the test data slightly differs from that of the training data of the model. To the best of our knowledge, most of the existing…

Machine Learning · Computer Science 2026-01-19 Sravan Danda , Aditya Challa , Shlok Mehendale , Snehanshu Saha

Test-Time Adaptation (TTA) addresses domain shifts between training and testing. However, existing methods assume a homogeneous target domain (e.g., single domain) at any given time. They fail to handle the dynamic nature of real-world…

Machine Learning · Computer Science 2025-12-25 Chuyang Ye , Dongyan Wei , Zhendong Liu , Yuanyi Pang , Yixi Lin , Qinting Jiang , Jingyan Jiang , Dongbiao He

Recently, Miller et al. (2021) and Baek et al. (2022) empirically demonstrated strong linear correlations between in-distribution (ID) versus out-of-distribution (OOD) accuracy and agreement. These trends, coined accuracy-on-the-line (ACL)…

Machine Learning · Computer Science 2024-11-11 Eungyeup Kim , Mingjie Sun , Christina Baek , Aditi Raghunathan , J. Zico Kolter

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

Test time adaptation (TTA) equips deep learning models to handle unseen test data that deviates from the training distribution, even when source data is inaccessible. While traditional TTA methods often rely on entropy as a confidence…

Machine Learning · Computer Science 2024-09-17 Afshar Shamsi , Rejisa Becirovic , Ahmadreza Argha , Ehsan Abbasnejad , Hamid Alinejad-Rokny , Arash Mohammadi

Deep neural networks often encounter significant performance drops while facing with domain shifts between training (source) and test (target) data. To address this issue, Test Time Adaptation (TTA) methods have been proposed to adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Siqi Luo , Yi Xin , Yuntao Du , Tao Tan , Guangtao Zhai , Xiaohong Liu

This article presents a comprehensive survey of online test-time adaptation (OTTA), focusing on effectively adapting machine learning models to distributionally different target data upon batch arrival. Despite the recent proliferation of…

Artificial Intelligence · Computer Science 2024-07-19 Zixin Wang , Yadan Luo , Liang Zheng , Zhuoxiao Chen , Sen Wang , Zi Huang

Test-time adaptation (TTA) adapts the pre-trained models to test distributions during the inference phase exclusively employing unlabeled test data streams, which holds great value for the deployment of models in real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Shuang Li , Longhui Yuan , Binhui Xie , Tao Yang

This paper investigates test-time adaptation (TTA) for regression, where a regression model pre-trained in a source domain is adapted to an unknown target distribution with unlabeled target data. Although regression is one of the…

Machine Learning · Computer Science 2025-01-24 Kazuki Adachi , Shin'ya Yamaguchi , Atsutoshi Kumagai , Tomoki Hamagami

In real-world scenarios, tabular data often suffer from distribution shifts that threaten the performance of machine learning models. Despite its prevalence and importance, handling distribution shifts in the tabular domain remains…

Machine Learning · Computer Science 2025-02-13 Changhun Kim , Taewon Kim , Seungyeon Woo , June Yong Yang , Eunho Yang

Robust facial expression recognition in unconstrained, "in-the-wild" environments remains challenging due to significant domain shifts between training and testing distributions. Test-time adaptation (TTA) offers a promising solution by…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Mohammadmahdi Honarmand , Onur Cezmi Mutlu , Parnian Azizian , Saimourya Surabhi , Dennis P. Wall

Test-time adaptation (TTA) aims to address distributional shifts between training and testing data using only unlabeled test data streams for continual model adaptation. However, most TTA methods assume benign test streams, while test…

Machine Learning · Computer Science 2023-10-17 Taesik Gong , Yewon Kim , Taeckyung Lee , Sorn Chottananurak , Sung-Ju Lee