English
Related papers

Related papers: Higher-Order Asymptotics of Test-Time Adaptation f…

200 papers

Standard (network) meta-analysis methods for medical test accuracy evaluation analyse the data separately for each test threshold - wasting data - unless every study reports all thresholds. Previously proposed "multiple threshold" models…

Test-time domain adaptation aims to adapt the model trained on source domains to unseen target domains using a few unlabeled images. Emerging research has shown that the label and domain information is separately embedded in the weight…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yanan Wu , Zhixiang Chi , Yang Wang , Konstantinos N. Plataniotis , Songhe Feng

This paper considers inference for conditional moment inequality models using a multiscale statistic. We derive the asymptotic distribution of this test statistic and use the result to propose feasible critical values that have a simple…

Applications · Statistics 2015-12-10 Timothy B. Armstrong , Hock Peng Chan

Continual Test-Time Adaptation (CTTA) aims to adapt a pretrained model to ever-changing environments during the test time under continuous domain shifts. Most existing CTTA approaches are based on the Mean Teacher (MT) structure, which…

Machine Learning · Computer Science 2024-07-03 Jiaxu Tian , Fan Lyu

Continual Test-Time Adaptation (CTTA) is an emerging and challenging task where a model trained in a source domain must adapt to continuously changing conditions during testing, without access to the original source data. CTTA is prone to…

Machine Learning · Computer Science 2024-05-29 Ziqi Shi , Fan Lyu , Ye Liu , Fanhua Shang , Fuyuan Hu , Wei Feng , Zhang Zhang , Liang Wang

Since experiencing domain shifts during test-time is inevitable in practice, test-time adaption (TTA) continues to adapt the model after deployment. Recently, the area of continual and gradual test-time adaptation (TTA) emerged. In contrast…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Mario Döbler , Robert A. Marsden , Bin Yang

Deep neural networks have a clear degradation when applying to the unseen environment due to the covariate shift. Conventional approaches like domain adaptation requires the pre-collected target data for iterative training, which is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Fuming You , Jingjing Li , Zhou Zhao

Test-time adaptation (TTA) aims to adapt a trained classifier using online unlabeled test data only, without any information related to the training procedure. Most existing TTA methods adapt the trained classifier using the classifier's…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Minguk Jang , Sae-Young Chung , Hye Won Chung

Batch Normalization (BN), a widely-used technique in neural networks, enhances generalization and expedites training by normalizing each mini-batch to the same mean and variance. However, its effectiveness diminishes when confronted with…

Machine Learning · Computer Science 2024-05-28 Bilal Faye , Mustapha Lebbah , Hanane Azzag

Batch Normalization (BN) has become a cornerstone of deep learning across diverse architectures, appearing to help optimization as well as generalization. While the idea makes intuitive sense, theoretical analysis of its effectiveness has…

Machine Learning · Computer Science 2018-12-11 Sanjeev Arora , Zhiyuan Li , Kaifeng Lyu

Continual Test-Time Adaptation (CTTA) aims to empower perception systems to handle dynamic distribution shifts encountered after deployment. Existing methods predominantly follow a backward-alignment paradigm, which rigidly aligns incoming…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zhilin Zhu , Yabin Wang , Zhiheng Ma , Yaguang Song , Yaowei Wang , Xiaopeng Hong

Online adaptation to distribution shifts in satellite image segmentation stands as a crucial yet underexplored problem. In this paper, we address source-free and online domain adaptation, i.e., test-time adaptation (TTA), for satellite…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Fahim Faisal Niloy , Kishor Kumar Bhaumik , Simon S. Woo

Deep learning models perform poorly when domain shifts exist between training and test data. Test-time adaptation (TTA) is a paradigm to mitigate this issue by adapting pre-trained models using only unlabeled test samples. However, existing…

Machine Learning · Computer Science 2025-05-27 Taeckyung Lee , Sorn Chottananurak , Junsu Kim , Jinwoo Shin , Taesik Gong , Sung-Ju Lee

Deep neural networks are known to be vulnerable to unseen data: they may wrongly assign high confidence stcores to out-distribuion samples. Recent works try to solve the problem using representation learning methods and specific metrics. In…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Haowei He , Jiaye Teng , Yang Yuan

Prior to the deployment of robotic systems, pre-training the deep-recognition models on all potential visual cases is infeasible in practice. Hence, test-time adaptation (TTA) allows the model to adapt itself to novel environments and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Junha Song , Kwanyong Park , InKyu Shin , Sanghyun Woo , Chaoning Zhang , In So Kweon

Test-Time Adaptation (TTA) aims to tackle distribution shifts using unlabeled test data without access to the source data. In the context of multimodal data, there are more complex noise patterns than unimodal data such as simultaneous…

Machine Learning · Computer Science 2025-03-05 Zirun Guo , Tao Jin

Active Test-Time Adaptation (ATTA) improves model robustness under domain shift by selectively querying human annotations at deployment, but existing methods use heuristic uncertainty measures and suffer from low data selection efficiency,…

Machine Learning · Computer Science 2025-10-01 Tingyu Shi , Fan Lyu , Shaoliang Peng

Online Test-Time Adaptation (OTTA) has emerged as an effective strategy to handle distributional shifts, allowing on-the-fly adaptation of pre-trained models to new target domains during inference, without the need for source data. We…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 WeiQin Chuah , Ruwan Tennakoon , Alireza Bab-Hadiashar

Mainstream test-time adaptation (TTA) techniques endeavor to mitigate distribution shifts via entropy minimization for multi-class classification, inherently increasing the probability of the most confident class. However, when encountering…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Xiangyu Wu , Feng Yu , Qing-Guo Chen , Yang Yang , Jianfeng Lu

Continual learning entails learning a sequence of tasks and balancing their knowledge appropriately. With limited access to old training samples, much of the current work in deep neural networks has focused on overcoming catastrophic…

Machine Learning · Computer Science 2023-10-16 Yilin Lyu , Liyuan Wang , Xingxing Zhang , Zicheng Sun , Hang Su , Jun Zhu , Liping Jing