English
Related papers

Related papers: Test-Time Adaptation to Distribution Shift by Conf…

200 papers

Test-time adaptation (TTA) refers to adapting neural networks to distribution shifts, with access to only the unlabeled test samples from the new domain at test-time. Prior TTA methods optimize over unsupervised objectives such as the…

Machine Learning · Computer Science 2022-11-24 Sachin Goyal , Mingjie Sun , Aditi Raghunathan , Zico Kolter

We propose a method for adapting neural networks to distribution shifts at test-time. In contrast to training-time robustness mechanisms that attempt to anticipate and counter the shift, we create a closed-loop system and make use of a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Teresa Yeo , Oğuzhan Fatih Kar , Zahra Sodagar , Amir Zamir

In this work, we propose a novel complementary learning approach to enhance test-time adaptation (TTA), which has been proven to exhibit good performance on testing data with distribution shifts such as corruptions. In test-time adaptation…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Jiayi Han , Longbin Zeng , Liang Du , Weiyang Ding , Jianfeng Feng

Deep neural networks have a clear degradation when applying to the unseen environment due to the covariate shift. Conventional approaches like domain adaptation requires the pre-collected target data for iterative training, which is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Fuming You , Jingjing Li , Zhou Zhao

Test-Time Adaptation aims to adapt source domain model to testing data at inference stage with success demonstrated in adapting to unseen corruptions. However, these attempts may fail under more challenging real-world scenarios. Existing…

Machine Learning · Computer Science 2025-03-27 Yongyi Su , Xun Xu , Kui Jia

Given a model trained on source data, Test-Time Adaptation (TTA) enables adaptation and inference in test data streams with domain shifts from the source. Current methods predominantly optimize the model for each incoming test data batch…

Machine Learning · Computer Science 2024-07-18 Ziqiang Wang , Zhixiang Chi , Yanan Wu , Li Gu , Zhi Liu , Konstantinos Plataniotis , Yang Wang

Deep networks are prone to performance degradation when there is a domain shift between the source (training) data and target (test) data. Recent test-time adaptation methods update batch normalization layers of pre-trained source models…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Wenyu Zhang , Li Shen , Wanyue Zhang , Chuan-Sheng Foo

Data augmentation has been actively studied for robust neural networks. Most of the recent data augmentation methods focus on augmenting datasets during the training phase. At the testing phase, simple transformations are still widely used…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Ildoo Kim , Younghoon Kim , Sungwoong Kim

Test-time adaptation (TTA) aims at adapting a model pre-trained on the labeled source domain to the unlabeled target domain. Existing methods usually focus on improving TTA performance under covariate shifts, while neglecting semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Zhengqing Gao , Xu-Yao Zhang , Cheng-Lin Liu

Data samples generated by several real world processes are dynamic in nature \textit{i.e.}, their characteristics vary with time. Thus it is not possible to train and tackle all possible distributional shifts between training and inference,…

Machine Learning · Computer Science 2021-10-22 Prabhu Teja Sivaprasad , François Fleuret

Despite recent advancements in deep learning, deep neural networks continue to suffer from performance degradation when applied to new data that differs from training data. Test-time adaptation (TTA) aims to address this challenge by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanghun Jung , Jungsoo Lee , Nanhee Kim , Amirreza Shaban , Byron Boots , Jaegul Choo

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

Machine Learning · Computer Science 2025-02-06 Minguk Jang , Hye Won Chung

Test-time domain adaptation aims to adapt a source pre-trained model to a target domain without using any source data. Existing works mainly consider the case where the target domain is static. However, real-world machine perception systems…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Qin Wang , Olga Fink , Luc Van Gool , Dengxin Dai

Test-time adaptation (TTA) is a technique used to reduce distribution gaps between the training and testing sets by leveraging unlabeled test data during inference. In this work, we expand TTA to a more practical scenario, where the test…

Machine Learning · Computer Science 2023-03-06 Chenyan Wu , Yimu Pan , Yandong Li , James Z. Wang

Deepfake (DF) detectors face significant challenges when deployed in real-world environments, particularly when encountering test samples deviated from training data through either postprocessing manipulations or distribution shifts. We…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Hong-Hanh Nguyen-Le , Van-Tuan Tran , Dinh-Thuc Nguyen , Nhien-An Le-Khac

We demonstrate that self-learning techniques like entropy minimization and pseudo-labeling are simple and effective at improving performance of a deployed computer vision model under systematic domain shifts. We conduct a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Evgenia Rusak , Steffen Schneider , George Pachitariu , Luisa Eck , Peter Gehler , Oliver Bringmann , Wieland Brendel , Matthias Bethge

In contrast to close-set scenarios that restore images from a predefined set of degradations, open-set image restoration aims to handle the unknown degradations that were unforeseen during the pretraining phase, which is less-touched as far…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Yuanbiao Gou , Haiyu Zhao , Boyun Li , Xinyan Xiao , Xi Peng

Test-time adaptation aims to adapt to realistic environments in an online manner by learning during test time. Entropy minimization has emerged as a principal strategy for test-time adaptation due to its efficiency and adaptability.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Jisu Han , Jaemin Na , Wonjun Hwang

Deep neural networks often fail to generalize outside of their training distribution, in particular when only a single data domain is available during training. While test-time adaptation has yielded encouraging results in this setting, we…

Machine Learning · Computer Science 2022-12-26 Thomas Duboudin , Emmanuel Dellandréa , Corentin Abgrall , Gilles Hénaff , Liming Chen

Test-time adaptation (TTA) seeks to tackle potential distribution shifts between training and test data by adapting a given model w.r.t. any test sample. Although recent TTA has shown promising performance, we still face two key challenges:…

Machine Learning · Computer Science 2025-08-27 Mingkui Tan , Guohao Chen , Jiaxiang Wu , Yifan Zhang , Yaofo Chen , Peilin Zhao , Shuaicheng Niu