English
Related papers

Related papers: Improving Batch Normalization with TTA for Robust …

200 papers

Batch Normalization (BN) has become a cornerstone of deep learning across diverse architectures, appearing to help optimization as well as generalization. While the idea makes intuitive sense, theoretical analysis of its effectiveness has…

Machine Learning · Computer Science 2018-12-11 Sanjeev Arora , Zhiyuan Li , Kaifeng Lyu

Test-time adaptation (TTA) refers to adjusting the model during the testing phase to cope with changes in sample distribution and enhance the model's adaptability to new environments. In real-world scenarios, models often encounter samples…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ziqiong Liu , Yushun Tang , Junyang Ji , Zhihai He

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model…

Machine Learning · Computer Science 2023-01-12 Taesik Gong , Jongheon Jeong , Taewon Kim , Yewon Kim , Jinwoo Shin , Sung-Ju Lee

This study develops a higher-order asymptotic framework for test-time adaptation (TTA) of Batch Normalization (BN) statistics under distribution shift by integrating classical Edgeworth expansion and saddlepoint approximation techniques…

Machine Learning · Statistics 2025-05-23 Masanari Kimura

In this study, we introduce an intelligent Test Time Augmentation (TTA) algorithm designed to enhance the robustness and accuracy of image classification models against viewpoint variations. Unlike traditional TTA methods that…

Image and Video Processing · Electrical Eng. & Systems 2024-06-14 Efe Ozturk , Mohit Prabhushankar , Ghassan AlRegib

Despite the significant success of deep learning in computer vision tasks, cross-domain tasks still present a challenge in which the model's performance will degrade when the training set and the test set follow different distributions.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Lei Qi , Dongjia Zhao , Yinghuan Shi , Xin Geng

Most object detection methods for autonomous driving usually assume a consistent feature distribution between training and testing data, which is not always the case when weathers differ significantly. The object detection model trained…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Jinlong Li , Runsheng Xu , Jin Ma , Qin Zou , Jiaqi Ma , Hongkai Yu

Test-time adaptation (TTA) has emerged as a promising solution to address performance decay due to unforeseen distribution shifts between training and test data. While recent TTA methods excel in adapting to test data variations, such…

Machine Learning · Computer Science 2024-03-29 Hyejin Park , Jeongyeon Hwang , Sunung Mun , Sangdon Park , Jungseul Ok

In this paper, we investigate the generalization problem of person re-identification (re-id), whose major challenge is the distribution shift on an unseen domain. As an important tool of regularizing the distribution, batch normalization…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ke Han , Chenyang Si , Yan Huang , Liang Wang , Tieniu Tan

Detecting vehicles in aerial imagery is a critical task with applications in traffic monitoring, urban planning, and defense intelligence. Deep learning methods have provided state-of-the-art (SOTA) results for this application. However, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Xiao Fang , Minhyek Jeon , Zheyang Qin , Stanislav Panev , Celso de Melo , Shuowen Hu , Shayok Chakraborty , Fernando De la Torre

The rapid development of 3D object detection systems for self-driving cars has significantly improved accuracy. However, these systems struggle to generalize across diverse driving environments, which can lead to safety-critical failures in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Travis Zhang , Katie Luo , Cheng Perng Phoo , Yurong You , Wei-Lun Chao , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger

In autonomous driving, 3D object detection is essential for accurately identifying and tracking objects. Despite the continuous development of various technologies for this task, a significant drawback is observed in most of them-they…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Hsin-Cheng Lu , Chung-Yi Lin , Winston H. Hsu

Batch normalization (BN) is a ubiquitous technique for training deep neural networks that accelerates their convergence to reach higher accuracy. However, we demonstrate that BN comes with a fundamental drawback: it incentivizes the model…

Machine Learning · Computer Science 2022-07-05 Saeid Asgari Taghanaki , Ali Gholami , Fereshte Khani , Kristy Choi , Linh Tran , Ran Zhang , Aliasghar Khani

Deep learning models often struggle under natural distribution shifts, a common challenge in real-world deployments. Test-Time Adaptation (TTA) addresses this by adapting models during inference without labeled source data. We present the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 John Turnbull , Shivam Grover , Amin Jalali , Ali Etemad

Environment perception in autonomous driving vehicles often heavily relies on deep neural networks (DNNs), which are subject to domain shifts, leading to a significantly decreased performance during DNN deployment. Usually, this problem is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Marvin Klingner , Mouadh Ayache , Tim Fingscheidt

Continual Test Time Adaptation (CTTA) has emerged as a critical approach for bridging the domain gap between the controlled training environments and the real-world scenarios, enhancing model adaptability and robustness. Existing CTTA…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Hyewon Park , Hyejin Park , Jueun Ko , Dongbo Min

We focus on bridging domain discrepancy in lane detection among different scenarios to greatly reduce extra annotation and re-training costs for autonomous driving. Critical factors hinder the performance improvement of cross-domain lane…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Chenguang Li , Boheng Zhang , Jia Shi , Guangliang Cheng

Continual Test-Time Adaptation (CTTA) enables pre-trained models to adapt to continuously evolving domains. Existing methods have improved robustness but typically rely on fixed or batch-level thresholds, which cannot account for varying…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Seunghwan Lee , Inyoung Jung , Hojoon Lee , Eunil Park , Sungeun Hong

In this paper, we seek to develop a versatile test-time adaptation (TTA) objective for a variety of tasks - classification and regression across image-, object-, and pixel-level predictions. We achieve this through a self-bootstrapping…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Shuaicheng Niu , Guohao Chen , Peilin Zhao , Tianyi Wang , Pengcheng Wu , Zhiqi Shen

Utilizing well-trained representations in transfer learning often results in superior performance and faster convergence compared to training from scratch. However, even if such good representations are transferred, a model can easily…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 SeokHyun Seo , Jinwoo Hong , JungWoo Chae , Kyungyul Kim , Sangheum Hwang