English
Related papers

Related papers: Test-time Batch Statistics Calibration for Covaria…

200 papers

Convolutional neural networks trained on publicly available medical imaging datasets (source domain) rarely generalise to different scanners or acquisition protocols (target domain). This motivates the active field of domain adaptation.…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Thomas Varsavsky , Mauricio Orbes-Arteaga , Carole H. Sudre , Mark S. Graham , Parashkev Nachev , M. Jorge Cardoso

A model must adapt itself to generalize to new and different data during testing. In this setting of fully test-time adaptation the model has only the test data and its own parameters. We propose to adapt by test entropy minimization…

Machine Learning · Computer Science 2021-03-19 Dequan Wang , Evan Shelhamer , Shaoteng Liu , Bruno Olshausen , Trevor Darrell

Continual Test-Time Adaptation (CTTA) task investigates effective domain adaptation under the scenario of continuous domain shifts during testing time. Due to the utilization of solely unlabeled samples, there exists significant uncertainty…

Machine Learning · Computer Science 2025-12-18 Fan Lyu , Kaile Du , Yuyang Li , Hanyu Zhao , Fuyuan Hu , Zhang Zhang , Guangcan Liu , Liang Wang

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sicheng Zhao , Bichen Wu , Joseph Gonzalez , Sanjit A. Seshia , Kurt Keutzer

Real-world image recognition systems often face corrupted input images, which cause distribution shifts and degrade the performance of models. These systems often use a single prediction model in a central server and process images sent…

Machine Learning · Computer Science 2025-12-03 Kazuki Adachi , Shin'ya Yamaguchi , Atsutoshi Kumagai

Deep neural networks rely heavily on normalization methods to improve their performance and learning behavior. Although normalization methods spurred the development of increasingly deep and efficient architectures, they also increase the…

Machine Learning · Computer Science 2021-10-06 Alexander Fuchs , Christian Knoll , Franz Pernkopf

Deep convolutional neural networks have considerably improved state-of-the-art results for semantic segmentation. Nevertheless, even modern architectures lack the ability to generalize well to a test dataset that originates from a different…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Robert A. Marsden , Alexander Bartler , Mario Döbler , Bin Yang

Batch Normalization (BN)(Ioffe and Szegedy 2015) normalizes the features of an input image via statistics of a batch of images and hence BN will bring the noise to the gradient of the training loss. Previous works indicate that the noise is…

Machine Learning · Computer Science 2019-09-19 Senwei Liang , Zhongzhan Huang , Mingfu Liang , Haizhao Yang

The assumption that training and testing samples are generated from the same distribution does not always hold for real-world machine-learning applications. The procedure of tackling this discrepancy between the training (source) and…

Machine Learning · Computer Science 2018-12-05 Debasmit Das , C. S. George Lee

While recent computer vision algorithms achieve impressive performance on many benchmarks, they lack robustness - presented with an image from a different distribution, (e.g. weather or lighting conditions not considered during training),…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Sebastian Cygert , Bartłomiej Wróblewski , Karol Woźniak , Radosław Słowiński , Andrzej Czyżewski

Adversarial learning baselines for domain adaptation (DA) approaches in the context of semantic segmentation are under explored in semi-supervised framework. These baselines involve solely the available labeled target samples in the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Marwa Kechaou , Mokhtar Z. Alaya , Romain Hérault , Gilles Gasso

We consider the unsupervised scene adaptation problem of learning from both labeled source data and unlabeled target data. Existing methods focus on minoring the inter-domain gap between the source and target domains. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Zhedong Zheng , Yi Yang

In machine learning, if the training data is an unbiased sample of an underlying distribution, then the learned classification function will make accurate predictions for new samples. However, if the training data is not an unbiased sample,…

Machine Learning · Computer Science 2019-01-15 Wouter M. Kouw , Marco Loog

Collection of real world annotations for training semantic segmentation models is an expensive process. Unsupervised domain adaptation (UDA) tries to solve this problem by studying how more accessible data such as synthetic data can be used…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Kian Boon Koh , Basura Fernando

Unsupervised domain adaptation (DA) has gained substantial interest in semantic segmentation. However, almost all prior arts assume concurrent access to both labeled source and unlabeled target, making them unsuitable for scenarios…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Jogendra Nath Kundu , Akshay Kulkarni , Amit Singh , Varun Jampani , R. Venkatesh Babu

We consider the novel problem of unsupervised domain adaptation of source models, without access to the source data for semantic segmentation. Unsupervised domain adaptation aims to adapt a model learned on the labeled source data, to a new…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Sujoy Paul , Ansh Khurana , Gaurav Aggarwal

Deep neural networks often degrade under distribution shifts. Although domain adaptation offers a solution, privacy constraints often prevent access to source data, making Test-Time Adaptation (TTA, which adapts using only unlabeled test…

Machine Learning · Computer Science 2025-06-10 Linjing You , Jiabao Lu , Xiayuan Huang

In this paper, we propose a generalization of the Batch Normalization (BN) algorithm, diminishing batch normalization (DBN), where we update the BN parameters in a diminishing moving average way. BN is very effective in accelerating the…

Machine Learning · Computer Science 2019-02-20 Yintai Ma , Diego Klabjan

Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing. Test-Time Training (TTT) methods have recently gained popularity by their ability to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 David Osowiechi , Gustavo A. Vargas Hakim , Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers