English
Related papers

Related papers: Unraveling Batch Normalization for Realistic Test-…

200 papers

Batch Normalization (BN) is one of the most widely used techniques in Deep Learning field. But its performance can awfully degrade with insufficient batch size. This weakness limits the usage of BN on many computer vision tasks like…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Junjie Yan , Ruosi Wan , Xiangyu Zhang , Wei Zhang , Yichen Wei , Jian Sun

Given the inevitability of domain shifts during inference in real-world applications, test-time adaptation (TTA) is essential for model adaptation after deployment. However, the real-world scenario of continuously changing target…

Machine Learning · Computer Science 2023-11-28 Junyoung Park , Jin Kim , Hyeongjun Kwon , Ilhoon Yoon , Kwanghoon Sohn

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

Test-time alignment (TTA) aims to adapt models to specific rewards during inference. However, existing methods tend to either under-optimise or over-optimise (reward hack) the target reward function. We propose Null-Text Test-Time Alignment…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Taehoon Kim , Henry Gouk , Timothy Hospedales

Test-time adaptive (TTA) semantic segmentation adapts a source pre-trained image semantic segmentation model to unlabeled batches of target domain test images, different from real-world, where samples arrive one-by-one in an online fashion.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Debasmit Das , Shubhankar Borse , Hyojin Park , Kambiz Azarian , Hong Cai , Risheek Garrepalli , Fatih Porikli

Deep learning has become the method of choice to tackle real-world problems in different domains, partly because of its ability to learn from data and achieve impressive performance on a wide range of applications. However, its success…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Xiaofeng Liu , Chaehwa Yoo , Fangxu Xing , Hyejin Oh , Georges El Fakhri , Je-Won Kang , Jonghye Woo

Applying an object detector, which is neither trained nor fine-tuned on data close to the final application, often leads to a substantial performance drop. In order to overcome this problem, it is necessary to consider a shift between…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Alexey Abramov , Christopher Bayer , Claudio Heller

Adapting a trained model to perform satisfactorily on continually changing testing domains/environments is an important and challenging task. In this work, we propose a novel framework, SATA, which aims to satisfy the following…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Goirik Chakrabarty , Manogna Sreenivas , Soma Biswas

When neural networks are confronted with unfamiliar data that deviate from their training set, this signifies a domain shift. While these networks output predictions on their inputs, they typically fail to account for their level of…

Machine Learning · Computer Science 2025-09-09 Fin Amin , Jung-Eun Kim

This paper presents an effective and general data augmentation framework for medical image segmentation. We adopt a computationally efficient and data-efficient gradient-based meta-learning scheme to explicitly align the distribution of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Zeju Li , Konstantinos Kamnitsas , Qi Dou , Chen Qin , Ben Glocker

Vision-language models (VLMs) exhibit remarkable zero-shot capabilities but struggle with distribution shifts in downstream tasks when labeled data is unavailable, which has motivated the development of Test-Time Adaptation (TTA) to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Yiwen Liang , Hui Chen , Yizhe Xiong , Zihan Zhou , Mengyao Lyu , Zijia Lin , Shuaicheng Niu , Sicheng Zhao , Jungong Han , Guiguang Ding

Batch Normalization is quite effective at accelerating and improving the training of deep models. However, its effectiveness diminishes when the training minibatches are small, or do not consist of independent samples. We hypothesize that…

Machine Learning · Computer Science 2017-03-31 Sergey Ioffe

Referring image segmentation aims to segment specific targets based on a natural text expression. Recently, parameter-efficient tuning (PET) has emerged as a promising paradigm. However, existing PET-based methods often suffer from the fact…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Shuo Jin , Siyue Yu , Bingfeng Zhang , Chao Yao , Meiqin Liu , Jimin Xiao

Fully test-time adaptation (FTTA) adapts a model that is trained on a source domain to a target domain during the testing phase, where the two domains follow different distributions and source data is unavailable during the training phase.…

Artificial Intelligence · Computer Science 2023-12-15 Houcheng Su , Daixian Liu , Mengzhu Wang , Wei Wang

Convolutional neural networks trained on publicly available medical imaging datasets (source domain) rarely generalise to different scanners or acquisition protocols (target domain). This motivates the active field of domain adaptation.…

Image and Video Processing · Electrical Eng. & Systems 2020-10-06 Thomas Varsavsky , Mauricio Orbes-Arteaga , Carole H. Sudre , Mark S. Graham , Parashkev Nachev , M. Jorge Cardoso

Domain Adaptation (DA) techniques are important for overcoming the domain shift between the source domain used for training and the target domain where testing takes place. However, current DA methods assume that the entire target domain is…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Abu Md Niamul Taufique , Chowdhury Sadman Jahan , Andreas Savakis

Unsupervised tabular anomaly detection methods typically learn feature patterns from normal samples during training and subsequently identify samples that deviate from these patterns as anomalies during testing. However, in practical…

Machine Learning · Computer Science 2026-05-12 Wei Huang , Hezhe Qiao , Kailai Zhang , Zaisheng Ye , Yu-Ming Shang , Xiangling Fu

Test-time adaptation harnesses test inputs to improve the accuracy of a model trained on source data when tested on shifted target data. Existing methods update the source model by (re-)training on each target domain. While effective,…

Machine Learning · Computer Science 2023-06-22 Jin Gao , Jialing Zhang , Xihui Liu , Trevor Darrell , Evan Shelhamer , Dequan Wang

Data-driven fault diagnostics and prognostics suffers from class-imbalance problem in industrial systems and it raises challenges to common machine learning algorithms as it becomes difficult to learn the features of the minority class…

Machine Learning · Computer Science 2018-11-20 Wenfang Lin , Zhenyu Wu , Yang Ji

The assumption that training and testing samples are generated from the same distribution does not always hold for real-world machine-learning applications. The procedure of tackling this discrepancy between the training (source) and…

Machine Learning · Computer Science 2018-12-05 Debasmit Das , C. S. George Lee