English
Related papers

Related papers: Un-Mixing Test-Time Normalization Statistics: Comb…

200 papers

To deal with the domain shift between training and test samples, current methods have primarily focused on learning generalizable features during training and ignore the specificity of unseen samples that are also critical during the test.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Irregular multivariate time series (IMTS) is characterized by the lack of synchronized observations across its different channels. In this paper, we point out that this channel-wise asynchrony can lead to poor channel-wise modeling of…

Machine Learning · Computer Science 2025-09-23 Shuhan Zhong , Weipeng Zhuo , Sizhe Song , Guanyao Li , Zhongyi Yu , S. -H. Gary Chan

Model Merging (MM) has emerged as a scalable paradigm for multi-task learning (MTL), enabling multiple task-specific models to be integrated without revisiting the original training data. Despite recent progress, the reliability of MM under…

Machine Learning · Computer Science 2026-03-12 Yuhan Xie , Chen Lyu

In this paper, we investigate the generalization problem of person re-identification (re-id), whose major challenge is the distribution shift on an unseen domain. As an important tool of regularizing the distribution, batch normalization…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ke Han , Chenyang Si , Yan Huang , Liang Wang , Tieniu Tan

When faced with distribution shift at test time, deep neural networks often make inaccurate predictions with unreliable uncertainty estimates. While improving the robustness of neural networks is one promising approach to mitigate this…

Machine Learning · Computer Science 2021-09-28 Aurick Zhou , Sergey Levine

Machine learning methods strive to acquire a robust model during the training process that can effectively generalize to test samples, even in the presence of distribution shifts. However, these methods often suffer from performance…

Machine Learning · Computer Science 2024-12-13 Jian Liang , Ran He , Tieniu Tan

Domain adaptation is an important technique to alleviate performance degradation caused by domain shift, e.g., when training and test data come from different domains. Most existing deep adaptation methods focus on reducing domain shift by…

Machine Learning · Computer Science 2019-06-25 Jun Wen , Nenggan Zheng , Junsong Yuan , Zhefeng Gong , Changyou Chen

The drastic increase of data quantity often brings the severe decrease of data quality, such as incorrect label annotations, which poses a great challenge for robustly training Deep Neural Networks (DNNs). Existing learning \mbox{methods}…

Machine Learning · Computer Science 2022-03-18 Qizhou Wang , Bo Han , Tongliang Liu , Gang Niu , Jian Yang , Chen Gong

Class distribution plays an important role in learning deep classifiers. When the proportion of each class in the test set differs from the training set, the performance of classification nets usually degrades. Such a label distribution…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Wenao Ma , Cheng Chen , Shuang Zheng , Jing Qin , Huimao Zhang , Qi Dou

Unsupervised tabular anomaly detection methods typically learn feature patterns from normal samples during training and subsequently identify samples that deviate from these patterns as anomalies during testing. However, in practical…

Machine Learning · Computer Science 2026-05-12 Wei Huang , Hezhe Qiao , Kailai Zhang , Zaisheng Ye , Yu-Ming Shang , Xiangling Fu

While deep neural networks have achieved remarkable performance, data augmentation has emerged as a crucial strategy to mitigate overfitting and enhance network performance. These techniques hold particular significance in industrial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Hyungmin Kim , Donghun Kim , Pyunghwan Ahn , Sungho Suh , Hansang Cho , Junmo Kim

Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing. Test-Time Training (TTT) methods have recently gained popularity by their ability to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 David Osowiechi , Gustavo A. Vargas Hakim , Mehrdad Noori , Milad Cheraghalikhani , Ali Bahri , Moslem Yazdanpanah , Ismail Ben Ayed , Christian Desrosiers

Since distribution shifts are likely to occur after a model's deployment and can drastically decrease the model's performance, online test-time adaptation (TTA) continues to update the model during test-time, leveraging the current test…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Mario Döbler , Florian Marencke , Robert A. Marsden , Bin Yang

Continual learning entails learning a sequence of tasks and balancing their knowledge appropriately. With limited access to old training samples, much of the current work in deep neural networks has focused on overcoming catastrophic…

Machine Learning · Computer Science 2023-10-16 Yilin Lyu , Liyuan Wang , Xingxing Zhang , Zicheng Sun , Hang Su , Jun Zhu , Liping Jing

Computer-aided diagnosis systems must make critical decisions from medical images that are often noisy, ambiguous, or conflicting, yet today's models are trained on overly simplistic labels that ignore diagnostic uncertainty. One-hot labels…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Ang Nan Gu , Michael Tsang , Hooman Vaseli , Purang Abolmaesumi , Teresa Tsang

Test-time computing approaches, which leverage additional computational resources during inference, have been proven effective in enhancing large language model performance. This work introduces a novel, linearly scaling approach, TestNUC,…

Computation and Language · Computer Science 2025-06-03 Henry Peng Zou , Zhengyao Gu , Yue Zhou , Yankai Chen , Weizhi Zhang , Liancheng Fang , Yibo Wang , Yangning Li , Kay Liu , Philip S. Yu

Despite progress, deep neural networks still suffer performance declines under distribution shifts between training and test domains, leading to a substantial decrease in Quality of Experience (QoE) for multimedia applications. Existing…

Machine Learning · Computer Science 2024-06-11 Qinting Jiang , Chuyang Ye , Dongyan Wei , Yuan Xue , Jingyan Jiang , Zhi Wang

We study the problem of continual test-time adaption where the goal is to adapt a source pre-trained model to a sequence of unlabelled target domains at test time. Existing methods on test-time training suffer from several limitations: (1)…

Machine Learning · Computer Science 2024-10-03 Kien X. Nguyen , Fengchun Qiao , Xi Peng

Test-time adaptation (TTA) has emerged as a promising solution to address performance decay due to unforeseen distribution shifts between training and test data. While recent TTA methods excel in adapting to test data variations, such…

Machine Learning · Computer Science 2024-03-29 Hyejin Park , Jeongyeon Hwang , Sunung Mun , Sangdon Park , Jungseul Ok

In label-noise learning, estimating the transition matrix has attracted more and more attention as the matrix plays an important role in building statistically consistent classifiers. However, it is very challenging to estimate the…

Machine Learning · Computer Science 2022-06-08 De Cheng , Tongliang Liu , Yixiong Ning , Nannan Wang , Bo Han , Gang Niu , Xinbo Gao , Masashi Sugiyama