English
Related papers

Related papers: Un-Mixing Test-Time Normalization Statistics: Comb…

200 papers

We study the problem of unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain. Recently, the cluster assumption has been applied to unsupervised domain…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Xudong Mao , Yun Ma , Zhenguo Yang , Yangbin Chen , Qing Li

A primary challenge in semi-supervised learning (SSL) for segmentation is the confirmation bias from noisy pseudo-labels, which destabilizes training and degrades performance. We propose Inconsistency Masks (IM), a framework that reframes…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Michael R. H. Vorndran , Bernhard F. Roeck

In Self-Supervised Learning (SSL), models are typically pretrained, fine-tuned, and evaluated on the same domains. However, they tend to perform poorly when evaluated on unseen domains, a challenge that Unsupervised Domain Generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Marin Scalbert , Maria Vakalopoulou , Florent Couzinié-Devy

Deploying models on target domain data subject to distribution shift requires adaptation. Test-time training (TTT) emerges as a solution to this adaptation under a realistic scenario where access to full source domain data is not available…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Yongyi Su , Xun Xu , Kui Jia

Under label shift, the label distribution p(y) might change but the class-conditional distributions p(x|y) do not. There are two dominant approaches for estimating the label marginal. BBSE, a moment-matching approach based on confusion…

Machine Learning · Computer Science 2020-10-20 Saurabh Garg , Yifan Wu , Sivaraman Balakrishnan , Zachary C. Lipton

Time series forecasting is a crucial task in various domains. Caused by factors such as trends, seasonality, or irregular fluctuations, time series often exhibits non-stationary. It obstructs stable feature propagation through deep layers,…

Machine Learning · Computer Science 2024-01-05 Xiang Ma , Xuemei Li , Lexin Fang , Tianlong Zhao , Caiming Zhang

Normalization methods are a central building block in the deep learning toolbox. They accelerate and stabilize training, while decreasing the dependence on manually tuned learning rate schedules. When learning from multi-modal…

Machine Learning · Computer Science 2018-10-15 Lucas Deecke , Iain Murray , Hakan Bilen

Test-time adaptation (TTA) intends to adapt the pretrained model to test distributions with only unlabeled test data streams. Most of the previous TTA methods have achieved great success on simple test data streams such as independently…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Longhui Yuan , Binhui Xie , Shuang Li

Test-Time Adaptation (TTA) adjusts models using unlabeled test data to handle dynamic distribution shifts. However, existing methods rely on frequent adaptation and high computational cost, making them unsuitable for resource-constrained…

Machine Learning · Computer Science 2025-11-20 Hyeongheon Cha , Dong Min Kim , Hye Won Chung , Taesik Gong , Sung-Ju Lee

With significant advancements in diffusion models, addressing the potential risks of dataset bias becomes increasingly important. Since generated outputs directly suffer from dataset bias, mitigating latent bias becomes a key factor in…

Machine Learning · Computer Science 2024-03-05 Yeongmin Kim , Byeonghu Na , Minsang Park , JoonHo Jang , Dongjun Kim , Wanmo Kang , Il-Chul Moon

Changes in the data distribution at test time can have deleterious effects on the performance of predictive models $p(y|x)$. We consider situations where there are additional meta-data labels (such as group labels), denoted by $z$, that can…

Machine Learning · Statistics 2023-11-30 Qingyao Sun , Kevin Murphy , Sayna Ebrahimi , Alexander D'Amour

While large volumes of unlabeled data are usually available, associated labels are often scarce. The unsupervised domain adaptation problem aims at exploiting labels from a source domain to classify data from a related, yet different,…

Machine Learning · Computer Science 2023-08-28 François Painblanc , Laetitia Chapel , Nicolas Courty , Chloé Friguet , Charlotte Pelletier , Romain Tavenard

Self-training often falls short under distribution shifts due to an increased discrepancy between prediction confidence and actual accuracy. This typically necessitates computationally demanding methods such as neighborhood or…

Machine Learning · Computer Science 2024-11-04 Taejong Joo , Diego Klabjan

Medical data poses a daunting challenge for AI algorithms: it exists in many different modalities, experiences frequent distribution shifts, and suffers from a scarcity of examples and labels. Recent advances, including transformers and…

Semi-supervised text classification (SSTC) has gained increasing attention due to its ability to leverage unlabeled data. However, existing approaches based on pseudo-labeling suffer from the issues of pseudo-label bias and error…

Computation and Language · Computer Science 2023-10-24 Henry Peng Zou , Cornelia Caragea

We report our ongoing work about a new deep architecture working in tandem with a statistical test procedure for jointly training texts and their label descriptions for multi-label and multi-class classification tasks. A statistical…

Computation and Language · Computer Science 2019-06-18 Ahmad Aghaebrahimian , Mark Cieliebak

Studies on semi-supervised medical image segmentation (SSMIS) have seen fast progress recently. Due to the limited labelled data, SSMIS methods mainly focus on effectively leveraging unlabeled data to enhance the segmentation performance.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zhen Zhao , Ye Liu , Meng Zhao , Di Yin , Yixuan Yuan , Luping Zhou

Deploying models on target domain data subject to distribution shift requires adaptation. Test-time training (TTT) emerges as a solution to this adaptation under a realistic scenario where access to full source domain data is not available,…

Machine Learning · Computer Science 2023-03-21 Yongyi Su , Xun Xu , Tianrui Li , Kui Jia

Label noise is ubiquitous in real-world scenarios, posing a practical challenge to supervised models due to its effect in hurting the generalization performance of deep neural networks. Existing methods primarily employ the sample selection…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Mengmeng Sheng , Zeren Sun , Tao Chen , Shuchao Pang , Yucheng Wang , Yazhou Yao

When neural networks are confronted with unfamiliar data that deviate from their training set, this signifies a domain shift. While these networks output predictions on their inputs, they typically fail to account for their level of…

Machine Learning · Computer Science 2025-09-09 Fin Amin , Jung-Eun Kim