中文
相关论文

相关论文: Meta-TTT: A Meta-learning Minimax Framework For Te…

200 篇论文

Batch normalization (BN) is a ubiquitous technique for training deep neural networks that accelerates their convergence to reach higher accuracy. However, we demonstrate that BN comes with a fundamental drawback: it incentivizes the model…

机器学习 · 计算机科学 2022-07-05 Saeid Asgari Taghanaki , Ali Gholami , Fereshte Khani , Kristy Choi , Linh Tran , Ran Zhang , Aliasghar Khani

Semi-supervised domain adaptation (SSDA) is quite a challenging problem requiring methods to overcome both 1) overfitting towards poorly annotated data and 2) distribution shift across domains. Unfortunately, a simple combination of domain…

计算机视觉与模式识别 · 计算机科学 2022-12-07 Can Qin , Lichen Wang , Qianqian Ma , Yu Yin , Huan Wang , Yun Fu

Deep Learning models have shown remarkable performance in a broad range of vision tasks. However, they are often vulnerable against domain shifts at test-time. Test-time training (TTT) methods have been developed in an attempt to mitigate…

计算机视觉与模式识别 · 计算机科学 2023-10-20 Gustavo A. Vargas Hakim , David Osowiechi , Mehrdad Noori , Milad Cheraghalikhani , Ismail Ben Ayed , Christian Desrosiers

Batch Normalization (BN) is an important preprocessing step to many deep learning applications. Since it is a data-dependent process, for some homogeneous datasets it is a redundant or even a performance-degrading process. In this paper, we…

机器学习 · 计算机科学 2022-12-01 Wael Alsobhi , Tarik Alafif , Alaa Abdel-Hakim , Weiwei Zong

Deep neural networks have useful applications in many different tasks, however their performance can be severely affected by changes in the data distribution. For example, in the biomedical field, their performance can be affected by…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Pedro Vianna , Muawiz Chaudhary , Paria Mehrbod , An Tang , Guy Cloutier , Guy Wolf , Michael Eickenberg , Eugene Belilovsky

Test-time domain adaptation aims to adapt a source pre-trained model to a target domain without using any source data. Existing works mainly consider the case where the target domain is static. However, real-world machine perception systems…

计算机视觉与模式识别 · 计算机科学 2022-03-28 Qin Wang , Olga Fink , Luc Van Gool , Dengxin Dai

The main challenge in domain generalization (DG) is to handle the distribution shift problem that lies between the training and test data. Recent studies suggest that test-time training (TTT), which adapts the learned model with test data,…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Liang Chen , Yong Zhang , Yibing Song , Ying Shan , Lingqiao Liu

To deal with the domain shift between training and test samples, current methods have primarily focused on learning generalizable features during training and ignore the specificity of unseen samples that are also critical during the test.…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Domain shift is a common problem in the realistic world, where training data and test data follow different data distributions. To deal with this problem, fully test-time adaptation (TTA) leverages the unlabeled data encountered during test…

人工智能 · 计算机科学 2024-04-29 Guoliang Lin , Hanjiang Lai , Yan Pan , Jian Yin

Deep-learning based speech separation models confront poor generalization problem that even the state-of-the-art models could abruptly fail when evaluating them in mismatch conditions. To address this problem, we propose an…

音频与语音处理 · 电气工程与系统科学 2020-03-04 Max W. Y. Lam , Jun Wang , Dan Su , Dong Yu

In this paper, we investigate the generalization problem of person re-identification (re-id), whose major challenge is the distribution shift on an unseen domain. As an important tool of regularizing the distribution, batch normalization…

计算机视觉与模式识别 · 计算机科学 2022-03-29 Ke Han , Chenyang Si , Yan Huang , Liang Wang , Tieniu Tan

Test-time adaptation (TTA) aims to adapt a trained classifier using online unlabeled test data only, without any information related to the training procedure. Most existing TTA methods adapt the trained classifier using the classifier's…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Minguk Jang , Sae-Young Chung , Hye Won Chung

Contemporary domain adaptation methods are very effective at aligning feature distributions of source and target domains without any target supervision. However, we show that these techniques perform poorly when even a few labeled examples…

计算机视觉与模式识别 · 计算机科学 2019-09-17 Kuniaki Saito , Donghyun Kim , Stan Sclaroff , Trevor Darrell , Kate Saenko

In this work we examine how fine-tuning impacts the fairness of contrastive Self-Supervised Learning (SSL) models. Our findings indicate that Batch Normalization (BN) statistics play a crucial role, and that updating only the BN statistics…

机器学习 · 计算机科学 2021-10-04 Jason Ramapuram , Dan Busbridge , Russ Webb

Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which…

计算机视觉与模式识别 · 计算机科学 2019-10-10 Qianru Sun , Yaoyao Liu , Zhaozheng Chen , Tat-Seng Chua , Bernt Schiele

In recent advancements in Test Time Adaptation (TTA), most existing methodologies focus on updating normalization layers to adapt to the test domain. However, the reliance on normalization-based adaptation presents key challenges. First,…

机器学习 · 计算机科学 2026-03-24 Hyeongyu Kim , Geonhui Han , Dosik Hwang

Deep neural networks have a clear degradation when applying to the unseen environment due to the covariate shift. Conventional approaches like domain adaptation requires the pre-collected target data for iterative training, which is…

计算机视觉与模式识别 · 计算机科学 2021-10-11 Fuming You , Jingjing Li , Zhou Zhao

Unsupervised domain translation has recently achieved impressive performance with Generative Adversarial Network (GAN) and sufficient (unpaired) training data. However, existing domain translation frameworks form in a disposable way where…

计算机视觉与模式识别 · 计算机科学 2019-09-11 Jianxin Lin , Yijun Wang , Tianyu He , Zhibo Chen

Domain adaptation (DA) is the topical problem of adapting models from labelled source datasets so that they perform well on target datasets where only unlabelled or partially labelled data is available. Many methods have been proposed to…

计算机视觉与模式识别 · 计算机科学 2020-07-28 Da Li , Timothy Hospedales

Test time adaptation (TTA) aims to adapt deep neural networks when receiving out of distribution test domain samples. In this setting, the model can only access online unlabeled test samples and pre-trained models on the training domains.…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Shuai Wang , Daoan Zhang , Zipei Yan , Jianguo Zhang , Rui Li