中文
相关论文

相关论文: Target Domain Data induces Negative Transfer in Mi…

200 篇论文

Experiencing domain shifts during test-time is nearly inevitable in practice and likely results in a severe performance degradation. To overcome this issue, test-time adaptation continues to update the initial source model during…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Robert A. Marsden , Mario Döbler , Bin Yang

Negative transfer in training of acoustic models for automatic speech recognition has been reported in several contexts such as domain change or speaker characteristics. This paper proposes a novel technique to overcome negative transfer by…

机器学习 · 计算机科学 2015-09-18 Mortaza Doulaty , Oscar Saz , Thomas Hain

Transfer learning aims to leverage models pre-trained on source data to efficiently adapt to target setting, where only limited data are available for model fine-tuning. Recent works empirically demonstrate that adversarial training in the…

机器学习 · 计算机科学 2021-06-21 Zhun Deng , Linjun Zhang , Kailas Vodrahalli , Kenji Kawaguchi , James Zou

Shortcut learning occurs when a deep neural network overly relies on spurious correlations in the training dataset in order to solve downstream tasks. Prior works have shown how this impairs the compositional generalization capability of…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Piyapat Saranrittichai , Chaithanya Kumar Mummadi , Claudia Blaiotta , Mauricio Munoz , Volker Fischer

The performance of a machine learning model degrades when it is applied to data from a similar but different domain than the data it has initially been trained on. To mitigate this domain shift problem, domain adaptation (DA) techniques…

机器学习 · 计算机科学 2024-10-08 Felix Ott , David Rügamer , Lucas Heublein , Bernd Bischl , Christopher Mutschler

Models that perform out-of-domain generalization borrow knowledge from heterogeneous source data and apply it to a related but distinct target task. Transfer learning has proven effective for accomplishing this generalization in many…

机器学习 · 计算机科学 2022-02-07 Xinran Miao , Kris Sankaran

Domain adaptation aims to transfer knowledge from a domain with adequate labeled samples to a domain with scarce labeled samples. Prior research has introduced various open set domain adaptation settings in the literature to extend the…

计算机视觉与模式识别 · 计算机科学 2020-09-25 Tasfia Shermin , Guojun Lu , Shyh Wei Teng , Manzur Murshed , Ferdous Sohel

Domain adaptation investigates the problem of cross-domain knowledge transfer where the labeled source domain and unlabeled target domain have distinctive data distributions. Recently, adversarial training have been successfully applied to…

计算机视觉与模式识别 · 计算机科学 2019-09-18 Jingjing Li , Erpeng Chen , Zhengming Ding , Lei Zhu , Ke Lu , Zi Huang

Existing adversarial domain adaptation methods mainly consider the marginal distribution and these methods may lead to either under transfer or negative transfer. To address this problem, we present a self-adaptive re-weighted adversarial…

计算机视觉与模式识别 · 计算机科学 2020-06-03 Shanshan Wang , Lei Zhang

In multi-domain learning, a single model is trained on diverse data domains to leverage shared knowledge and improve generalization. The order in which the data from these domains is used for training can significantly affect the model's…

机器学习 · 计算机科学 2025-01-28 Alexey Rukhovich , Alexander Podolskiy , Irina Piontkovskaya

The performance of a classifier trained on data coming from a specific domain typically degrades when applied to a related but different one. While annotating many samples from the new domain would address this issue, it is often too…

计算机视觉与模式识别 · 计算机科学 2018-03-13 Artem Rozantsev , Mathieu Salzmann , Pascal Fua

We study linear regression under covariate shift, where the marginal distribution over the input covariates differs in the source and the target domains, while the conditional distribution of the output given the input covariates is similar…

机器学习 · 计算机科学 2022-08-04 Jingfeng Wu , Difan Zou , Vladimir Braverman , Quanquan Gu , Sham M. Kakade

While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain…

机器学习 · 计算机科学 2017-10-31 Han Zhao , Shanghang Zhang , Guanhang Wu , João P. Costeira , José M. F. Moura , Geoffrey J. Gordon

Humans are incredibly good at transferring knowledge from one domain to another, enabling rapid learning of new tasks. Likewise, transfer learning has enabled enormous success in many computer vision problems using pretraining. However, the…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Yipeng Zhang , Tyler L. Hayes , Christopher Kanan

Single domain generalization aims to learn a model from a single training domain (source domain) and apply it to multiple unseen test domains (target domains). Existing methods focus on expanding the distribution of the training domain to…

计算机视觉与模式识别 · 计算机科学 2023-04-10 Jin Chen , Zhi Gao , Xinxiao Wu , Jiebo Luo

Transfer learning leverages knowledge from other domains and has been successful in many applications. Transfer learning methods rely on the overall similarity of the source and target domains. However, in some cases, it is impossible to…

计算机视觉与模式识别 · 计算机科学 2023-06-30 Yifu Zhang , Hongru Li , Shimeng Shi , Youqi Li , Jiansong Zhang

Transferring learned patterns from pretrained neural language models has been shown to significantly improve effectiveness across a variety of language-based tasks, meanwhile further tuning on intermediate tasks has been demonstrated to…

计算与语言 · 计算机科学 2023-03-01 Alexander Pugantsov , Richard McCreadie

Deep networks are prone to performance degradation when there is a domain shift between the source (training) data and target (test) data. Recent test-time adaptation methods update batch normalization layers of pre-trained source models…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Wenyu Zhang , Li Shen , Wanyue Zhang , Chuan-Sheng Foo

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

The task of learning a sentiment classification model that adapts well to any target domain, different from the source domain, is a challenging problem. Majority of the existing approaches focus on learning a common representation by…

机器学习 · 计算机科学 2019-12-05 Pratik Kayal , Mayank Singh , Pawan Goyal