English
Related papers

Related papers: Target Domain Data induces Negative Transfer in Mi…

200 papers

While neural networks have shown impressive performance on large datasets, applying these models to tasks where little data is available remains a challenging problem. In this paper we propose to use feature transfer in a zero-shot…

Computation and Language · Computer Science 2018-08-30 Javid Dadashkarimi , Alexander Fabbri , Sekhar Tatikonda , Dragomir R. Radev

In uses of pre-trained machine learning models, it is a known issue that the target population in which the model is being deployed may not have been reflected in the source population with which the model was trained. This can result in a…

Machine Learning · Computer Science 2023-06-27 Jose M. Alvarez , Kristen M. Scott , Salvatore Ruggieri , Bettina Berendt

Transfer learning aims to improve inference in a target domain by leveraging information from related source domains, but its effectiveness critically depends on how cross-domain heterogeneity is modeled and controlled. When the conditional…

Statistics Theory · Mathematics 2026-02-23 Hanxiao Chen , Debarghya Mukherjee

For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. Previous deep domain adaptation methods mainly learn a global domain shift, i.e., align the global source and…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Yongchun Zhu , Fuzhen Zhuang , Jindong Wang , Guolin Ke , Jingwu Chen , Jiang Bian , Hui Xiong , Qing He

Transfer learning enables to re-use knowledge learned on a source task to help learning a target task. A simple form of transfer learning is common in current state-of-the-art computer vision models, i.e. pre-training a model for image…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Thomas Mensink , Jasper Uijlings , Alina Kuznetsova , Michael Gygli , Vittorio Ferrari

Unsupervised domain adaption aims to learn a powerful classifier for the target domain given a labeled source data set and an unlabeled target data set. To alleviate the effect of `domain shift', the major challenge in domain adaptation,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Yexun Zhang , Ya Zhang , Yanfeng Wang , Qi Tian

Machine learning models trained in one domain perform poorly in the other domains due to the existence of domain shift. Domain adaptation techniques solve this problem by training transferable models from the label-rich source domain to the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Jinghua Wang , Jianmin Jiang

Few-shot slot tagging is an emerging research topic in the field of Natural Language Understanding (NLU). With sufficient annotated data from source domains, the key challenge is how to train and adapt the model to another target domain…

Computation and Language · Computer Science 2021-09-14 Zezhong Wang , Hongru Wang , Kwan Wai Chung , Jia Zhu , Gabriel Pui Cheong Fung , Kam-Fai Wong

Performance on benchmark datasets has drastically improved with advances in deep learning. Still, cross-dataset generalization performance remains relatively low due to the domain shift that can occur between two different datasets. This…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Alexandra Carlson , Katherine A. Skinner , Ram Vasudevan , Matthew Johnson-Roberson

Unsupervised domain adaptation targets to transfer task-related knowledge from labeled source domain to unlabeled target domain. Although tremendous efforts have been made to minimize domain divergence, most existing methods only partially…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Peizhao Li , Zhengming Ding , Hongfu Liu

In many practical applications, it is often difficult and expensive to obtain enough large-scale labeled data to train deep neural networks to their full capability. Therefore, transferring the learned knowledge from a separate, labeled…

Machine Learning · Computer Science 2020-02-28 Sicheng Zhao , Bo Li , Colorado Reed , Pengfei Xu , Kurt Keutzer

Transfer learning has emerged as a powerful technique for improving the performance of machine learning models on new domains where labeled training data may be scarce. In this approach a model trained for a source task, where plenty of…

Machine Learning · Computer Science 2020-06-19 Seyed Mohammadreza Mousavi Kalan , Zalan Fabian , A. Salman Avestimehr , Mahdi Soltanolkotabi

Recent advances in domain adaptation establish that requiring a low risk on the source domain and equal feature marginals degrade the adaptation's performance. At the same time, empirical evidence shows that incorporating an unsupervised…

Machine Learning · Computer Science 2022-03-11 Sofien Dhouib , Setareh Maghsudi

This paper investigates Cross-Domain Sequential Recommendation (CDSR), a promising method that uses information from multiple domains (more than three) to generate accurate and diverse recommendations, and takes into account the sequential…

Artificial Intelligence · Computer Science 2023-11-23 Chung Park , Taesan Kim , Taekyoon Choi , Junui Hong , Yelim Yu , Mincheol Cho , Kyunam Lee , Sungil Ryu , Hyungjun Yoon , Minsung Choi , Jaegul Choo

In computer vision, one is often confronted with problems of domain shifts, which occur when one applies a classifier trained on a source dataset to target data sharing similar characteristics (e.g. same classes), but also different latent…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Bharath Bhushan Damodaran , Benjamin Kellenberger , Rémi Flamary , Devis Tuia , Nicolas Courty

Domain Adaptation (DA) is a highly relevant research topic when it comes to image classification with deep neural networks. Combining multiple source domains in a sophisticated way to optimize a classification model can improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Sebastian Schrom , Stephan Hasler , Jürgen Adamy

The phenomenon of distribution shift (DS) occurs when a dataset at test time differs from the dataset at training time, which can significantly impair the performance of a machine learning model in practical settings due to a lack of…

Transfer learning aims to faciliate learning tasks in a label-scarce target domain by leveraging knowledge from a related source domain with plenty of labeled data. Often times we may have multiple domains with little or no labeled data as…

Machine Learning · Computer Science 2017-11-10 Tianchun Wang

In recent years, machine learning has achieved impressive results across different application areas. However, machine learning algorithms do not necessarily perform well on a new domain with a different distribution than its training set.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Ye Gao , Zhendong Chu , Hongning Wang , John Stankovic

Unsupervised domain adaptation aims to transfer the classifier learned from the source domain to the target domain in an unsupervised manner. With the help of target pseudo-labels, aligning class-level distributions and learning the…

Machine Learning · Computer Science 2019-06-11 Dong-Dong Chen , Yisen Wang , Jinfeng Yi , Zaiyi Chen , Zhi-Hua Zhou