English
Related papers

Related papers: Source data selection for out-of-domain generaliza…

200 papers

Empirical risk minimization often performs poorly when the distribution of the target domain differs from those of source domains. To address such potential distribution shifts, we develop an unsupervised domain adaptation approach that…

Machine Learning · Statistics 2025-03-25 Zhenyu Wang , Peter Bühlmann , Zijian Guo

Phenomenon-specific "adversarial" datasets have been recently designed to perform targeted stress-tests for particular inference types. Recent work (Liu et al., 2019a) proposed that such datasets can be utilized for training NLI and other…

Computation and Language · Computer Science 2019-10-22 Ohad Rozen , Vered Shwartz , Roee Aharoni , Ido Dagan

Transfer learning is an exciting area of Natural Language Processing that has the potential to both improve model performance and increase data efficiency. This study explores the effects of varying quantities of target task training data…

Computation and Language · Computer Science 2022-10-24 Josiah Ross , Luke Yoffe , Alon Albalak , William Yang Wang

In this paper, a new approach for classification of target task using limited labeled target data as well as enormous unlabeled source data is proposed which is called self-taught learning. The target and source data can be drawn from…

Computer Vision and Pattern Recognition · Computer Science 2017-10-13 Parvin Razzaghi

Domain adaptation enables the learner to safely generalize into novel environments by mitigating domain shifts across distributions. Previous works may not effectively uncover the underlying reasons that would lead to the drastic model…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Ruijia Xu , Guanbin Li , Jihan Yang , Liang Lin

While machine learning models rapidly advance the state-of-the-art on various real-world tasks, out-of-domain (OOD) generalization remains a challenging problem given the vulnerability of these models to spurious correlations. We propose a…

Machine Learning · Computer Science 2023-02-21 Xinyi Wang , Michael Saxon , Jiachen Li , Hongyang Zhang , Kun Zhang , William Yang Wang

In practical scenarios, it is often the case that the available training data within the target domain only exist for a limited number of classes, with the remaining classes only available within surrogate domains. We show that including…

Machine Learning · Computer Science 2023-03-03 Eryk Banatt , Vickram Rajendran , Liam Packer

Single domain generalization aims to learn a model from a single training domain (source domain) and apply it to multiple unseen test domains (target domains). Existing methods focus on expanding the distribution of the training domain to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jin Chen , Zhi Gao , Xinxiao Wu , Jiebo Luo

Out-of-Distribution (OOD) Generalization aims to learn robust models that generalize well to various environments without fitting to distribution-specific features. Recent studies based on Lottery Ticket Hypothesis (LTH) address this…

Machine Learning · Computer Science 2023-10-26 Zhuo Huang , Muyang Li , Li Shen , Jun Yu , Chen Gong , Bo Han , Tongliang Liu

Unsupervised domain transfer is the task of transferring or translating samples from a source distribution to a different target distribution. Current solutions unsupervised domain transfer often operate on data on which the modes of the…

Machine Learning · Computer Science 2019-05-31 Mikołaj Bińkowski , R Devon Hjelm , Aaron Courville

Over the past decade, domain adaptation has become a widely studied branch of transfer learning that aims to improve performance on target domains by leveraging knowledge from the source domain. Conventional domain adaptation methods often…

Machine Learning · Computer Science 2023-02-24 Zhiqi Yu , Jingjing Li , Zhekai Du , Lei Zhu , Heng Tao Shen

In this work, we propose to use out-of-distribution samples, i.e., unlabeled samples coming from outside the target classes, to improve few-shot learning. Specifically, we exploit the easily available out-of-distribution samples to drive…

Machine Learning · Computer Science 2022-06-13 Duong H. Le , Khoi D. Nguyen , Khoi Nguyen , Quoc-Huy Tran , Rang Nguyen , Binh-Son Hua

There is a strong incentive to develop versatile learning techniques that can transfer the knowledge of class-separability from a labeled source domain to an unlabeled target domain in the presence of a domain-shift. Existing domain…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Jogendra Nath Kundu , Naveen Venkat , Rahul M , R. Venkatesh Babu

Transfer learning has been developed to improve the performances of different but related tasks in machine learning. However, such processes become less efficient with the increase of the size of training data and the number of tasks.…

Machine Learning · Computer Science 2018-03-28 Rui Zhang , Quanyan Zhu

Mislabeled, duplicated, or biased data in real-world scenarios can lead to prolonged training and even hinder model convergence. Traditional solutions prioritizing easy or hard samples lack the flexibility to handle such a variety…

Machine Learning · Computer Science 2023-11-08 Zhijie Deng , Peng Cui , Jun Zhu

Knowledge transfer between heterogeneous source and target networks and tasks has received a lot of attention in recent times as large amounts of quality labeled data can be difficult to obtain in many applications. Existing approaches…

Machine Learning · Computer Science 2022-03-17 Keerthiram Murugesan , Vijay Sadashivaiah , Ronny Luss , Karthikeyan Shanmugam , Pin-Yu Chen , Amit Dhurandhar

Domain shift refers to the well known problem that a model trained in one source domain performs poorly when applied to a target domain with different statistics. {Domain Generalization} (DG) techniques attempt to alleviate this issue by…

Machine Learning · Computer Science 2017-10-11 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy M. Hospedales

Transfer learning aims to leverage models pre-trained on source data to efficiently adapt to target setting, where only limited data are available for model fine-tuning. Recent works empirically demonstrate that adversarial training in the…

Machine Learning · Computer Science 2021-06-21 Zhun Deng , Linjun Zhang , Kailas Vodrahalli , Kenji Kawaguchi , James Zou

Domain adaptation approaches seek to learn from a source domain and generalize it to an unseen target domain. At present, the state-of-the-art unsupervised domain adaptation approaches for subjective text classification problems leverage…

Machine Learning · Computer Science 2020-10-22 Jitin Krishnan , Hemant Purohit , Huzefa Rangwala

Transfer learning methods endeavor to leverage relevant knowledge from existing source pre-trained models or datasets to solve downstream target tasks. With the increase in the scale and quantity of available pre-trained models nowadays, it…

Machine Learning · Computer Science 2024-02-26 Yuhe Ding , Bo Jiang , Aijing Yu , Aihua Zheng , Jian Liang