English
Related papers

Related papers: Source data selection for out-of-domain generaliza…

200 papers

The ability of an agent to do well in new environments is a critical aspect of intelligence. In machine learning, this ability is known as $\textit{strong}$ or $\textit{out-of-distribution}$ generalization. However, merely considering…

Machine Learning · Computer Science 2024-02-09 Siyuan Guo , Jonas Wildberger , Bernhard Schölkopf

Domain generalization aims to learn a prediction model on multi-domain source data such that the model can generalize to a target domain with unknown statistics. Most existing approaches have been developed under the assumption that the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

We study the transfer learning process between two linear regression problems. An important and timely special case is when the regressors are overparameterized and perfectly interpolate their training data. We examine a parameter transfer…

Machine Learning · Computer Science 2022-09-29 Yehuda Dar , Richard G. Baraniuk

We expect the generalization error to improve with more samples from a similar task, and to deteriorate with more samples from an out-of-distribution (OOD) task. In this work, we show a counter-intuitive phenomenon: the generalization error…

Machine Learning · Computer Science 2023-07-20 Ashwin De Silva , Rahul Ramesh , Carey E. Priebe , Pratik Chaudhari , Joshua T. Vogelstein

Data scarcity is a tremendous challenge in causal effect estimation. In this paper, we propose to exploit additional data sources to facilitate estimating causal effects in the target population. Specifically, we leverage additional source…

Machine Learning · Computer Science 2021-06-01 Thanh Vinh Vo , Pengfei Wei , Trong Nghia Hoang , Tze-Yun Leong

Deep transfer learning recently has acquired significant research interest. It makes use of pre-trained models that are learned from a source domain, and utilizes these models for the tasks in a target domain. Model-based deep transfer…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Tianyang Wang , Jun Huan , Michelle Zhu

Citations are generally analyzed using only quantitative measures while excluding qualitative aspects such as sentiment and intent. However, qualitative aspects provide deeper insights into the impact of a scientific research artifact and…

Information Retrieval · Computer Science 2022-02-23 Dominique Mercier , Syed Tahseen Raza Rizvi , Vikas Rajashekar , Sheraz Ahmed , Andreas Dengel

Transfer learning is a machine learning paradigm where the knowledge from one task is utilized to resolve the problem in a related task. On the one hand, it is conceivable that knowledge from one task could be useful for solving a related…

Machine Learning · Computer Science 2021-05-05 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

Datasets for training recommender systems are often subject to distribution shift induced by users' and recommenders' selection biases. In this paper, we study the impact of selection bias on datasets with different quantization. We then…

Information Retrieval · Computer Science 2022-12-29 Fengyu Li , Sarah Dean

In this paper, we propose to tackle the problem of reducing discrepancies between multiple domains referred to as multi-source domain adaptation and consider it under the target shift assumption: in all domains we aim to solve a…

Machine Learning · Statistics 2019-03-15 Ievgen Redko , Nicolas Courty , Rémi Flamary , Devis Tuia

Safely deploying machine learning models to the real world is often a challenging process. Models trained with data obtained from a specific geographic location tend to fail when queried with data obtained elsewhere, agents trained in a…

Machine Learning · Computer Science 2021-11-02 Marco Federici , Ryota Tomioka , Patrick Forré

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Transfer Learning aims to optimally aggregate samples from a target distribution, with related samples from a so-called source distribution to improve target risk. Multiple procedures have been proposed over the last two decades to address…

Machine Learning · Statistics 2025-04-29 Steve Hanneke , Samory Kpotufe

We present a theoretical and algorithmic study of the multiple-source domain adaptation problem in the common scenario where the learner has access only to a limited amount of labeled target data, but where the learner has at disposal a…

Machine Learning · Computer Science 2020-11-02 Yishay Mansour , Mehryar Mohri , Jae Ro , Ananda Theertha Suresh , Ke Wu

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a…

Machine Learning · Computer Science 2020-02-14 Vikas K. Garg , Adam Kalai , Katrina Ligett , Zhiwei Steven Wu

Multi-source transfer learning has been proven effective when within-target labeled data is scarce. Previous work focuses primarily on exploiting domain similarities and assumes that source domains are richly or at least comparably labeled.…

Machine Learning · Computer Science 2018-07-09 Zirui Wang , Jaime Carbonell

Deployed real-world machine learning applications are often subject to uncontrolled and even potentially malicious inputs. Those out-of-domain inputs can lead to unpredictable outputs and sometimes catastrophic safety issues. Prior studies…

Computation and Language · Computer Science 2022-05-23 Keyang Xu , Tongzheng Ren , Shikun Zhang , Yihao Feng , Caiming Xiong

As the volume of data continues to expand, it becomes increasingly common for data to be aggregated from multiple sources. Leveraging multiple sources for model training typically achieves better predictive performance on test datasets.…

Methodology · Statistics 2025-03-05 Congbin Xu , Chengde Qian , Zhaojun Wang , Changliang Zou

Transfer learning is a machine learning paradigm where knowledge from one problem is utilized to solve a new but related problem. While conceivable that knowledge from one task could be useful for solving a related task, if not executed…

Machine Learning · Computer Science 2021-10-01 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

Considering data insufficiency in metal additive manufacturing (AM), transfer learning (TL) has been adopted to extract knowledge from source domains (e.g., completed printings) to improve the modeling performance in target domains (e.g.,…

Machine Learning · Computer Science 2024-01-18 Yifan Tang , M. Rahmani Dehaghani , Pouyan Sajadi , G. Gary Wang