English
Related papers

Related papers: Multiple Source Adaptation and the Renyi Divergenc…

200 papers

Classical machine learning assumes that the training and test sets come from the same distributions. Therefore, a model learned from the labeled training data is expected to perform well on the test data. However, This assumption may not…

Machine Learning · Computer Science 2020-10-12 Abolfazl Farahani , Sahar Voghoei , Khaled Rasheed , Hamid R. Arabnia

Reweighting a distribution to minimize a distance to a target distribution is a powerful and flexible strategy for estimating a wide range of causal effects, but can be challenging in practice because optimal weights typically depend on…

Machine Learning · Statistics 2026-02-16 Oscar Clivio , Avi Feller , Chris Holmes

The recent success of deep neural networks relies on massive amounts of labeled data. For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. In this paper, we propose a…

Machine Learning · Computer Science 2017-02-17 Mingsheng Long , Han Zhu , Jianmin Wang , Michael I. Jordan

Distribution shift between train (source) and test (target) datasets is a common problem encountered in machine learning applications. One approach to resolve this issue is to use the Unsupervised Domain Adaptation (UDA) technique that…

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Due to privacy, storage, and other constraints, there is a growing need for unsupervised domain adaptation techniques in machine learning that do not require access to the data used to train a collection of source models. Existing methods…

Machine Learning · Computer Science 2023-06-01 Maohao Shen , Yuheng Bu , Gregory Wornell

The assumption that training and testing samples are generated from the same distribution does not always hold for real-world machine-learning applications. The procedure of tackling this discrepancy between the training (source) and…

Machine Learning · Computer Science 2018-12-05 Debasmit Das , C. S. George Lee

Transfer learning is a problem defined over two domains. These two domains share the same feature space and class label space, but have significantly different distributions. One domain has sufficient labels, named as source domain, and the…

Machine Learning · Computer Science 2016-05-24 Hongqi Wang , Anfeng Xu , Shanshan Wang , Sunny Chughtai

Large data-driven image models are extensively used to support creative and artistic work. Under the currently predominant distribution-fitting paradigm, a dataset is treated as ground truth to be approximated as closely as possible. Yet,…

Machine Learning · Computer Science 2023-06-16 Sebastian Berns , Simon Colton , Christian Guckelsberger

We propose novel model transfer-learning methods that refine a decision forest model M learned within a "source" domain using a training set sampled from a "target" domain, assumed to be a variation of the source. We present two random…

Machine Learning · Computer Science 2018-05-01 Noam Segev , Maayan Harel , Shie Mannor , Koby Crammer , Ran El-Yaniv

Multiclass neural networks are a common tool in modern unsupervised domain adaptation, yet an appropriate theoretical description for their non-uniform sample complexity is lacking in the adaptation literature. To fill this gap, we propose…

Machine Learning · Computer Science 2022-07-13 Anthony Sicilia , Katherine Atwell , Malihe Alikhani , Seong Jae Hwang

Deep learning has produced state-of-the-art results for a variety of tasks. While such approaches for supervised learning have performed well, they assume that training and testing data are drawn from the same distribution, which may not…

Machine Learning · Computer Science 2020-02-10 Garrett Wilson , Diane J. Cook

Distribution regression refers to the supervised learning problem where labels are only available for groups of inputs instead of individual inputs. In this paper, we develop a rigorous mathematical framework for distribution regression…

Machine Learning · Computer Science 2021-09-30 Maud Lemercier , Cristopher Salvi , Theodoros Damoulas , Edwin V. Bonilla , Terry Lyons

In transfer learning, we wish to make inference about a target population when we have access to data both from the distribution itself, and from a different but related source distribution. We introduce a flexible framework for transfer…

Machine Learning · Statistics 2021-09-03 Henry W. J. Reeve , Timothy I. Cannings , Richard J. Samworth

The success of supervised learning hinges on the assumption that the training and test data come from the same underlying distribution, which is often not valid in practice due to potential distribution shift. In light of this, most…

Machine Learning · Computer Science 2021-04-06 Bo Li , Yezhen Wang , Shanghang Zhang , Dongsheng Li , Trevor Darrell , Kurt Keutzer , Han Zhao

Existing metric learning losses can be categorized into two classes: pair-based and proxy-based losses. The former class can leverage fine-grained semantic relations between data points, but slows convergence in general due to its high…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

This work studies approximation based on single-hidden-layer feedforward and recurrent neural networks with randomly generated internal weights. These methods, in which only the last layer of weights and a few hyperparameters are optimized,…

Probability · Mathematics 2021-02-17 Lukas Gonon , Lyudmila Grigoryeva , Juan-Pablo Ortega

Domain adaptation is important in sentiment analysis as sentiment-indicating words vary between domains. Recently, multi-domain adaptation has become more pervasive, but existing approaches train on all available source domains including…

Computation and Language · Computer Science 2017-02-09 Sebastian Ruder , Parsa Ghaffari , John G. Breslin

Domain Adaptation has been widely used to deal with the distribution shift in vision, language, multimedia etc. Most domain adaptation methods learn domain-invariant features with data from both domains available. However, such a strategy…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Ning Ma , Jiajun Bu , Lixian Lu , Jun Wen , Zhen Zhang , Sheng Zhou , Xifeng Yan

Multi-Source cross-lingual transfer learning deals with the transfer of task knowledge from multiple labelled source languages to an unlabeled target language under the language shift. Existing methods typically focus on weighting the…

Computation and Language · Computer Science 2024-03-08 Ling Ge , Chunming Hu , Guanghui Ma , Jihong Liu , Hong Zhang