English
Related papers

Related papers: Multiple Source Adaptation and the Renyi Divergenc…

200 papers

We present a novel instance-based approach to handle regression tasks in the context of supervised domain adaptation under an assumption of covariate shift. The approach developed in this paper is based on the assumption that the task on…

Machine Learning · Computer Science 2021-09-16 Antoine de Mathelin , Guillaume Richard , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

Tight bounds for several symmetric divergence measures are derived in terms of the total variation distance. It is shown that each of these bounds is attained by a pair of 2 or 3-element probability distributions. An application of these…

Information Theory · Computer Science 2016-11-17 Igal Sason

This work considers distributed sensing and transmission of sporadic random samples. Lower bounds are derived for the reconstruction error of a single normally or uniformly-distributed finite-dimensional vector imperfectly measured by a…

Information Theory · Computer Science 2015-11-20 Ayşe Ünsal , Raymond Knopp

We study a new highly-practical problem setting that enables resource-constrained edge devices to adapt a pre-trained model to their local data distributions. Recognizing that device's data are likely to come from multiple latent domains…

Machine Learning · Computer Science 2024-02-02 Ondrej Bohdal , Da Li , Shell Xu Hu , Timothy Hospedales

Multitask learning and related areas such as multi-source domain adaptation address modern settings where datasets from $N$ related distributions $\{P_t\}$ are to be combined towards improving performance on any single such distribution…

Machine Learning · Computer Science 2020-08-07 Steve Hanneke , Samory Kpotufe

In the settings of conventional domain adaptation, categories of the source dataset are from the same domain (or domains for multi-source domain adaptation), which is not always true in reality. In this paper, we propose…

Machine Learning · Computer Science 2020-11-06 Sitong Mao , Keli Zhang , Fu-lai Chung

Social and real-world considerations such as robustness, fairness, social welfare and multi-agent tradeoffs have given rise to multi-distribution learning paradigms, such as collaborative learning, group distributionally robust…

Machine Learning · Computer Science 2024-04-04 Nika Haghtalab , Michael I. Jordan , Eric Zhao

Multi-source domain adaptation (MSDA) plays an important role in industrial model generalization. Recent efforts on MSDA focus on enhancing multi-domain distributional alignment while omitting three issues, e.g., the class-level discrepancy…

Machine Learning · Computer Science 2024-12-24 Min Huang , Zifeng Xie , Bo Sun , Ning Wang

In Multi-Source Domain Adaptation (MSDA), models are trained on samples from multiple source domains and used for inference on a different, target, domain. Mainstream domain adaptation approaches learn a joint representation of source and…

Machine Learning · Computer Science 2020-10-21 Ohad Amosy , Gal Chechik

When data is generated by multiple sources, conventional training methods update models assuming equal reliability for each source and do not consider their individual data quality. However, in many applications, sources have varied levels…

Machine Learning · Computer Science 2025-02-17 Alexander Capstick , Francesca Palermo , Tianyu Cui , Payam Barnaghi

Domain adaptation approaches seek to learn from a source domain and generalize it to an unseen target domain. At present, the state-of-the-art unsupervised domain adaptation approaches for subjective text classification problems leverage…

Machine Learning · Computer Science 2020-10-22 Jitin Krishnan , Hemant Purohit , Huzefa Rangwala

This paper considers the problem of sequentially detecting a change in the joint distribution of multiple data sources under a sampling constraint. Specifically, the channels or sources generate observations that are independent over time,…

Methodology · Statistics 2024-03-26 Anamitra Chaudhuri , Georgios Fellouris , Ali Tajer

Multi-Source Unsupervised Domain Adaptation (multi-source UDA) aims to learn a model from several labeled source domains while performing well on a different target domain where only unlabeled data are available at training time. To align…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Marin Scalbert , Maria Vakalopoulou , Florent Couzinié-Devy

We study the multi-task learning problem that aims to simultaneously analyze multiple datasets collected from different sources and learn one model for each of them. We propose a family of adaptive methods that automatically utilize…

Machine Learning · Statistics 2023-09-19 Yaqi Duan , Kaizheng Wang

The goal of domain adaptation is to adapt models learned on a source domain to a particular target domain. Most methods for unsupervised domain adaptation proposed in the literature to date, assume that the set of classes present in the…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Ayush Mittal , Anant Raj , Vinay P. Namboodiri , Tinne Tuytelaars

An important goal common to domain adaptation and causal inference is to make accurate predictions when the distributions for the source (or training) domain(s) and target (or test) domain(s) differ. In many cases, these different…

Machine Learning · Computer Science 2022-08-31 Sara Magliacane , Thijs van Ommen , Tom Claassen , Stephan Bongers , Philip Versteeg , Joris M. Mooij

In theory, the success of unsupervised domain adaptation (UDA) largely relies on domain gap estimation. However, for source free UDA, the source domain data can not be accessed during adaptation, which poses great challenge of measuring the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Ziyang Zong , Jun He , Lei Zhang , Hai Huan

We develop a general theory for computing the Renyi entropy with general multiple disjoint intervals from the swapping operations. Our theory is proposed based on the fact that we have observed the resemblance between the replica trick in…

Statistical Mechanics · Physics 2026-04-03 Han-Qing Shi , Hai-Qing Zhang

Domain adaptation aims to use training data from one or multiple source domains to learn a hypothesis that can be generalized to a different, but related, target domain. As such, having a reliable measure for evaluating the discrepancy of…

Machine Learning · Computer Science 2024-05-31 Wenzhe Yin , Shujian Yu , Yicong Lin , Jie Liu , Jan-Jakob Sonke , Efstratios Gavves

Given a model trained on source data, Test-Time Adaptation (TTA) enables adaptation and inference in test data streams with domain shifts from the source. Current methods predominantly optimize the model for each incoming test data batch…

Machine Learning · Computer Science 2024-07-18 Ziqiang Wang , Zhixiang Chi , Yanan Wu , Li Gu , Zhi Liu , Konstantinos Plataniotis , Yang Wang