English
Related papers

Related papers: Sequential Domain Adaptation by Synthesizing Distr…

200 papers

Wasserstein distributionally robust optimization estimators are obtained as solutions of min-max problems in which the statistician selects a parameter minimizing the worst-case loss among all probability models within a certain distance…

Statistics Theory · Mathematics 2021-03-04 Jose Blanchet , Karthyek Murthy , Nian Si

Although deep convolutional networks have reached state-of-the-art performance in many medical image segmentation tasks, they have typically demonstrated poor generalisation capability. To be able to generalise from one domain (e.g. one…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Reuben Dorent , Samuel Joutard , Jonathan Shapey , Sotirios Bisdas , Neil Kitchen , Robert Bradford , Shakeel Saeed , Marc Modat , Sebastien Ourselin , Tom Vercauteren

Domain Adaptation is an actively researched problem in Computer Vision. In this work, we propose an approach that leverages unsupervised data to bring the source and target distributions closer in a learned joint feature space. We…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Swami Sankaranarayanan , Yogesh Balaji , Carlos D. Castillo , Rama Chellappa

Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution. While absent assumptions, domain adaptation is impossible, strict conditions, e.g.…

Machine Learning · Computer Science 2019-03-13 Yifan Wu , Ezra Winston , Divyansh Kaushik , Zachary Lipton

We consider the problem of subspace estimation in situations where the number of available snapshots and the observation dimension are comparable in magnitude. In this context, traditional subspace methods tend to fail because the…

Information Theory · Computer Science 2016-11-15 Pascal Vallet , Philippe Loubaton , Xavier Mestre

We study the problem of robust domain adaptation in the context of unavailable target labels and source data. The considered robustness is against adversarial perturbations. This paper aims at answering the question of finding the right…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peshal Agarwal , Danda Pani Paudel , Jan-Nico Zaech , Luc Van Gool

Domain Adaptation (DA) has recently received significant attention due to its potential to adapt a learning model across source and target domains with mismatched distributions. Since DA methods rely exclusively on the given source and…

Machine Learning · Statistics 2022-11-01 Akram S. Awad , George K. Atia

Unsupervised domain adaptation (UDA) is a statistical learning problem when the distribution of training (source) data is different from that of test (target) data. In this setting, one has access to labeled data only from the source domain…

Machine Learning · Computer Science 2026-02-24 Seonghwi Kim , Sung Ho Jo , Wooseok Ha , Minwoo Chae

This paper proposes a novel non-parametric multidimensional convex regression estimator which is designed to be robust to adversarial perturbations in the empirical measure. We minimize over convex functions the maximum (over Wasserstein…

Statistics Theory · Mathematics 2020-07-28 Jose Blanchet , Peter W. Glynn , Jun Yan , Zhengqing Zhou

Contemporary domain adaptation methods are very effective at aligning feature distributions of source and target domains without any target supervision. However, we show that these techniques perform poorly when even a few labeled examples…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Kuniaki Saito , Donghyun Kim , Stan Sclaroff , Trevor Darrell , Kate Saenko

The phenomenon of data distribution evolving over time has been observed in a range of applications, calling the needs of adaptive learning algorithms. We thus study the problem of supervised gradual domain adaptation, where labeled data…

Machine Learning · Computer Science 2022-11-15 Jing Dong , Shiji Zhou , Baoxiang Wang , Han Zhao

Distribution shifts are ubiquitous in real-world machine learning applications, posing a challenge to the generalization of models trained on one data distribution to another. We focus on scenarios where data distributions vary across…

Machine Learning · Statistics 2024-06-05 Steven Wilkins-Reeves , Xu Chen , Qi Ma , Christine Agarwal , Aude Hofleitner

In this work, we study the problem of learning a single model for multiple domains. Unlike the conventional machine learning scenario where each domain can have the corresponding model, multiple domains (i.e., applications/users) may share…

Machine Learning · Computer Science 2019-05-23 Qi Qian , Shenghuo Zhu , Jiasheng Tang , Rong Jin , Baigui Sun , Hao Li

When data is collected in an adaptive manner, even simple methods like ordinary least squares can exhibit non-normal asymptotic behavior. As an undesirable consequence, hypothesis tests and confidence intervals based on asymptotic normality…

Statistics Theory · Mathematics 2023-03-23 Koulik Khamaru , Yash Deshpande , Tor Lattimore , Lester Mackey , Martin J. Wainwright

The task of learning a sentiment classification model that adapts well to any target domain, different from the source domain, is a challenging problem. Majority of the existing approaches focus on learning a common representation by…

Machine Learning · Computer Science 2019-12-05 Pratik Kayal , Mayank Singh , Pawan Goyal

The growing deployment of low-cost, distributed sensor networks in environmental and biomedical domains has enabled continuous, large-scale health monitoring. However, these systems often face challenges related to degraded data quality…

Machine Learning · Computer Science 2025-08-07 Keivan Faghih Niresi , Ismail Nejjar , Olga Fink

We study how we can adapt a predictor to a non-stationary environment with advises from multiple experts. We study the problem under complete feedback when the best expert changes over time from a decision theoretic point of view. Proposed…

Machine Learning · Computer Science 2017-08-08 Vishnu Raj , Sheetal Kalyani

We study the problem of choosing algorithm hyper-parameters in unsupervised domain adaptation, i.e., with labeled data in a source domain and unlabeled data in a target domain, drawn from a different input distribution. We follow the…

We consider online prediction of a binary sequence with expert advice. For this setting, we devise label-efficient forecasting algorithms, which use a selective sampling scheme that enables collecting much fewer labels than standard…

Machine Learning · Statistics 2023-10-23 Rui M. Castro , Fredrik Hellström , Tim van Erven

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone