English
Related papers

Related papers: PAC-Bayesian Learning and Domain Adaptation

200 papers

A basic assumption of statistical learning theory is that train and test data are drawn from the same underlying distribution. Unfortunately, this assumption doesn't hold in many applications. Instead, ample labeled data might exist in a…

Computer Vision and Pattern Recognition · Computer Science 2012-11-21 Oscar Beijbom

Unsupervised domain transfer is the task of transferring or translating samples from a source distribution to a different target distribution. Current solutions unsupervised domain transfer often operate on data on which the modes of the…

Machine Learning · Computer Science 2019-05-31 Mikołaj Bińkowski , R Devon Hjelm , Aaron Courville

In this work, we define and address a novel domain adaptation (DA) problem in semantic scene segmentation, where the target domain not only exhibits a data distribution shift w.r.t. the source domain, but also includes novel classes that do…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Maxime Bucher , Tuan-Hung Vu , Matthieu Cord , Patrick Pérez

Tremendous research efforts have been made to thrive deep domain adaptation (DA) by seeking domain-invariant features. Most existing deep DA models only focus on aligning feature representations of task-specific layers across domains while…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 Shuang Li , Chi Harold Liu , Qiuxia Lin , Binhui Xie , Zhengming Ding , Gao Huang , Jian Tang

One of the central problems in machine learning is domain adaptation. Unlike past theoretical work, we consider a new model for subpopulation shift in the input or representation space. In this work, we propose a provably effective…

Machine Learning · Computer Science 2021-07-21 Tianle Cai , Ruiqi Gao , Jason D. Lee , Qi Lei

Unsupervised domain adaptation (UDA) is a technique used to transfer knowledge from a labeled source domain to a different but related unlabeled target domain. While many UDA methods have shown success in the past, they often assume that…

Machine Learning · Computer Science 2023-02-07 Yiling Liu , Juncheng Dong , Ziyang Jiang , Ahmed Aloui , Keyu Li , Hunter Klein , Vahid Tarokh , David Carlson

The ability to build a model on a source task and subsequently adapt such model on a new target task is a pervasive need in many astronomical applications. The problem is generally known as transfer learning in machine learning, where…

Machine Learning · Computer Science 2019-09-25 Ricardo Vilalta , Kinjal Dhar Gupta , Dainis Boumber , Mikhail M. Meskhi

Machine learning algorithms typically assume that the training and test samples come from the same distributions, i.e., in-distribution. However, in open-world scenarios, streaming big data can be Out-Of-Distribution (OOD), rendering these…

Machine Learning · Computer Science 2022-11-10 Anique Tahir , Lu Cheng , Ruocheng Guo , Huan Liu

Domain adaptation (DA) strives to mitigate the domain gap between the source domain where a model is trained, and the target domain where the model is deployed. When a deep learning model is deployed on an aerial platform, it may face…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Chowdhury Sadman Jahan , Andreas Savakis

Discrepancy between training and testing domains is a fundamental problem in the generalization of machine learning techniques. Recently, several approaches have been proposed to learn domain invariant feature representations through…

Machine Learning · Statistics 2019-03-18 Yitong Li , Michael Murias , Samantha Major , Geraldine Dawson , David E. Carlson

While huge volumes of unlabeled data are generated and made available in many domains, the demand for automated understanding of visual data is higher than ever before. Most existing machine learning models typically rely on massive amounts…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Youshan Zhang

Transfer learning has received a lot of attention in the machine learning community over the last years, and several effective algorithms have been developed. However, relatively little is known about their theoretical properties,…

Machine Learning · Statistics 2014-05-13 Anastasia Pentina , Christoph H. Lampert

The diffusion approximation (DA) is widely used in the analysis of stochastic population dynamics, from population genetics to ecology and evolution. DA is an uncontrolled approximation that assumes the smoothness of the calculated quantity…

Populations and Evolution · Quantitative Biology 2021-01-04 Jayant Pande , Nadav M. Shnerb

The major challenge in today's computer vision scenario is the availability of good quality labeled data. In a field of study like image classification, where data is of utmost importance, we need to find more reliable methods which can…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Aashish Dhawan , Divyanshu Mudgal

Data assimilation (DA) in the geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction, and is a crucial building block that has…

The performance of a classifier trained on data coming from a specific domain typically degrades when applied to a related but different one. While annotating many samples from the new domain would address this issue, it is often too…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Artem Rozantsev , Mathieu Salzmann , Pascal Fua

Due to the ability of deep neural nets to learn rich representations, recent advances in unsupervised domain adaptation have focused on learning domain-invariant features that achieve a small error on the source domain. The hope is that the…

Machine Learning · Computer Science 2019-05-31 Han Zhao , Remi Tachet des Combes , Kun Zhang , Geoffrey J. Gordon

We consider representation learning (hypothesis class $\mathcal{H} = \mathcal{F}\circ\mathcal{G}$) where training and test distributions can be different. Recent studies provide hints and failure examples for domain invariant representation…

Machine Learning · Computer Science 2020-06-05 Xi Wu , Yang Guo , Jiefeng Chen , Yingyu Liang , Somesh Jha , Prasad Chalasani

Domain Adaptive Object Detection (DAOD) transfers knowledge from a labeled source domain to an unannotated target domain under closed-set assumption. Universal DAOD (UniDAOD) extends DAOD to handle open-set, partial-set, and closed-set…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuanfan Zheng , Jinlin Wu , Wuyang Li , Zhen Chen

This paper seeks to solve Multi-Source Domain Adaptation (MSDA), which aims to mitigate data distribution shifts when transferring knowledge from multiple labeled source domains to an unlabeled target domain. We propose a novel MSDA…

Machine Learning · Computer Science 2023-11-09 Eduardo Fernandes Montesuma , Fred Ngolè Mboula , Antoine Souloumiac