English
Related papers

Related papers: Theoretical Analysis of Domain Adaptation with Opt…

200 papers

Domain adaptation (DA) attempts to transfer the knowledge from a labeled source domain to an unlabeled target domain that follows different distribution from the source. To achieve this, DA methods include a source classification objective…

Machine Learning · Computer Science 2021-12-10 Fangrui Lv , Jian Liang , Kaixiong Gong , Shuang Li , Chi Harold Liu , Han Li , Di Liu , Guoren Wang

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

Distribution shift between train (source) and test (target) datasets is a common problem encountered in machine learning applications. One approach to resolve this issue is to use the Unsupervised Domain Adaptation (UDA) technique that…

Domain adaptation (DA) enables knowledge transfer from a labeled source domain to an unlabeled target domain by reducing the cross-domain distribution discrepancy. Most prior DA approaches leverage complicated and powerful deep neural…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Shuang Li , Jinming Zhang , Wenxuan Ma , Chi Harold Liu , Wei Li

In many practical applications, it is often difficult and expensive to obtain enough large-scale labeled data to train deep neural networks to their full capability. Therefore, transferring the learned knowledge from a separate, labeled…

Machine Learning · Computer Science 2020-02-28 Sicheng Zhao , Bo Li , Colorado Reed , Pengfei Xu , Kurt Keutzer

Conventional domain adaptation (DA) techniques aim to improve domain transferability by learning domain-invariant representations; while concurrently preserving the task-discriminability knowledge gathered from the labeled source data.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Jogendra Nath Kundu , Akshay Kulkarni , Suvaansh Bhambri , Deepesh Mehta , Shreyas Kulkarni , Varun Jampani , R. Venkatesh Babu

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

Unsupervised domain adaptation (UDA) adapts a model from a labeled source domain to an unlabeled target domain in a one-off way. Though widely applied, UDA faces a great challenge whenever the distribution shift between the source and the…

Machine Learning · Computer Science 2025-01-06 Yifei He , Haoxiang Wang , Bo Li , Han Zhao

Distribution shifts are all too common in real-world applications of machine learning. Domain adaptation (DA) aims to address this by providing various frameworks for adapting models to the deployment data without using labels. However, the…

Machine Learning · Computer Science 2023-09-08 Linus Ericsson , Da Li , Timothy M. Hospedales

Most existing multi-source domain adaptation (MSDA) methods minimize the distance between multiple source-target domain pairs via feature distribution alignment, an approach borrowed from the single source setting. However, with diverse…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Zhongying Deng , Kaiyang Zhou , Yongxin Yang , Tao Xiang

Transfer learning aims to learn robust classifiers for the target domain by leveraging knowledge from a source domain. Since the source and the target domains are usually from different distributions, existing methods mainly focus on…

Machine Learning · Computer Science 2019-09-19 Jindong Wang , Yiqiang Chen , Wenjie Feng , Han Yu , Meiyu Huang , Qiang Yang

While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain…

Machine Learning · Computer Science 2017-10-31 Han Zhao , Shanghang Zhang , Guanhang Wu , João P. Costeira , José M. F. Moura , Geoffrey J. Gordon

Unsupervised domain adaptation is one of the challenging problems in computer vision. This paper presents a novel approach to unsupervised domain adaptations based on the optimal transport-based distance. Our approach allows aligning target…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Thanh-Dat Truong , Naga Venkata Sai Raviteja Chappa , Xuan Bac Nguyen , Ngan Le , Ashley Dowling , Khoa Luu

A fundamental assumption of most machine learning algorithms is that the training and test data are drawn from the same underlying distribution. However, this assumption is violated in almost all practical applications: machine learning…

Machine Learning · Computer Science 2021-12-02 Marvin Zhang , Henrik Marklund , Nikita Dhawan , Abhishek Gupta , Sergey Levine , Chelsea Finn

Machine learning systems operate under the assumption that training and test data are sampled from a fixed probability distribution. However, this assumptions is rarely verified in practice, as the conditions upon which data was acquired…

Machine Learning · Computer Science 2025-07-09 Eduardo Fernandes Montesuma , Fred Maurice Ngolè Mboula , Antoine Souloumiac

This thesis contributes to the mathematical foundation of domain adaptation as emerging field in machine learning. In contrast to classical statistical learning, the framework of domain adaptation takes into account deviations between…

Machine Learning · Statistics 2020-04-23 Werner Zellinger

In this paper, we present an adversarial unsupervised domain adaptation framework for object detection. Prior approaches utilize adversarial training based on cross entropy between the source and target domain distributions to learn a…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Pengcheng Xu , Prudhvi Gurram , Gene Whipps , Rama Chellappa

Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution. While absent assumptions, domain adaptation is impossible, strict conditions, e.g.…

Machine Learning · Computer Science 2019-03-13 Yifan Wu , Ezra Winston , Divyansh Kaushik , Zachary Lipton

Distribution data refers to a data set where each sample is represented as a probability distribution, a subject area receiving burgeoning interest in the field of statistics. Although several studies have developed…

Methodology · Statistics 2024-02-09 Ryo Okano , Masaaki Imaizumi

Given multiple source domains, domain generalization aims at learning a universal model that performs well on any unseen but related target domain. In this work, we focus on the domain generalization scenario where domain shifts occur among…

Machine Learning · Computer Science 2021-09-09 Jingge Wang , Yang Li , Liyan Xie , Yao Xie