English
Related papers

Related papers: Information-Theoretic Analysis of Unsupervised Dom…

200 papers

Training machine learning models for radioisotope identification using gamma spectroscopy remains an elusive challenge for many practical applications, largely stemming from the difficulty of acquiring and labeling large, diverse…

Machine Learning · Computer Science 2026-04-20 Peter Lalor , Ayush Panigrahy , Alex Hagen

Unsupervised domain adaptation (UDA) involves a supervised loss in a labeled source domain and an unsupervised loss in an unlabeled target domain, which often faces more severe overfitting (than classical supervised learning) as the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Jiaxing Huang , Dayan Guan , Aoran Xiao , Shijian Lu

Unsupervised domain adaptation (UDA) methods can dramatically improve generalization on unlabeled target domains. However, optimal hyper-parameter selection is critical to achieving high accuracy and avoiding negative transfer. Supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Kuniaki Saito , Donghyun Kim , Piotr Teterwak , Stan Sclaroff , Trevor Darrell , Kate Saenko

Transferring knowledge learned from the labeled source domain to the raw target domain for unsupervised domain adaptation (UDA) is essential to the scalable deployment of autonomous driving systems. State-of-the-art methods in UDA often…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Lingdong Kong , Niamul Quader , Venice Erin Liong

Domain adaptation refers to the problem of leveraging labeled data in a source domain to learn an accurate model in a target domain where labels are scarce or unavailable. A recent approach for finding a common representation of the two…

Machine Learning · Statistics 2018-03-20 Rui Shu , Hung H. Bui , Hirokazu Narui , Stefano Ermon

The success of deep learning in computer vision is mainly attributed to an abundance of data. However, collecting large-scale data is not always possible, especially for the supervised labels. Unsupervised domain adaptation (UDA) aims to…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Jiren Jin , Richard G. Calland , Takeru Miyato , Brian K. Vogel , Hideki Nakayama

The generalization error of a learning algorithm refers to the discrepancy between the loss of a learning algorithm on training data and that on unseen testing data. Various information-theoretic bounds on the generalization error have been…

Information Theory · Computer Science 2025-06-24 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

Unsupervised domain adaptation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Previous methods focus on learning domain-invariant features to decrease the discrepancy between the feature distributions…

Machine Learning · Computer Science 2021-06-30 Yuntao Du , Yinghao Chen , Fengli Cui , Xiaowen Zhang , Chongjun Wang

Unsupervised domain adaptation leverages abundant labeled data from various source domains to generalize onto unlabeled target data. Prior research has primarily focused on learning domain-invariant features across the source and target…

Computation and Language · Computer Science 2025-03-10 Jie He , Wendi Zhou , Xiang Lorraine Li , Jeff Z. Pan

Source-Free Unsupervised Domain Adaptation (SFUDA) is a challenging task where a model needs to be adapted to a new domain without access to target domain labels or source domain data. The primary difficulty in this task is that the model's…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Yangyang Shu , Xiaofeng Cao , Qi Chen , Bowen Zhang , Ziqin Zhou , Anton van den Hengel , Lingqiao Liu

This paper introduces the first fully unsupervised domain adaptation (UDA) framework for unsupervised anomaly detection (UAD). The performance of UAD techniques degrades significantly in the presence of a domain shift, difficult to avoid in…

Machine Learning · Computer Science 2025-12-29 Nesryne Mejri , Enjie Ghorbel , Anis Kacem , Pavel Chernakov , Niki Foteinopoulou , Djamila Aouada

Domain adaptation seeks to leverage the abundant label information in a source domain to improve classification performance in a target domain with limited labels. While the field has seen extensive methodological development, its…

Machine Learning · Statistics 2025-07-31 Elif Vural , Huseyin Karaca

Unsupervised Domain Adaptation (UDA) aims to classify unlabeled target domain by transferring knowledge from labeled source domain with domain shift. Most of the existing UDA methods try to mitigate the adverse impact induced by the shift…

Machine Learning · Computer Science 2022-12-13 Weikai Li , Songcan Chen

We address the problem of unsupervised domain adaptation (UDA) by learning a cross-domain agnostic embedding space, where the distance between the probability distributions of the two source and target visual domains is minimized. We use…

Machine Learning · Computer Science 2019-09-25 Alex Gabourie , Mohammad Rostami , Philip Pope , Soheil Kolouri , Kyungnam Kim

Unsupervised domain adaptation (UDA) aims to adapt existing models of the source domain to a new target domain with only unlabeled data. Most existing methods suffer from noticeable negative transfer resulting from either the error-prone…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Qianyu Zhou , Zhengyang Feng , Qiqi Gu , Guangliang Cheng , Xuequan Lu , Jianping Shi , Lizhuang Ma

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang

We study the generalization properties of the popular stochastic optimization method known as stochastic gradient descent (SGD) for optimizing general non-convex loss functions. Our main contribution is providing upper bounds on the…

Machine Learning · Computer Science 2021-08-17 Gergely Neu , Gintare Karolina Dziugaite , Mahdi Haghifam , Daniel M. Roy

Domain adaptation (DA) addresses the real-world image classification problem of discrepancy between training (source) and testing (target) data distributions. We propose an unsupervised DA method that considers the presence of only…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Debasmit Das , C. S. George Lee

Learning domain-invariant representations has become a popular approach to unsupervised domain adaptation and is often justified by invoking a particular suite of theoretical results. We argue that there are two significant flaws in such…

Machine Learning · Statistics 2019-07-05 Fredrik D. Johansson , David Sontag , Rajesh Ranganath

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher