English
Related papers

Related papers: Information-Theoretic Analysis of Unsupervised Dom…

200 papers

Adversarial discriminative domain adaptation (ADDA) is an efficient framework for unsupervised domain adaptation in image classification, where the source and target domains are assumed to have the same classes, but no labels are available…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Aaron Chadha , Yiannis Andreopoulos

Domain adaptation approaches seek to learn from a source domain and generalize it to an unseen target domain. At present, the state-of-the-art unsupervised domain adaptation approaches for subjective text classification problems leverage…

Machine Learning · Computer Science 2020-10-22 Jitin Krishnan , Hemant Purohit , Huzefa Rangwala

Unsupervised Domain Adaptation (UDA) endeavors to adjust models trained on a source domain to perform well on a target domain without requiring additional annotations. In the context of domain adaptive semantic segmentation, which tackles…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Wenlve Zhou , Zhiheng Zhou , Tianlei Wang , Delu Zeng

Domain Adaptation (DA) is always challenged by the spurious correlation between domain-invariant features (e.g., class identity) and domain-specific features (e.g., environment) that does not generalize to the target domain. Unfortunately,…

Machine Learning · Computer Science 2023-12-05 Zhongqi Yue , Hanwang Zhang , Qianru Sun

Existing calibration algorithms address the problem of covariate shift via unsupervised domain adaptation. However, these methods suffer from the following limitations: 1) they require unlabeled data from the target domain, which may not be…

Machine Learning · Computer Science 2021-10-19 Yunye Gong , Xiao Lin , Yi Yao , Thomas G. Dietterich , Ajay Divakaran , Melinda Gervasio

In this paper we present a solution to the task of "unsupervised domain adaptation (UDA) of a given pre-trained semantic segmentation model without relying on any source domain representations". Previous UDA approaches for semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Marvin Klingner , Jan-Aike Termöhlen , Jacob Ritterbach , Tim Fingscheidt

Deep learning models are sensitive to domain shift phenomena. A model trained on images from one domain cannot generalise well when tested on images from a different domain, despite capturing similar anatomical structures. It is mainly…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Sulaiman Vesal , Mingxuan Gu , Ronak Kosti , Andreas Maier , Nishant Ravikumar

Multi-source domain adaptation (MDA) aims to transfer knowledge from multiple source domains to an unlabeled target domain. MDA is a challenging task due to the severe domain shift, which not only exists between target and source but also…

Machine Learning · Computer Science 2022-02-23 Ren Chuan-Xian , Liu Yong-Hui , Zhang Xi-Wen , Huang Ke-Kun

Given data from diverse sets of distinct distributions, domain generalization aims to learn models that generalize to unseen distributions. A common approach is designing a data-driven surrogate penalty to capture generalization and…

Machine Learning · Computer Science 2023-08-31 Ozan Sener , Vladlen Koltun

Unsupervised domain adaptation (UDA) aims to transfer the knowledge on a labeled source domain distribution to perform well on an unlabeled target domain. Recently, the deep self-training involves an iterative process of predicting on the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Xiaofeng Liu , Bo Hu , Xiongchang Liu , Jun Lu , Jane You , Lingsheng Kong

Unsupervised domain adaptation (UDA) deals with the adaptation process of a model to an unlabeled target domain while annotated data is only available for a given source domain. This poses a challenging task, as the domain shift between…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Tobias Ringwald , Rainer Stiefelhagen

Unsupervised domain adaptation (UDA) aims to enhance the generalization capability of a certain model from a source domain to a target domain. UDA is of particular significance since no extra effort is devoted to annotating target domain…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Qiming Zhang , Jing Zhang , Wei Liu , Dacheng Tao

Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce. This is because most learning algorithms strongly rely on the i.i.d.~assumption on source/target data, which is…

Machine Learning · Computer Science 2022-08-15 Kaiyang Zhou , Ziwei Liu , Yu Qiao , Tao Xiang , Chen Change Loy

Unsupervised domain adaptation (UDA) aims to learn transferable knowledge from a labeled source domain and adapts a trained model to an unlabeled target domain. To bridge the gap between source and target domains, one prevailing strategy is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Xu Ma , Junkun Yuan , Yen-wei Chen , Ruofeng Tong , Lanfen Lin

Most unsupervised domain adaptation (UDA) methods assume that labeled source images are available during model adaptation. However, this assumption is often infeasible owing to confidentiality issues or memory constraints on mobile devices.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 JoonHo Lee , Gyemin Lee

The aim of this paper is to give an overview of the recent advancements in the Unsupervised Domain Adaptation (UDA) of deep networks for semantic segmentation. This task is attracting a wide interest, since semantic segmentation models…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Marco Toldo , Andrea Maracani , Umberto Michieli , Pietro Zanuttigh

Successful unsupervised domain adaptation is guaranteed only under strong assumptions such as covariate shift and overlap between input domains. The latter is often violated in high-dimensional applications like image classification which,…

Machine Learning · Computer Science 2024-06-13 Adam Breitholtz , Anton Matsson , Fredrik D. Johansson

In this paper, we explore bounds on the expected risk when using deep neural networks for supervised classification from an information theoretic perspective. Firstly, we introduce model risk and fitting error, which are derived from…

Machine Learning · Computer Science 2024-10-08 Binchuan Qi

Generalization error bounds are critical to understanding the performance of machine learning models. In this work, we propose a new information-theoretic based generalization error upper bound applicable to supervised learning scenarios.…

Information Theory · Computer Science 2021-01-11 Gholamali Aminian , Laura Toni , Miguel R. D. Rodrigues

In this paper, we establish generalization bounds for transductive learning algorithms in the context of information theory and PAC-Bayes, covering both the random sampling and the random splitting setting. First, we show that the…

Machine Learning · Computer Science 2025-01-22 Huayi Tang , Yong Liu