English
Related papers

Related papers: Information-Theoretic Analysis of Unsupervised Dom…

200 papers

In this work, we study out-of-distribution (OOD) generalization in meta-reinforcement learning from an information-theoretic perspective. We begin by establishing OOD generalization bounds for meta-supervised learning under two distinct…

Machine Learning · Computer Science 2026-04-07 Xingtu Liu

Generalization is one of the key challenges in the clinical validation and application of deep learning models to medical images. Studies have shown that such models trained on publicly available datasets often do not work well on…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Yu Zhang , Gongbo Liang , Nathan Jacobs , Xiaoqin Wang

In statistical learning theory, generalization error is used to quantify the degree to which a supervised machine learning algorithm may overfit to training data. Recent work [Xu and Raginsky (2017)] has established a bound on the…

Machine Learning · Computer Science 2018-01-16 Ankit Pensia , Varun Jog , Po-Ling Loh

The ability to generalize learned representations across significantly different visual domains, such as between real photos, clipart, paintings, and sketches, is a fundamental capacity of the human visual system. In this paper, different…

Data modification, either via additional training datasets, data augmentation, debiasing, and dataset filtering, has been proposed as an effective solution for generalizing to out-of-domain (OOD) inputs, in both natural language processing…

Computation and Language · Computer Science 2022-03-16 Tejas Gokhale , Swaroop Mishra , Man Luo , Bhavdeep Singh Sachdeva , Chitta Baral

Unsupervised domain adaptation (UDA) methods for person re-identification (re-ID) aim at transferring re-ID knowledge from labeled source data to unlabeled target data. Although achieving great success, most of them only use limited data…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Zechen Bai , Zhigang Wang , Jian Wang , Di Hu , Errui Ding

Unsupervised domain adaptation (UDA) methods intend to reduce the gap between source and target domains by using unlabeled target domain and labeled source domain data, however, in the medical domain, target domain data may not always be…

Image and Video Processing · Electrical Eng. & Systems 2022-02-01 Mingxuan Gu , Sulaiman Vesal , Ronak Kosti , Andreas Maier

We study the issue of PAC-Bayesian domain adaptation: We want to learn, from a source domain, a majority vote model dedicated to a target one. Our theoretical contribution brings a new perspective by deriving an upper-bound on the target…

Machine Learning · Statistics 2016-07-27 Pascal Germain , Amaury Habrard , François Laviolette , Emilie Morvant

Domain generalization (DG) aims to incorporate knowledge from multiple source domains into a single model that could generalize well on unseen target domains. This problem is ubiquitous in practice since the distributions of the target data…

Machine Learning · Statistics 2019-07-26 Shoubo Hu , Kun Zhang , Zhitang Chen , Laiwan Chan

Neural networks are fragile when confronted with data that significantly deviates from their training distribution. This is true in particular for simulation-based inference methods, such as neural amortized Bayesian inference (ABI), where…

Image-to-image translation architectures may have limited effectiveness in some circumstances. For example, while generating rainy scenarios, they may fail to model typical traits of rain as water drops, and this ultimately impacts the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Fabio Pizzati , Raoul de Charette , Michela Zaccaria , Pietro Cerri

Unsupervised domain adaptation (UDA) deals with the adaptation of models from a given source domain with labeled data to an unlabeled target domain. In this paper, we utilize the inherent prediction uncertainty of a model to accomplish the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Tobias Ringwald , Rainer Stiefelhagen

Meta-learning, or "learning to learn", refers to techniques that infer an inductive bias from data corresponding to multiple related tasks with the goal of improving the sample efficiency for new, previously unobserved, tasks. A key…

Machine Learning · Computer Science 2021-02-24 Sharu Theresa Jose , Osvaldo Simeone

Data augmentation has been widely applied as an effective methodology to improve generalization in particular when training deep neural networks. Recently, researchers proposed a few intensive data augmentation techniques, which indeed…

Machine Learning · Computer Science 2019-11-22 Zhuoxun He , Lingxi Xie , Xin Chen , Ya Zhang , Yanfeng Wang , Qi Tian

Recent developments in the unsupervised domain adaptation (UDA) enable the unsupervised machine learning (ML) prediction for target data, thus this will accelerate real world applications with ML models such as image recognition tasks in…

Machine Learning · Computer Science 2025-02-18 Hisashi Oshima , Tsuyoshi Ishizone , Tomoyuki Higuchi

The recent prevalence of deep neural networks has lead semantic segmentation networks to achieve human-level performance in the medical field when sufficient training data is provided. Such networks however fail to generalize when tasked…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Serban Stan , Mohammad Rostami

Domain Adaptation (DA) techniques are important for overcoming the domain shift between the source domain used for training and the target domain where testing takes place. However, current DA methods assume that the entire target domain is…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Abu Md Niamul Taufique , Chowdhury Sadman Jahan , Andreas Savakis

Domain adaptation is crucial to adapt a learned model to new scenarios, such as domain shifts or changing data distributions. Current approaches usually require a large amount of labeled or unlabeled data from the shifted domain. This can…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 M. Jehanzeb Mirza , Jakub Micorek , Horst Possegger , Horst Bischof

Unsupervised domain adaptation (UDA) is a critical problem for transfer learning, which aims to transfer the semantic information from labeled source domain to unlabeled target domain. Recent advancements in UDA models have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Shanshan Wang , Hao Zhou , Xun Yang , Zhenwei He , Mengzhu Wang , Xingyi Zhang , Meng Wang

Unsupervised domain adaptation is used in many machine learning applications where, during training, a model has access to unlabeled data in the target domain, and a related labeled dataset. In this paper, we introduce a novel and general…

Machine Learning · Computer Science 2021-06-23 David Acuna , Guojun Zhang , Marc T. Law , Sanja Fidler