English
Related papers

Related papers: Respecting Domain Relations: Hypothesis Invariance…

200 papers

Domain Randomization (DR) is known to require a significant amount of training data for good performance. We argue that this is due to DR's strategy of random data generation using a uniform distribution over simulation parameters, as a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Rawal Khirodkar , Kris M. Kitani

Unsupervised domain adaptation aims at transferring knowledge from the labeled source domain to the unlabeled target domain. Previous adversarial domain adaptation methods mostly adopt the discriminator with binary or $K$-dimensional output…

Machine Learning · Computer Science 2020-01-03 Yuntao Du , Zhiwen Tan , Qian Chen , Xiaowen Zhang , Yirong Yao , Chongjun Wang

Unsupervised domain adaptation aims to learn a model of classifier for unlabeled samples on the target domain, given training data of labeled samples on the source domain. Impressive progress is made recently by learning invariant features…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Yabin Zhang , Hui Tang , Kui Jia , Mingkui Tan

A fundamental assumption of most machine learning algorithms is that the training and test data are drawn from the same underlying distribution. However, this assumption is violated in almost all practical applications: machine learning…

Machine Learning · Computer Science 2021-12-02 Marvin Zhang , Henrik Marklund , Nikita Dhawan , Abhishek Gupta , Sergey Levine , Chelsea Finn

The data-driven approach to robot control has been gathering pace rapidly, yet generalization to unseen task domains remains a critical challenge. We argue that the key to generalization is representations that are (i) rich enough to…

Robotics · Computer Science 2023-12-05 Bo Ai , Zhanxin Wu , David Hsu

Traditional domain generalization methods often rely on domain alignment to reduce inter-domain distribution differences and learn domain-invariant representations. However, domain shifts are inherently difficult to eliminate, which limits…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuheng Xu , Taiping Zhang

The accuracy of deep learning (e.g., convolutional neural networks) for an image classification task critically relies on the amount of labeled training data. Aiming to solve an image classification task on a new domain that lacks labeled…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Xianghong Fang , Haoli Bai , Ziyi Guo , Bin Shen , Steven Hoi , Zenglin Xu

A predictor, $f_A : X \to Y$, learned with data from a source domain (A) might not be accurate on a target domain (B) when their distributions are different. Domain adaptation aims to reduce the negative effects of this distribution…

Machine Learning · Computer Science 2022-01-17 Roberto Vega , Russell Greiner

Out-of-distribution (OOD) generalisation is challenging because it involves not only learning from empirical data, but also deciding among various notions of generalisation, e.g., optimising the average-case risk, worst-case risk, or…

Machine Learning · Computer Science 2024-05-31 Anurag Singh , Siu Lun Chau , Shahine Bouabid , Krikamol Muandet

In the problem of domain adaptation for binary classification, the learner is presented with labeled examples from a source domain, and must correctly classify unlabeled examples from a target domain, which may differ from the source.…

Machine Learning · Statistics 2019-03-01 Clayton Scott

Domain generalization models learn to generalize to previously unseen domains, but suffer from prediction uncertainty and domain shift. In this paper, we address both problems. We introduce a probabilistic meta-learning model for domain…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Yingjun Du , Jun Xu , Huan Xiong , Qiang Qiu , Xiantong Zhen , Cees G. M. Snoek , Ling Shao

Handling out-of-distribution samples is a long-lasting challenge for deep visual models. In particular, domain generalization (DG) is one of the most relevant tasks that aims to train a model with a generalization capability on novel…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Sang-Yeong Jo , Sung Whan Yoon

Clinical machine learning models experience significantly degraded performance in datasets not seen during training, e.g., new hospitals or populations. Recent developments in domain generalization offer a promising solution to this problem…

Machine Learning · Computer Science 2021-04-16 Haoran Zhang , Natalie Dullerud , Laleh Seyyed-Kalantari , Quaid Morris , Shalmali Joshi , Marzyeh Ghassemi

Researchers have been facing a difficult problem that data generation mechanisms could be influenced by internal or external factors leading to the training and test data with quite different distributions, consequently traditional…

Machine Learning · Statistics 2021-10-14 Anqi Wu

We study the problem of unsupervised domain adaptation, which aims to adapt classifiers trained on a labeled source domain to an unlabeled target domain. Many existing approaches first learn domain-invariant features and then construct…

Machine Learning · Computer Science 2012-07-03 Yuan Shi , Fei Sha

Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain…

Computation and Language · Computer Science 2022-10-26 Md Arafat Sultan , Avirup Sil , Radu Florian

Learning domain-invariant representation is a dominant approach for domain generalization (DG), where we need to build a classifier that is robust toward domain shifts. However, previous domain-invariance-based methods overlooked the…

Machine Learning · Computer Science 2020-03-03 Kei Akuzawa , Yusuke Iwasawa , Yutaka Matsuo

Though deep neural networks have achieved impressive success on various vision tasks, obvious performance degradation still exists when models are tested in out-of-distribution scenarios. In addressing this limitation, we ponder that the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Xiaotong Li , Zixuan Hu , Jun Liu , Yixiao Ge , Yongxing Dai , Ling-Yu Duan

The goal of causal representation learning is to find a representation of data that consists of causally related latent variables. We consider a setup where one has access to data from multiple domains that potentially share a causal…

Machine Learning · Statistics 2023-10-30 Nils Sturma , Chandler Squires , Mathias Drton , Caroline Uhler

Deep imbalanced regression (DIR), where the target values have a highly skewed distribution and are also continuous, is an intriguing yet under-explored problem in machine learning. While recent works have already shown that incorporating…

Machine Learning · Computer Science 2024-12-20 Ruizhi Pu , Gezheng Xu , Ruiyi Fang , Binkun Bao , Charles X. Ling , Boyu Wang