English
Related papers

Related papers: Contrastive ACE: Domain Generalization Through Ali…

200 papers

Invariance learning methods aim to learn invariant features in the hope that they generalize under distributional shifts. Although many tasks are naturally characterized by continuous domains, current invariance learning techniques…

Machine Learning · Computer Science 2024-04-24 Yong Lin , Fan Zhou , Lu Tan , Lintao Ma , Jiameng Liu , Yansu He , Yuan Yuan , Yu Liu , James Zhang , Yujiu Yang , Hao Wang

Existing domain adaptation methods assume that domain discrepancies are caused by a few discrete attributes and variations, e.g., art, real, painting, quickdraw, etc. We argue that this is not realistic as it is implausible to define the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Yinsong Xu , Zhuqing Jiang , Aidong Men , Yang Liu , Qingchao Chen

Domain adaptation solves the learning problem in a target domain by leveraging the knowledge in a relevant source domain. While remarkable advances have been made, almost all existing domain adaptation methods heavily require large amounts…

Machine Learning · Computer Science 2021-10-13 Shuai Yang , Kui Yu , Fuyuan Cao , Lin Liu , Hao Wang , Jiuyong Li

The promise that causal modelling can lead to robust AI generalization has been challenged in recent work on domain generalization (DG) benchmarks. We revisit the claims of the causality and DG literature, reconciling apparent…

Domain generalization aims at developing suitable learning algorithms in source training domains such that the model learned can generalize well on a different unseen testing domain. We present a novel two-stage approach called…

Machine Learning · Computer Science 2025-04-07 Hao Yan , Yuhong Guo

Domain-invariant representation learning is a powerful method for domain generalization. Previous approaches face challenges such as high computational demands, training instability, and limited effectiveness with high-dimensional data,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Yuheng Xu , Taiping Zhang

A basic assumption of statistical learning theory is that train and test data are drawn from the same underlying distribution. Unfortunately, this assumption doesn't hold in many applications. Instead, ample labeled data might exist in a…

Computer Vision and Pattern Recognition · Computer Science 2012-11-21 Oscar Beijbom

Machine learning models trained with purely observational data and the principle of empirical risk minimization \citep{vapnik_principles_1992} can fail to generalize to unseen domains. In this paper, we focus on the case where the problem…

Machine Learning · Statistics 2020-10-27 Maximilian Ilse , Jakub M. Tomczak , Patrick Forré

Domain generalization (DG) task aims to learn a robust model from source domains that could handle the out-of-distribution (OOD) issue. In order to improve the generalization ability of the model in unseen domains, increasing the diversity…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Shanshan Wang , ALuSi , Xun Yang , Ke Xu , Huibin Tan , Xingyi Zhang

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

In the context of single domain generalisation, the objective is for models that have been exclusively trained on data from a single domain to demonstrate strong performance when confronted with various unfamiliar domains. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Anastasios Arsenos , Dimitrios Kollias , Evangelos Petrongonas , Christos Skliros , Stefanos Kollias

Domain generalization aims to learn a predictive model from multiple different but related source tasks that can generalize well to a target task without the need of accessing any target data. Existing domain generalization methods ignore…

Machine Learning · Computer Science 2022-06-08 William Wei Wang , Gezheng Xu , Ruizhi Pu , Jiaqi Li , Fan Zhou , Changjian Shui , Charles Ling , Christian Gagné , Boyu Wang

The standard closed-set domain adaptation approaches seek to mitigate distribution discrepancies between two domains under the constraint of both sharing identical label sets. However, in realistic scenarios, finding an optimal source…

Machine Learning · Computer Science 2022-12-06 Sandipan Choudhuri , Suli Adeniye , Arunabha Sen , Hemanth Venkateswara

While deep neural networks demonstrate state-of-the-art performance on a variety of learning tasks, their performance relies on the assumption that train and test distributions are the same, which may not hold in real-world applications.…

Machine Learning · Computer Science 2021-02-18 Wenyu Zhang , Mohamed Ragab , Ramon Sagarna

Two prevalent types of distributional shifts in machine learning are the covariate shift (as observed across different domains) and the semantic shift (as seen across different classes). Traditional OOD detection techniques typically…

Artificial Intelligence · Computer Science 2023-09-20 Haoliang Wang , Chen Zhao , Yunhui Guo , Kai Jiang , Feng Chen

We propose associative domain adaptation, a novel technique for end-to-end domain adaptation with neural networks, the task of inferring class labels for an unlabeled target domain based on the statistical properties of a labeled source…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Philip Haeusser , Thomas Frerix , Alexander Mordvintsev , Daniel Cremers

Learning Invariant Representations has been successfully applied for reconciling a source and a target domain for Unsupervised Domain Adaptation. By investigating the robustness of such methods under the prism of the cluster assumption, we…

Machine Learning · Computer Science 2020-07-01 Yassine Ouali , Victor Bouvier , Myriam Tami , Céline Hudelot

Domain generalization (DG), aiming at models able to work on multiple unseen domains, is a must-have characteristic of general artificial intelligence. DG based on single source domain training data is more challenging due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Qingyue Yang , Hongjing Niu , Pengfei Xia , Wei Zhang , Bin Li

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

The ability to learn and act in novel situations is still a prerogative of animate intelligence, as current machine learning methods mostly fail when moving beyond the standard i.i.d. setting. What is the reason for this discrepancy? Most…

Machine Learning · Computer Science 2018-12-04 Niki Kilbertus , Giambattista Parascandolo , Bernhard Schölkopf