English
Related papers

Related papers: Self-balanced Learning For Domain Generalization

200 papers

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

Domain generalization aims to address the domain shift between training and testing data. To learn the domain invariant representations, the model is usually trained on multiple domains. It has been found that the gradients of network…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Jiaqi Xu , Yuwang Wang , Xuejin Chen

Domain generalization (DG) strives to address distribution shifts across diverse environments to enhance model's generalizability. Current DG approaches are confined to acquiring robust representations with continuous features, specifically…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Shaocong Long , Qianyu Zhou , Xikun Jiang , Chenhao Ying , Lizhuang Ma , Yuan Luo

Deep neural networks (DNNs) have revolutionized artificial intelligence but often lack performance when faced with out-of-distribution (OOD) data, a common scenario due to the inevitable domain shifts in real-world applications. This…

Machine Learning · Computer Science 2024-08-23 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

Researchers have been facing a difficult problem that data generation mechanisms could be influenced by internal or external factors leading to the training and test data with quite different distributions, consequently traditional…

Machine Learning · Statistics 2021-10-14 Anqi Wu

Transferring knowledge across different datasets is an important approach to successfully train deep models with a small-scale target dataset or when few labeled instances are available. In this paper, we aim at developing a model that can…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Eman T. Hassan , Xin Chen , David Crandall

We study a worst-case scenario in generalization: Out-of-domain generalization from a single source. The goal is to learn a robust model from a single source and expect it to generalize over many unknown distributions. This challenging…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Fengchun Qiao , Xi Peng

A basic assumption of statistical learning theory is that train and test data are drawn from the same underlying distribution. Unfortunately, this assumption doesn't hold in many applications. Instead, ample labeled data might exist in a…

Computer Vision and Pattern Recognition · Computer Science 2012-11-21 Oscar Beijbom

Domain generalization aims to apply knowledge gained from multiple labeled source domains to unseen target domains. The main difficulty comes from the dataset bias: training data and test data have different distributions, and the training…

Machine Learning · Computer Science 2018-07-24 Ya Li , Mingming Gong , Xinmei Tian , Tongliang Liu , Dacheng Tao

The assumption that training and testing samples are generated from the same distribution does not always hold for real-world machine-learning applications. The procedure of tackling this discrepancy between the training (source) and…

Machine Learning · Computer Science 2018-12-05 Debasmit Das , C. S. George Lee

Traditional place categorization approaches in robot vision assume that training and test images have similar visual appearance. Therefore, any seasonal, illumination and environmental changes typically lead to severe degradation in…

Robotics · Computer Science 2018-05-31 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

In unsupervised domain adaptation (UDA), where models are trained on source data (e.g., synthetic) and adapted to target data (e.g., real-world) without target annotations, addressing the challenge of significant class imbalance remains an…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Roberto Alcover-Couso , Marcos Escudero-Viñolo , Juan C. SanMiguel , Jesus Bescós

There has been great interest in enhancing the robustness of neural network classifiers to defend against adversarial perturbations through adversarial training, while balancing the trade-off between robust accuracy and standard accuracy.…

Machine Learning · Computer Science 2022-10-24 Chester Holtz , Tsui-Wei Weng , Gal Mishne

In this work, we propose a domain generalization (DG) approach to learn on several labeled source domains and transfer knowledge to a target domain that is inaccessible in training. Considering the inherent conditional and label shifts, we…

Machine Learning · Computer Science 2021-07-26 Xiaofeng Liu , Bo Hu , Linghao Jin , Xu Han , Fangxu Xing , Jinsong Ouyang , Jun Lu , Georges EL Fakhri , Jonghye Woo

Multi-source domain adaptation aims at leveraging the knowledge from multiple tasks for predicting a related target domain. Hence, a crucial aspect is to properly combine different sources based on their relations. In this paper, we…

Machine Learning · Computer Science 2021-06-16 Changjian Shui , Zijian Li , Jiaqi Li , Christian Gagné , Charles Ling , Boyu Wang

Training a single model on multiple input domains and/or output tasks allows for compressing information from multiple sources into a unified backbone hence improves model efficiency. It also enables potential positive knowledge transfer…

Machine Learning · Computer Science 2023-10-16 Amelie Royer , Tijmen Blankevoort , Babak Ehteshami Bejnordi

Unsupervised domain adaptation aims to transfer knowledge from a source domain to a target domain so that the target domain data can be recognized without any explicit labelling information for this domain. One limitation of the problem…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Qian Wang , Penghui Bu , Toby P. Breckon

It has been known for a while that the problem of multi-source domain adaptation can be regarded as a single source domain adaptation task where the source domain corresponds to a mixture of the original source domains. Nonetheless, how to…

Machine Learning · Computer Science 2020-09-30 Diogo Pernes , Jaime S. Cardoso

Medical diagnosis might fail due to bias. In this work, we identified class-feature bias, which refers to models' potential reliance on features that are strongly correlated with only a subset of classes, leading to biased performance and…

Machine Learning · Computer Science 2025-09-03 Lishi Zuo , Man-Wai Mak , Lu Yi , Youzhi Tu

Studies show that the representations learned by deep neural networks can be transferred to similar prediction tasks in other domains for which we do not have enough labeled data. However, as we transition to higher layers in the model, the…

Machine Learning · Computer Science 2019-10-29 Raha Moraffah , Kai Shu , Adrienne Raglin , Huan Liu