English
Related papers

Related papers: Cross-Domain Ensemble Distillation for Domain Gene…

200 papers

In this work, we propose to tackle the problem of domain generalization in the context of \textit{insufficient samples}. Instead of extracting latent feature embeddings based on deterministic models, we propose to learn a domain-invariant…

Machine Learning · Computer Science 2024-02-12 Kecheng Chen , Elena Gal , Hong Yan , Haoliang Li

Training robust learning algorithms across different medical imaging modalities is challenging due to the large domain gap. Unsupervised domain adaptation (UDA) mitigates this problem by using annotated images from the source domain and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Chen Li , Meilong Xu , Xiaoling Hu , Weimin Lyu , Chao Chen

Out-of-Domain (OOD) generalization is the ability of a model trained on one or more domains to generalize to unseen domains. In the ImageNet era of computer vision, evaluation sets for measuring a model's OOD performance were designed to be…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Prasanna Mayilvahanan , Roland S. Zimmermann , Thaddäus Wiedemer , Evgenia Rusak , Attila Juhos , Matthias Bethge , Wieland Brendel

The ability to generalize learned representations across significantly different visual domains, such as between real photos, clipart, paintings, and sketches, is a fundamental capacity of the human visual system. In this paper, different…

State-of-the-art stereo matching networks have difficulties in generalizing to new unseen environments due to significant domain differences, such as color, illumination, contrast, and texture. In this paper, we aim at designing a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Feihu Zhang , Xiaojuan Qi , Ruigang Yang , Victor Prisacariu , Benjamin Wah , Philip Torr

Unsupervised domain adaptation addresses the problem of classifying data in an unlabeled target domain, given labeled source domain data that share a common label space but follow a different distribution. Most of the recent methods take…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Hui Tang , Yaowei Wang , Kui Jia

Domain generalization models aim to learn cross-domain knowledge from source domain data, to improve performance on unknown target domains. Recent research has demonstrated that diverse and rich source domain samples can enhance domain…

Machine Learning · Computer Science 2024-03-12 Jianting Chen , Ling Ding , Yunxiao Yang , Zaiyuan Di , Yang Xiang

Deep Learning has emerged as a promising approach for skin lesion analysis. However, existing methods mostly rely on fully supervised learning, requiring extensive labeled data, which is challenging and costly to obtain. To alleviate this…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Siyamalan Manivannan

Domain adaptation has become a prominent problem setting in machine learning and related fields. This review asks the question: how can a classifier learn from a source domain and generalize to a target domain? We present a categorization…

Machine Learning · Computer Science 2021-06-18 Wouter M. Kouw , Marco Loog

Currently, the divergence in distributions of design and operational data, and large computational complexity are limiting factors in the adoption of CNNs in real-world applications. For instance, person re-identification systems typically…

Machine Learning · Computer Science 2020-05-19 Le Thanh Nguyen-Meidine , Eric Granger , Madhu Kiran , Jose Dolz , Louis-Antoine Blais-Morin

Domain Generalization (DG) aims to resolve distribution shifts between source and target domains, and current DG methods are default to the setting that data from source and target domains share identical categories. Nevertheless, there…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Zining Chen , Weiqiu Wang , Zhicheng Zhao , Fei Su , Aidong Men , Hongying Meng

Deep ensembles excel in large-scale image classification tasks both in terms of prediction accuracy and calibration. Despite being simple to train, the computation and memory cost of deep ensembles limits their practicability. While some…

Machine Learning · Computer Science 2021-10-28 Giung Nam , Jongmin Yoon , Yoonho Lee , Juho Lee

Aiming towards human-level generalization, there is a need to explore adaptable representation learning methods with greater transferability. Most existing approaches independently address task-transferability and cross-domain adaptation,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Jogendra Nath Kundu , Nishank Lakkakula , R. Venkatesh Babu

Recently, considerable effort has been devoted to deep domain adaptation in computer vision and machine learning communities. However, most of existing work only concentrates on learning shared feature representation by minimizing the…

Machine Learning · Computer Science 2019-04-24 Chao Chen , Zhihong Chen , Boyuan Jiang , Xinyu Jin

Existing domain adaptation (DA) and generalization (DG) methods in object detection enforce feature alignment in the visual space but face challenges like object appearance variability and scene complexity, which make it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Sina Malakouti , Adriana Kovashka

Domain generalization aims to learn a model with good generalization ability, that is, the learned model should not only perform well on several seen domains but also on unseen domains with different data distributions. State-of-the-art…

Machine Learning · Computer Science 2023-04-04 Boyang Lyu , Thuan Nguyen , Matthias Scheutz , Prakash Ishwar , Shuchin Aeron

Domain adaptation (DA) is transfer learning which aims to learn an effective predictor on target data from source data despite data distribution mismatch between source and target. We present in this paper a novel unsupervised DA method for…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Lingkun Luo , Liming Chen , Ying lu , Shiqiang Hu

This paper presents a novel knowledge distillation based model compression framework consisting of a student ensemble. It enables distillation of simultaneously learnt ensemble knowledge onto each of the compressed student models. Each…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Devesh Walawalkar , Zhiqiang Shen , Marios Savvides

Recent studies have proven that DNNs, unlike human vision, tend to exploit texture information rather than shape. Such texture bias is one of the factors for the poor generalization performance of DNNs. We observe that the texture bias…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Hwan Heo , Youngjin Oh , Jaewon Lee , Hyunwoo J. Kim

The performance of existing underwater object detection methods degrades seriously when facing domain shift caused by complicated underwater environments. Due to the limitation of the number of domains in the dataset, deep detectors easily…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Yang Chen , Pinhao Song , Hong Liu , Linhui Dai , Xiaochuan Zhang , Runwei Ding , Shengquan Li