English
Related papers

Related papers: Domain Generalization via Gradient Surgery

200 papers

Convolutional neural networks require numerous data for training. Considering the difficulties in data collection and labeling in some specific tasks, existing approaches generally use models pre-trained on a large source domain (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Zhichen Zhao , Bowen Zhang , Yuning Jiang , Li Xu , Lei Li , Wei-Ying Ma

The phenomenon of distribution shift (DS) occurs when a dataset at test time differs from the dataset at training time, which can significantly impair the performance of a machine learning model in practical settings due to a lack of…

Though convolutional neural networks (CNNs) have demonstrated remarkable ability in learning discriminative features, they often generalize poorly to unseen domains. Domain generalization aims to address this problem by learning from a set…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Kaiyang Zhou , Yongxin Yang , Yu Qiao , Tao Xiang

Deep learning models for verification systems often fail to generalize to new users and new environments, even though they learn highly discriminative features. To address this problem, we propose a few-shot domain generalization framework…

Sound · Computer Science 2022-06-29 Seunghan Yang , Debasmit Das , Janghoon Cho , Hyoungwoo Park , Sungrack Yun

Machine learning models typically suffer from the domain shift problem when trained on a source dataset and evaluated on a target dataset of different distribution. To overcome this problem, domain generalisation (DG) methods aim to…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

Domain generalization (DG) tends to alleviate the poor generalization capability of deep neural networks by learning model with multiple source domains. A classical solution to DG is domain augmentation, the common belief of which is that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Fangrui Lv , Jian Liang , Shuang Li , Jinming Zhang , Di Liu

The absence of well-structured large datasets in medical computer vision results in decreased performance of automated systems and, especially, of deep learning models. Domain generalization techniques aim to approach unknown domains from a…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Nikolaos Spanos , Anastasios Arsenos , Paraskevi-Antonia Theofilou , Paraskevi Tzouveli , Athanasios Voulodimos , Stefanos Kollias

In search of robust and generalizable machine learning models, Domain Generalization (DG) has gained significant traction during the past few years. The goal in DG is to produce models which continue to perform well when presented with data…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Aristotelis Ballas , Christos Diou

Although recent advances in machine learning have shown its success to learn from independent and identically distributed (IID) data, it is vulnerable to out-of-distribution (OOD) data in an open world. Domain generalization (DG) deals with…

Machine Learning · Computer Science 2024-05-14 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

Machine learning models fail to perform when facing out-of-distribution (OOD) domains, a challenging task known as domain generalization (DG). In this work, we develop a novel DG training strategy, we call PGrad, to learn a robust gradient…

Machine Learning · Computer Science 2023-05-03 Zhe Wang , Jake Grigsby , Yanjun Qi

Change detection has essential significance for the region's development, in which pseudo-changes between bitemporal images induced by imaging environmental factors are key challenges. Existing transformation-based methods regard…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Qi Zang , Shuang Wang , Dong Zhao , Dou Quan , Yang Hu , Licheng Jiao

Machine learning algorithms have achieved remarkable success across various disciplines, use cases and applications, under the prevailing assumption that training and test samples are drawn from the same distribution. Consequently, these…

Machine Learning · Computer Science 2024-11-07 Zehao Xiao , Cees G. M. Snoek

With promising results of machine learning based models in computer vision, applications on medical imaging data have been increasing exponentially. However, generalizations to complex real-world clinical data is a persistent problem. Deep…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Nooshin Mojab , Vahid Noroozi , Darvin Yi , Manoj Prabhakar Nallabothula , Abdullah Aleem , Phillip S. Yu , Joelle A. Hallak

The hypothesis that computational models can be reliable enough to be adopted in prognosis and patient care is revolutionizing healthcare. Deep learning, in particular, has been a game changer in building predictive models, thus leading to…

Machine Learning · Statistics 2019-06-17 Jayaraman J. Thiagarajan , Deepta Rajan , Prasanna Sattigeri

While deep neural networks demonstrate state-of-the-art performance on a variety of learning tasks, their performance relies on the assumption that train and test distributions are the same, which may not hold in real-world applications.…

Machine Learning · Computer Science 2021-02-18 Wenyu Zhang , Mohamed Ragab , Ramon Sagarna

All famous machine learning algorithms that comprise both supervised and semi-supervised learning work well only under a common assumption: the training and test data follow the same distribution. When the distribution changes, most…

Machine Learning · Computer Science 2022-07-15 Ievgen Redko , Emilie Morvant , Amaury Habrard , Marc Sebban , Younès Bennani

Domain generalization aims to apply knowledge gained from multiple labeled source domains to unseen target domains. The main difficulty comes from the dataset bias: training data and test data have different distributions, and the training…

Machine Learning · Computer Science 2018-07-24 Ya Li , Mingming Gong , Xinmei Tian , Tongliang Liu , Dacheng Tao

Convolutional Neural Networks (CNNs) show impressive performance in the standard classification setting where training and testing data are drawn i.i.d. from a given domain. However, CNNs do not readily generalize to new domains with…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Nathan Somavarapu , Chih-Yao Ma , Zsolt Kira

Deep learning (DL)-based models have demonstrated good performance in medical image segmentation. However, the models trained on a known dataset often fail when performed on an unseen dataset collected from different centers, vendors and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Lei Li , Veronika A. Zimmer , Wangbin Ding , Fuping Wu , Liqin Huang , Julia A. Schnabel , Xiahai Zhuang

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xiaotong Li , Yongxing Dai , Yixiao Ge , Jun Liu , Ying Shan , Ling-Yu Duan