English
Related papers

Related papers: Domain Generalization by Rejecting Extreme Augment…

200 papers

A recurring problem faced when training neural networks is that there is typically not enough data to maximize the generalization capability of deep neural networks(DNN). There are many techniques to address this, including data…

Artificial Intelligence · Computer Science 2017-04-26 Joseph Lemley , Shabab Bazrafkan , Peter Corcoran

In real-life applications, machine learning models often face scenarios where there is a change in data distribution between training and test domains. When the aim is to make predictions on distributions different from those seen at…

Machine Learning · Computer Science 2021-11-04 Lucas Mansilla , Rodrigo Echeveste , Diego H. Milone , Enzo Ferrante

Deep Neural Networks (DNNs) suffer from domain shift when the test dataset follows a distribution different from the training dataset. Domain generalization aims to tackle this issue by learning a model that can generalize to unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Yu Ding , Lei Wang , Bin Liang , Shuming Liang , Yang Wang , Fang Chen

Unsupervised domain adaptation studies the problem of utilizing a relevant source domain with abundant labels to build predictive modeling for an unannotated target domain. Recent work observe that the popular adversarial approach of…

Machine Learning · Statistics 2020-01-06 Shen Yan , Huan Song , Nanxiang Li , Lincan Zou , Liu Ren

Domain generalization (DG) aims to help models trained on a set of source domains generalize better on unseen target domains. The performances of current DG methods largely rely on sufficient labeled data, which are usually costly or…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Xingxuan Zhang , Linjun Zhou , Renzhe Xu , Peng Cui , Zheyan Shen , Haoxin Liu

Domain generalization (DG) is the challenging and topical problem of learning models that generalize to novel testing domains with different statistics than a set of known training domains. The simple approach of aggregating data from all…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Da Li , Jianshu Zhang , Yongxin Yang , Cong Liu , Yi-Zhe Song , Timothy M. Hospedales

Researchers have been facing a difficult problem that data generation mechanisms could be influenced by internal or external factors leading to the training and test data with quite different distributions, consequently traditional…

Machine Learning · Statistics 2021-10-14 Anqi Wu

Despite significant advances in deep learning, models often struggle to generalize well to new, unseen domains, especially when training data is limited. To address this challenge, we propose a novel approach for distribution-aware latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Ran Liu , Sahil Khose , Jingyun Xiao , Lakshmi Sathidevi , Keerthan Ramnath , Zsolt Kira , Eva L. Dyer

We introduce a new representation learning approach for domain adaptation, in which data at training and test time come from similar but different distributions. Our approach is directly inspired by the theory on domain adaptation…

Data augmentation is a popular tool for single source domain generalization, which expands the source domain by generating simulated ones, improving generalization on unseen target domains. In this work, we show that the performance of such…

Machine Learning · Computer Science 2025-05-20 Dong Kyu Cho , Inwoo Hwang , Sanghack Lee

When models, e.g., for semantic segmentation, are applied to images that are vastly different from training data, the performance will drop significantly. Domain adaptation methods try to overcome this issue, but need samples from the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Joshua Niemeijer , Manuel Schwonberg , Jan-Aike Termöhlen , Nico M. Schmidt , Tim Fingscheidt

Though deep neural networks have achieved impressive success on various vision tasks, obvious performance degradation still exists when models are tested in out-of-distribution scenarios. In addressing this limitation, we ponder that the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Xiaotong Li , Zixuan Hu , Jun Liu , Yixiao Ge , Yongxing Dai , Ling-Yu Duan

Recent successes in Generative Adversarial Networks (GAN) have affirmed the importance of using more data in GAN training. Yet it is expensive to collect data in many domains such as medical applications. Data Augmentation (DA) has been…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Ngoc-Trung Tran , Viet-Hung Tran , Ngoc-Bao Nguyen , Trung-Kien Nguyen , Ngai-Man Cheung

Data augmentation (DA) is a powerful workhorse for bolstering performance in modern machine learning. Specific augmentations like translations and scaling in computer vision are traditionally believed to improve generalization by generating…

Machine Learning · Computer Science 2024-02-29 Chi-Heng Lin , Chiraag Kaushik , Eva L. Dyer , Vidya Muthukumar

Machine learning systems generally assume that the training and testing distributions are the same. To this end, a key requirement is to develop models that can generalize to unseen distributions. Domain generalization (DG), i.e.,…

Machine Learning · Computer Science 2022-05-25 Jindong Wang , Cuiling Lan , Chang Liu , Yidong Ouyang , Tao Qin , Wang Lu , Yiqiang Chen , Wenjun Zeng , Philip S. Yu

We propose a novel approach for domain generalisation (DG) leveraging risk distributions to characterise domains, thereby achieving domain invariance. In our findings, risk distributions effectively highlight differences between training…

Machine Learning · Computer Science 2023-10-31 Toan Nguyen , Kien Do , Bao Duong , Thin Nguyen

We are concerned with a worst-case scenario in model generalization, in the sense that a model aims to perform well on many unseen domains while there is only one single domain available for training. We propose a new method named…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Fengchun Qiao , Long Zhao , Xi Peng

Data augmentation is one of the most effective techniques to improve the generalization performance of deep neural networks. Yet, despite often facing limited data availability in medical image analysis, it is frequently underutilized. This…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Adam Tupper , Christian Gagné

Data augmentation has emerged as a powerful technique for improving the performance of deep neural networks and led to state-of-the-art results in computer vision. However, state-of-the-art data augmentation strongly distorts training…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Amil Merchant , Barret Zoph , Ekin Dogus Cubuk

Data augmentation is a popular technique largely used to enhance the training of convolutional neural networks. Although many of its benefits are well known by deep learning researchers and practitioners, its implicit regularization…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Alex Hernández-García , Peter König