English
Related papers

Related papers: Gradient-Guided Annealing for Domain Generalizatio…

200 papers

Deep learning has made significant advancements in supervised learning. However, models trained in this setting often face challenges due to domain shift between training and test sets, resulting in a significant drop in performance during…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Lei Qi , Hongpeng Yang , Yinghuan Shi , Xin Geng

While deep generative models (DGMs) have gained popularity, their susceptibility to biases and other inefficiencies that lead to undesirable outcomes remains an issue. With their growing complexity, there is a critical need for early…

Machine Learning · Computer Science 2024-12-18 Vidya Prasad , Anna Vilanova , Nicola Pezzotti

Unsupervised domain adaptation (UDA) and domain generalization (DG) enable machine learning models trained on a source domain to perform well on unlabeled or even unseen target domains. As previous UDA&DG semantic segmentation methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Lukas Hoyer , Dengxin Dai , Luc Van Gool

Generalization of neural networks is crucial for deploying them safely in the real world. Common training strategies to improve generalization involve the use of data augmentations, ensembling and model averaging. In this work, we first…

Machine Learning · Computer Science 2023-06-13 Samyak Jain , Sravanti Addepalli , Pawan Sahu , Priyam Dey , R. Venkatesh Babu

Domain generalization (DG) seeks to learn robust models that generalize well under unknown distribution shifts. As a critical aspect of DG, optimizer selection has not been explored in depth. Currently, most DG methods follow the widely…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Xingxuan Zhang , Renzhe Xu , Han Yu , Yancheng Dong , Pengfei Tian , Peng Cu

Computer vision has flourished in recent years thanks to Deep Learning advancements, fast and scalable hardware solutions and large availability of structured image data. Convolutional Neural Networks trained on supervised tasks with…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Antono D'Innocente

Adversarial training is an effective approach to make deep neural networks robust against adversarial attacks. Recently, different adversarial training defenses are proposed that not only maintain a high clean accuracy but also show…

Machine Learning · Computer Science 2023-01-02 Muzammal Naseer , Salman Khan , Fatih Porikli , Fahad Shahbaz Khan

Domain generalization (DG) intends to train a model on multiple source domains to ensure that it can generalize well to an arbitrary unseen target domain. The acquisition of domain-invariant representations is pivotal for DG as they possess…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Na Wang , Lei Qi , Jintao Guo , Yinghuan Shi , Yang Gao

Generative Adversarial Networks (GANs) have shown remarkable results in modeling complex distributions, but their evaluation remains an unsettled issue. Evaluations are essential for: (i) relative assessment of different models and (ii)…

Domain generalization (DG) aims to train a model to perform well in unseen domains under different distributions. This paper considers a more realistic yet more challenging scenario,namely Single Domain Generalization (Single-DG), where…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Jiajin Zhang , Hanqing Chao , Amit Dhurandhar , Pin-Yu Chen , Ali Tajer , Yangyang Xu , Pingkun Yan

Standard domain adaptation methods do not work well when a large gap exists between the source and target domains. Gradual domain adaptation is one of the approaches used to address the problem. It involves leveraging the intermediate…

Machine Learning · Statistics 2024-01-24 Shogo Sagawa , Hideitsu Hino

Learning domain-invariant representation is a dominant approach for domain generalization (DG), where we need to build a classifier that is robust toward domain shifts. However, previous domain-invariance-based methods overlooked the…

Machine Learning · Computer Science 2020-03-03 Kei Akuzawa , Yusuke Iwasawa , Yutaka Matsuo

Semantic segmentation algorithms require access to well-annotated datasets captured under diverse illumination conditions to ensure consistent performance. However, poor visibility conditions at varying illumination conditions result in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Pranjay Shyam , Antyanta Bangunharcana , Kuk-Jin Yoon , Kyung-Soo Kim

We introduce Gradient Agreement Filtering (GAF) to improve on gradient averaging in distributed deep learning optimization. Traditional distributed data-parallel stochastic gradient descent involves averaging gradients of microbatches to…

Machine Learning · Computer Science 2024-12-31 Francois Chaubard , Duncan Eddy , Mykel J. Kochenderfer

Domain generalization (DG) aims to tackle the distribution shift between training domains and unknown target domains. Generating new domains is one of the most effective approaches, yet its performance gain depends on the distribution…

Machine Learning · Computer Science 2023-05-17 Rui Dai , Yonggang Zhang , Zhen Fang , Bo Han , Xinmei Tian

Domain generalization (DG), aiming at models able to work on multiple unseen domains, is a must-have characteristic of general artificial intelligence. DG based on single source domain training data is more challenging due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Qingyue Yang , Hongjing Niu , Pengfei Xia , Wei Zhang , Bin Li

Existing machine learning literature lacks graph-based domain adaptation techniques capable of handling large distribution shifts, primarily due to the difficulty in simulating a coherent evolutionary path from source to target graph. To…

Machine Learning · Computer Science 2026-05-14 Pui Ieng Lei , Ximing Chen , Yijun Sheng , Yanyan Liu , Zhiguo Gong , Qiang Yang

Domain generalization refers to the problem where we aim to train a model on data from a set of source domains so that the model can generalize to unseen target domains. Naively training a model on the aggregate set of data (pooled from all…

Machine Learning · Computer Science 2022-02-16 A. Tuan Nguyen , Toan Tran , Yarin Gal , Atılım Güneş Baydin

Fine-grained domain generalization (FGDG) is a more challenging task than traditional DG tasks due to its small inter-class variations and relatively large intra-class disparities. When domain distribution changes, the vulnerability of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Wenlong Yu , Dongyue Chen , Qilong Wang , Qinghua Hu

The main challenge in domain generalization (DG) is to handle the distribution shift problem that lies between the training and test data. Recent studies suggest that test-time training (TTT), which adapts the learned model with test data,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Liang Chen , Yong Zhang , Yibing Song , Ying Shan , Lingqiao Liu