English
Related papers

Related papers: Learning to Learn Domain-invariant Parameters for …

200 papers

Deep neural networks suffer from significant performance deterioration when there exists distribution shift between deployment and training. Domain Generalization (DG) aims to safely transfer a model to unseen target domains by only relying…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xin Zhang , Ying-Cong Chen

In this paper, we consider domain-invariant deep learning by explicitly modeling domain shifts with only a small amount of domain-specific parameters in a Convolutional Neural Network (CNN). By exploiting the observation that a…

Machine Learning · Computer Science 2020-09-30 Ze Wang , Xiuyuan Cheng , Guillermo Sapiro , Qiang Qiu

Though convolutional neural networks are widely used in different tasks, lack of generalization capability in the absence of sufficient and representative data is one of the challenges that hinder their practical application. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Yufei Wang , Haoliang Li , Lap-pui Chau , Alex C. Kot

Domain generalization methods aim to learn models robust to domain shift with data from a limited number of source domains and without access to target domain samples during training. Popular domain alignment methods for domain…

Machine Learning · Computer Science 2022-06-17 Wenyu Zhang , Mohamed Ragab , Chuan-Sheng Foo

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

Machine Learning · Computer Science 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

This paper focuses on domain generalization (DG), the task of learning from multiple source domains a model that generalizes well to unseen domains. A main challenge for DG is that the available source domains often exhibit limited…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

A fundamental challenge for machine learning models is generalizing to out-of-distribution (OOD) data, in part due to spurious correlations. To tackle this challenge, we first formalize the OOD generalization problem as constrained…

Machine Learning · Computer Science 2022-10-20 Hanlin Zhang , Yi-Fan Zhang , Weiyang Liu , Adrian Weller , Bernhard Schölkopf , Eric P. Xing

When domains, which represent underlying data distributions, vary during training and testing processes, deep neural networks suffer a drop in their performance. Domain generalization allows improvements in the generalization performance…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Toshihiko Matsuura , Tatsuya Harada

In this paper we propose a sequential learning framework for Domain Generalization (DG), the problem of training a model that is robust to domain shift by design. Various DG approaches have been proposed with different motivating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy Hospedales

The performance of existing underwater object detection methods degrades seriously when facing domain shift caused by complicated underwater environments. Due to the limitation of the number of domains in the dataset, deep detectors easily…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Yang Chen , Pinhao Song , Hong Liu , Linhui Dai , Xiaochuan Zhang , Runwei Ding , Shengquan Li

Domain Generalization (DG) aims to enhance model robustness in unseen or distributionally shifted target domains through training exclusively on source domains. Although existing DG techniques, such as data manipulation, learning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hai Huang , Yan Xia , Sashuai Zhou , Hanting Wang , Shulei Wang , Zhou Zhao

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

Machine Learning · Computer Science 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

We introduce Domain-specific Masks for Generalization, a model for improving both in-domain and out-of-domain generalization performance. For domain generalization, the goal is to learn from a set of source domains to produce a single model…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Prithvijit Chattopadhyay , Yogesh Balaji , Judy Hoffman

Machine learning models are intrinsically vulnerable to domain shift between training and testing data, resulting in poor performance in novel domains. Domain generalization (DG) aims to overcome the problem by leveraging multiple source…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Tingwei Wang , Da Li , Kaiyang Zhou , Tao Xiang , Yi-Zhe Song

Current state-of-the-art self-supervised approaches, are effective when trained on individual domains but show limited generalization on unseen domains. We observe that these models poorly generalize even when trained on a mixture of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Neha Kalibhat , Sam Sharpe , Jeremy Goodsitt , Bayan Bruss , Soheil Feizi

Domain adaptation (DA) benefits from the rigorous theoretical works that study its insightful characteristics and various aspects, e.g., learning domain-invariant representations and its trade-off. However, it seems not the case for the…

Machine Learning · Computer Science 2023-11-07 Trung Phung , Trung Le , Long Vuong , Toan Tran , Anh Tran , Hung Bui , Dinh Phung

Humans have the ability to accumulate knowledge of new tasks in varying conditions, but deep neural networks often suffer from catastrophic forgetting of previously learned knowledge after learning a new task. Many recent methods focus on…

Domain generalization (DG) aims to help models trained on a set of source domains generalize better on unseen target domains. The performances of current DG methods largely rely on sufficient labeled data, which are usually costly or…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Xingxuan Zhang , Linjun Zhou , Renzhe Xu , Peng Cui , Zheyan Shen , Haoxin Liu

Improving the generalization ability of Deep Neural Networks (DNNs) is critical for their practical uses, which has been a longstanding challenge. Some theoretical studies have uncovered that DNNs have preferences for some frequency…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Shiqi Lin , Zhizheng Zhang , Zhipeng Huang , Yan Lu , Cuiling Lan , Peng Chu , Quanzeng You , Jiang Wang , Zicheng Liu , Amey Parulkar , Viraj Navkal , Zhibo Chen

Deep neural networks (DNNs) have revolutionized artificial intelligence but often lack performance when faced with out-of-distribution (OOD) data, a common scenario due to the inevitable domain shifts in real-world applications. This…

Machine Learning · Computer Science 2024-08-23 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt