English
Related papers

Related papers: Moment Alignment: Unifying Gradient and Hessian Ma…

200 papers

The single domain generalization(SDG) based on meta-learning has emerged as an effective technique for solving the domain-shift problem. However, the inadequate match of data distribution between source and augmented domains and difficult…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Can Sun , Hao Zheng , Zhigang Hu , Liu Yang , Meiguang Zheng , Bo Xu

The generalization of deep neural networks to unknown domains is a major challenge despite their tremendous progress in recent years. For this reason, the dynamic area of domain generalization (DG) has emerged. In contrast to unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Manuel Schwonberg , Hanno Gottschalk

Domain adaptation (DA) paves the way for label annotation and dataset bias issues by the knowledge transfer from a label-rich source domain to a related but unlabeled target domain. A mainstream of DA methods is to align the feature…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Shuang Li , Mixue Xie , Fangrui Lv , Chi Harold Liu , Jian Liang , Chen Qin , Wei Li

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang

Object counting models suffer when deployed across domains with differing density variety, since density shifts are inherently task-relevant and violate standard domain adaptation assumptions. To address this, we propose a theoretical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Zhuonan Liang , Dongnan Liu , Jianan Fan , Yaxuan Song , Qiang Qu , Runnan Chen , Yu Yao , Peng Fu , Weidong Cai

In open-world scenarios, where both novel classes and domains may exist, an ideal segmentation model should detect anomaly classes for safety and generalize to new domains. However, existing methods often struggle to distinguish between…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Zhitong Gao , Bingnan Li , Mathieu Salzmann , Xuming He

Domain generalization (DG) intends to train a model on multiple source domains to ensure that it can generalize well to an arbitrary unseen target domain. The acquisition of domain-invariant representations is pivotal for DG as they possess…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Na Wang , Lei Qi , Jintao Guo , Yinghuan Shi , Yang Gao

The composition of training data mixtures is critical for effectively training large language models (LLMs), as it directly impacts their performance on downstream tasks. Our goal is to identify an optimal data mixture to specialize an LLM…

Machine Learning · Computer Science 2024-10-04 Simin Fan , David Grangier , Pierre Ablin

Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution. While absent assumptions, domain adaptation is impossible, strict conditions, e.g.…

Machine Learning · Computer Science 2019-03-13 Yifan Wu , Ezra Winston , Divyansh Kaushik , Zachary Lipton

For domain generalization (DG) and unsupervised domain adaptation (UDA), cross domain feature alignment has been widely explored to pull the feature distributions of different domains in order to learn domain-invariant representations.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Xin Jin , Cuiling Lan , Wenjun Zeng , Zhibo Chen

Domain generalization (DG) is a difficult transfer learning problem aiming to learn a generalizable model for unseen domains. Recent foundation models (FMs) are robust to many distribution shifts and, therefore, should substantially improve…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Xin Zhang , Shixiang Shane Gu , Yutaka Matsuo , Yusuke Iwasawa

Existing domain generalization aims to learn a generalizable model to perform well even on unseen domains. For many real-world machine learning applications, the data distribution often shifts gradually along domain indices. For example, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Qiuhao Zeng , Wei Wang , Fan Zhou , Charles Ling , Boyu Wang

Generalizing knowledge to unseen domains, where data and labels are unavailable, is crucial for machine learning models. We tackle the domain generalization problem to learn from multiple source domains and generalize to a target domain…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Fan Zhou , Zhuqing Jiang , Changjian Shui , Boyu Wang , Brahim Chaib-draa

Feature alignment between domains is one of the mainstream methods for Unsupervised Domain Adaptation (UDA) semantic segmentation. Existing feature alignment methods for semantic segmentation learn domain-invariant features by adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Shuang Wang , Dong Zhao , Yi Li , Chi Zhang , Yuwei Guo , Qi Zang , Biao Hou , Licheng Jiao

Unsupervised domain adaptation aims to transfer the classifier learned from the source domain to the target domain in an unsupervised manner. With the help of target pseudo-labels, aligning class-level distributions and learning the…

Machine Learning · Computer Science 2019-06-11 Dong-Dong Chen , Yisen Wang , Jinfeng Yi , Zaiyi Chen , Zhi-Hua Zhou

Existing domain adaptation methods tend to treat every domain equally and align them all perfectly. Such uniform alignment ignores topological structures among different domains; therefore it may be beneficial for nearby domains, but not…

Machine Learning · Computer Science 2023-04-24 Zihao Xu , Hao He , Guang-He Lee , Yuyang Wang , Hao Wang

Domain generalizable model is attracting increasing attention in medical image analysis since data is commonly acquired from different institutes with various imaging protocols and scanners. To tackle this challenging domain generalization…

Image and Video Processing · Electrical Eng. & Systems 2021-09-21 Ran Gu , Jingyang Zhang , Rui Huang , Wenhui Lei , Guotai Wang , Shaoting Zhang

In this paper we propose a sequential learning framework for Domain Generalization (DG), the problem of training a model that is robust to domain shift by design. Various DG approaches have been proposed with different motivating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy Hospedales

Knowledge transfer from a source domain to a different but semantically related target domain has long been an important topic in the context of unsupervised domain adaptation (UDA). A key challenge in this field is establishing a metric…

Machine Learning · Computer Science 2020-07-21 Rongzhe Wei , Fa Zhang , Bo Dong , Qinghua Zheng

We address the problem of distribution shift in unsupervised domain adaptation with a moment-matching approach. Existing methods typically align low-order statistical moments of the source and target distributions in an embedding space…

Machine Learning · Computer Science 2025-10-17 Shayan Gharib , Marcelo Hartmann , Arto Klami