English
Related papers

Related papers: Bi-Level Optimization for Single Domain Generaliza…

200 papers

Domain generalization aims to address the domain shift between training and testing data. To learn the domain invariant representations, the model is usually trained on multiple domains. It has been found that the gradients of network…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Jiaqi Xu , Yuwang Wang , Xuejin Chen

Existing Source-free Unsupervised Domain Adaptation (SUDA) approaches inherently exhibit catastrophic forgetting. Typically, models trained on a labeled source domain and adapted to unlabeled target data improve performance on the target…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Waqar Ahmed , Pietro Morerio , Vittorio Murino

Single domain generalization aims to learn a model from a single training domain (source domain) and apply it to multiple unseen test domains (target domains). Existing methods focus on expanding the distribution of the training domain to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jin Chen , Zhi Gao , Xinxiao Wu , Jiebo Luo

Fine-tuning pretrained models is a common practice in domain generalization (DG) tasks. However, fine-tuning is usually computationally expensive due to the ever-growing size of pretrained models. More importantly, it may cause over-fitting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Ziyue Li , Kan Ren , Xinyang Jiang , Bo Li , Haipeng Zhang , Dongsheng Li

Scene Graph Generation (SGG) remains a challenging task due to its compositional property. Previous approaches improve prediction efficiency through end-to-end learning. However, these methods exhibit limited performance as they assume…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Peng Hao , Weilong Wang , Xiaobing Wang , Yingying Jiang , Hanchao Jia , Shaowei Cui , Junhang Wei , Xiaoshuai Hao

Training a single model on multiple input domains and/or output tasks allows for compressing information from multiple sources into a unified backbone hence improves model efficiency. It also enables potential positive knowledge transfer…

Machine Learning · Computer Science 2023-10-16 Amelie Royer , Tijmen Blankevoort , Babak Ehteshami Bejnordi

Unsupervised domain adaptation aims to address the problem of classifying unlabeled samples from the target domain whilst labeled samples are only available from the source domain and the data distributions are different in these two…

Machine Learning · Computer Science 2019-11-20 Qian Wang , Toby P. Breckon

While domain adaptation has been actively researched in recent years, most theoretical results and algorithms focus on the single-source-single-target adaptation setting. Naive application of such algorithms on multiple source domain…

Machine Learning · Computer Science 2017-10-31 Han Zhao , Shanghang Zhang , Guanhang Wu , João P. Costeira , José M. F. Moura , Geoffrey J. Gordon

Domain adaptation has been a fundamental technology for transferring knowledge from a source domain to a target domain. The key issue of domain adaptation is how to reduce the distribution discrepancy between two domains in a proper way…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Lei Tian , Yongqiang Tang , Liangchen Hu , Zhida Ren , Wensheng Zhang

Semi-Supervised Domain Adaptation (SSDA) leverages knowledge from a fully labeled source domain to classify data in a partially labeled target domain. Due to the limited number of labeled samples in the target domain, there can be intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yuting Hong , Li Dong , Xiaojie Qiu , Hui Xiao , Baochen Yao , Siming Zheng , Chengbin Peng

Domain generalization typically requires data from multiple source domains for model learning. However, such strong assumption may not always hold in practice, especially in medical field where the data sharing is highly concerned and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Quande Liu , Cheng Chen , Qi Dou , Pheng-Ann Heng

We tackle the general differentiable meta learning problem that is ubiquitous in modern deep learning, including hyperparameter optimization, loss function learning, few-shot learning, invariance learning and more. These problems are often…

Machine Learning · Computer Science 2024-10-15 Minyoung Kim , Timothy M. Hospedales

Domain generalization (DG) is proposed to deal with the issue of domain shift, which occurs when statistical differences exist between source and target domains. However, most current methods do not account for a common realistic scenario…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xiran Wang , Jian Zhang , Lei Qi , Yinghuan Shi

Conditional stochastic optimization covers a variety of applications ranging from invariant learning and causal inference to meta-learning. However, constructing unbiased gradient estimators for such problems is challenging due to the…

Optimization and Control · Mathematics 2024-06-04 Yifan Hu , Siqi Zhang , Xin Chen , Niao He

The phenomenon of data distribution evolving over time has been observed in a range of applications, calling the needs of adaptive learning algorithms. We thus study the problem of supervised gradual domain adaptation, where labeled data…

Machine Learning · Computer Science 2022-11-15 Jing Dong , Shiji Zhou , Baoxiang Wang , Han Zhao

Gradient methods have become mainstream techniques for Bi-Level Optimization (BLO) in learning and vision fields. The validity of existing works heavily relies on solving a series of approximation subproblems with extraordinarily high…

Optimization and Control · Mathematics 2022-05-23 Risheng Liu , Xuan Liu , Wei Yao , Shangzhi Zeng , Jin Zhang

Unsupervised domain adaptation aims to learn a model of classifier for unlabeled samples on the target domain, given training data of labeled samples on the source domain. Impressive progress is made recently by learning invariant features…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Yabin Zhang , Hui Tang , Kui Jia , Mingkui Tan

Contemporary domain adaptive semantic segmentation aims to address data annotation challenges by assuming that target domains are completely unannotated. However, annotating a few target samples is usually very manageable and worthwhile…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Jiaxing Huang , Dayan Guan , Aoran Xiao , Shijian Lu

Deep networks trained on the source domain show degraded performance when tested on unseen target domain data. To enhance the model's generalization ability, most existing domain generalization methods learn domain invariant features by…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Liwei Yang , Xiang Gu , Jian Sun

Recent metric-based meta-learning approaches, which learn a metric space that generalizes well over combinatorial number of different classification tasks sampled from a task distribution, have been shown to be effective for few-shot…

Machine Learning · Computer Science 2019-08-06 Hayeon Lee , Donghyun Na , Hae Beom Lee , Sung Ju Hwang