English
Related papers

Related papers: Bi-Level Optimization for Single Domain Generaliza…

200 papers

With the increasing utilization of deep learning in outdoor settings, its robustness needs to be enhanced to preserve accuracy in the face of distribution shifts, such as compression artifacts. Data augmentation is a widely used technique…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Shohei Enomoto , Monikka Roslianna Busto , Takeharu Eda

In this paper, we propose the Bi-Sub-Gradient (Bi-SG) method, which is a generalization of the classical sub-gradient method to the setting of convex bi-level optimization problems. This is a first-order method that is very easy to…

Optimization and Control · Mathematics 2023-07-18 Roey Merchav , Shoham Sabach

Ideally, visual learning algorithms should be generalizable, for dealing with any unseen domain shift when deployed in a new target environment; and data-efficient, for reducing development costs by using as little labels as possible. To…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Kaiyang Zhou , Chen Change Loy , Ziwei Liu

Generalising deep models to new data from new centres (termed here domains) remains a challenge. This is largely attributed to shifts in data statistics (domain shifts) between source and unseen domains. Recently, gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xiao Liu , Spyridon Thermos , Alison O'Neil , Sotirios A. Tsaftaris

Unsupervised sim-to-real domain adaptation (UDA) for semantic segmentation aims to improve the real-world test performance of a model trained on simulated data. It can save the cost of manually labeling data in real-world applications such…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Rui Gong , Qin Wang , Dengxin Dai , Luc Van Gool

To generalize the model trained in source domains to unseen target domains, domain generalization (DG) has recently attracted lots of attention. Since target domains can not be involved in training, overfitting source domains is inevitable.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks. However, in many applications, it is prohibitively expensive and time-consuming to obtain large quantities of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Sicheng Zhao , Xiangyu Yue , Shanghang Zhang , Bo Li , Han Zhao , Bichen Wu , Ravi Krishna , Joseph E. Gonzalez , Alberto L. Sangiovanni-Vincentelli , Sanjit A. Seshia , Kurt Keutzer

Deep learning approaches for semantic segmentation rely primarily on supervised learning approaches and require substantial efforts in producing pixel-level annotations. Further, such approaches may perform poorly when applied to unseen…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Ying Chen , Xu Ouyang , Kaiyue Zhu , Gady Agam

Diffusion models, which iteratively denoise data samples to synthesize high-quality outputs, have achieved empirical success across domains. However, optimizing these models for downstream tasks often involves nested bilevel structures,…

Machine Learning · Computer Science 2025-08-06 Quan Xiao , Hui Yuan , A F M Saif , Gaowen Liu , Ramana Kompella , Mengdi Wang , Tianyi Chen

Unsupervised domain adaptation facilitates the unlabeled target domain relying on well-established source domain information. The conventional methods forcefully reducing the domain discrepancy in the latent space will result in the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Guanglei Yang , Haifeng Xia , Mingli Ding , Zhengming Ding

Current state-of-the-art self-supervised approaches, are effective when trained on individual domains but show limited generalization on unseen domains. We observe that these models poorly generalize even when trained on a mixture of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Neha Kalibhat , Sam Sharpe , Jeremy Goodsitt , Bayan Bruss , Soheil Feizi

Accurate segmentation of brain tumors from multi-modal Magnetic Resonance (MR) images is essential in brain tumor diagnosis and treatment. However, due to the existence of domain shifts among different modalities, the performance of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Kelei He , Wen Ji , Tao Zhou , Zhuoyuan Li , Jing Huo , Xin Zhang , Yang Gao , Dinggang Shen , Bing Zhang , Junfeng Zhang

Domain adaptation seeks to leverage the abundant label information in a source domain to improve classification performance in a target domain with limited labels. While the field has seen extensive methodological development, its…

Machine Learning · Statistics 2025-07-31 Elif Vural , Huseyin Karaca

Domain generalization (DG) methods aim to develop models that generalize to settings where the test distribution is different from the training data. In this paper, we focus on the challenging problem of multi-source zero shot DG (MDG),…

Machine Learning · Computer Science 2022-11-07 Kowshik Thopalli , Sameeksha Katoch , Pavan Turaga , Jayaraman J. Thiagarajan

Domain generalization (DG) aims to help models trained on a set of source domains generalize better on unseen target domains. The performances of current DG methods largely rely on sufficient labeled data, which are usually costly or…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Xingxuan Zhang , Linjun Zhou , Renzhe Xu , Peng Cui , Zheyan Shen , Haoxin Liu

Deep learning based task systems normally rely on a large amount of manually labeled training data, which is expensive to obtain and subject to operator variations. Moreover, it does not always hold that the manually labeled data and the…

Machine Learning · Computer Science 2019-07-25 Jun Chen , Heye Zhang , Yanping Zhang , Shu Zhao , Raad Mohiaddin , Tom Wong , David Firmin , Guang Yang , Jennifer Keegan

Machine learning models are intrinsically vulnerable to domain shift between training and testing data, resulting in poor performance in novel domains. Domain generalization (DG) aims to overcome the problem by leveraging multiple source…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Tingwei Wang , Da Li , Kaiyang Zhou , Tao Xiang , Yi-Zhe Song

Domain adaptation for semantic image segmentation is very necessary since manually labeling large datasets with pixel-level labels is expensive and time consuming. Existing domain adaptation techniques either work on limited datasets, or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Yunsheng Li , Lu Yuan , Nuno Vasconcelos

Although Domain Generalization (DG) problem has been fast-growing in the 2D image tasks, its exploration on 3D point cloud data is still insufficient and challenged by more complex and uncertain cross-domain variances with uneven…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Siyuan Huang , Bo Zhang , Botian Shi , Peng Gao , Yikang Li , Hongsheng Li

In recent years, a variety of gradient-based first-order methods have been developed to solve bi-level optimization problems for learning applications. However, theoretical guarantees of these existing approaches heavily rely on the…

Machine Learning · Computer Science 2020-07-03 Risheng Liu , Pan Mu , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang