English
Related papers

Related papers: Preserving Silent Features for Domain Generalizati…

200 papers

Despite impressive progress in deep learning, generalizing far beyond the training distribution is an important open challenge. In this work, we consider few-shot classification, and aim to shed light on what makes some novel classes easier…

Machine Learning · Computer Science 2022-05-31 Mengye Ren , Eleni Triantafillou , Kuan-Chieh Wang , James Lucas , Jake Snell , Xaq Pitkow , Andreas S. Tolias , Richard Zemel

Self-training (ST) is a simple yet effective semi-supervised learning method. However, why and how ST improves generalization performance by using potentially erroneous pseudo-labels is still not well understood. To deepen the understanding…

Machine Learning · Statistics 2024-05-08 Takashi Takahashi

Domain generalization involves learning a classifier from a heterogeneous collection of training sources such that it generalizes to data drawn from similar unknown target domains, with applications in large-scale learning and personalized…

Machine Learning · Computer Science 2021-12-24 Xavier Thomas , Dhruv Mahajan , Alex Pentland , Abhimanyu Dubey

Domain adaptation, a pivotal branch of transfer learning, aims to enhance the performance of machine learning models when deployed in target domains with distinct data distributions. This is particularly critical for object detection tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Helia Mohamadi , Mohammad Ali Keyvanrad , Mohammad Reza Mohammadi

Self-supervised learning (SSL) has become the de facto training paradigm of large models, where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Despite demonstrating comparable performance with…

Machine Learning · Computer Science 2024-06-05 Sofia Yfantidou , Dimitris Spathis , Marios Constantinides , Athena Vakali , Daniele Quercia , Fahim Kawsar

An organ segmentation method that can generalize to unseen contrasts and scanner settings can significantly reduce the need for retraining of deep learning models. Domain Generalization (DG) aims to achieve this goal. However, most DG…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Yanwu Xu , Shaoan Xie , Maxwell Reynolds , Matthew Ragoza , Mingming Gong , Kayhan Batmanghelich

Domain adaptation (DA) mitigates the domain shift problem when transferring knowledge from one annotated domain to another similar but different unlabeled domain. However, existing models often utilize one of the ImageNet models as the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Youshan Zhang , Brian D. Davison

Single domain generalization (SDG) aims to train a robust model against unknown target domain shifts using data from a single source domain. Data augmentation has been proven an effective approach to SDG. However, the utility of standard…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Guangtao Zheng , Mengdi Huai , Aidong Zhang

Existing domain generalization aims to learn a generalizable model to perform well even on unseen domains. For many real-world machine learning applications, the data distribution often shifts gradually along domain indices. For example, a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Qiuhao Zeng , Wei Wang , Fan Zhou , Charles Ling , Boyu Wang

Face anti-spoofing (FAS) based on domain generalization (DG) has been recently studied to improve the generalization on unseen scenarios. Previous methods typically rely on domain labels to align the distribution of each domain for learning…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Qianyu Zhou , Ke-Yue Zhang , Taiping Yao , Xuequan Lu , Ran Yi , Shouhong Ding , Lizhuang Ma

Unsupervised Domain Adaptation (UDA) aims to align source and target domain distributions to close the domain gap, but still struggles with obtaining the target data. Fortunately, Domain Generalization (DG) excels without the need for any…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Binbin Wei , Yuhang Zhang , Shishun Tian , Muxin Liao , Wei Li , Wenbin Zou

Recognition across domains has recently become an active topic in the research community. However, it has been largely overlooked in the problem of recognition in new unseen domains. Under this condition, the delivered deep network models…

Computer Vision and Pattern Recognition · Computer Science 2020-04-15 Thanh-Dat Truong , Chi Nhan Duong , Khoa Luu , Minh-Triet Tran , Ngan Le

Deep neural networks suffer from significant performance deterioration when there exists distribution shift between deployment and training. Domain Generalization (DG) aims to safely transfer a model to unseen target domains by only relying…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xin Zhang , Ying-Cong Chen

Despite great progress in supervised semantic segmentation,a large performance drop is usually observed when deploying the model in the wild. Domain adaptation methods tackle the issue by aligning the source domain and the target domain.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Haoran Wang , Tong Shen , Wei Zhang , Lingyu Duan , Tao Mei

Domain generalization (DG) aims to enhance the ability of models trained on source domains to generalize effectively to unseen domains. Recently, Sharpness-Aware Minimization (SAM) has shown promise in this area by reducing the sharpness of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Ziyang Chen , Yiwen Ye , Feilong Tang , Yongsheng Pan , Yong Xia

Training and fine-tuning deep learning models, especially large language models (LLMs), on limited and imbalanced datasets poses substantial challenges. These issues often result in poor generalization, where models overfit to dominant…

Computation and Language · Computer Science 2025-01-14 Ashok Choudhary , Cornelius Thiels , Hojjat Salehinejad

Standard supervised learning setting assumes that training data and test data come from the same distribution (domain). Domain generalization (DG) methods try to learn a model that when trained on data from multiple domains, would…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Udit Maniyar , Joseph K J , Aniket Anand Deshmukh , Urun Dogan , Vineeth N Balasubramanian

Domain generalization (DG) focuses on transferring domain-invariant knowledge from multiple source domains (available at train time) to an, a priori, unseen target domain(s). This requires a class to be expressed in multiple domains for the…

Machine Learning · Computer Science 2023-06-02 Kimathi Kaai , Saad Hossain , Sirisha Rambhatla

Large-scale foundation models, such as CLIP, have demonstrated impressive zero-shot generalization performance on downstream tasks, leveraging well-designed language prompts. However, these prompt learning techniques often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Shirsha Bose , Ankit Jha , Enrico Fini , Mainak Singha , Elisa Ricci , Biplab Banerjee

The topic of generalizing machine learning models learned on a collection of source domains to unknown target domains is challenging. While many domain generalization (DG) methods have achieved promising results, they primarily rely on the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Xingchen Zhao , Chang Liu , Anthony Sicilia , Seong Jae Hwang , Yun Fu