English
Related papers

Related papers: Domain Generalization using Pretrained Models with…

200 papers

Domain generalization aims to improve the generalization capability of machine learning systems to out-of-distribution (OOD) data. Existing domain generalization techniques embark upon stationary and discrete environments to tackle the…

Machine Learning · Computer Science 2022-06-17 Tiexin Qin , Shiqi Wang , Haoliang Li

In this paper, we tackle the problem of training with multiple source domains with the aim to generalize to new domains at test time without an adaptation step. This is known as domain generalization (DG). Previous works on DG assume…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Mohammad Mahfujur Rahman , Clinton Fookes , Sridha Sridharan

Although recent advances in machine learning have shown its success to learn from independent and identically distributed (IID) data, it is vulnerable to out-of-distribution (OOD) data in an open world. Domain generalization (DG) deals with…

Machine Learning · Computer Science 2024-05-14 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

Annotating medical imaging datasets is costly, so fine-tuning (or transfer learning) is the most effective method for digital pathology vision applications such as disease classification and semantic segmentation. However, due to texture…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Tushar Kataria , Beatrice Knudsen , Shireen Elhabian

While computer vision and machine learning have made great progress, their robustness is still challenged by two key issues: data distribution shift and label noise. When domain generalization (DG) encounters noise, noisy labels further…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Wang Lu , Jindong Wang

The generalization of deep neural networks to unknown domains is a major challenge despite their tremendous progress in recent years. For this reason, the dynamic area of domain generalization (DG) has emerged. In contrast to unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Manuel Schwonberg , Hanno Gottschalk

Large, pre-trained representation models trained using self-supervised learning have gained popularity in various fields of machine learning because they are able to extract high-quality salient features from input data. As such, they have…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-16 Hejung Yang , Hong-Goo Kang

Recent pretrained language models extend from millions to billions of parameters. Thus the need to fine-tune an extremely large pretrained model with a limited training corpus arises in various downstream tasks. In this paper, we propose a…

Computation and Language · Computer Science 2021-09-14 Runxin Xu , Fuli Luo , Zhiyuan Zhang , Chuanqi Tan , Baobao Chang , Songfang Huang , Fei Huang

We develop an algorithm for adapting a semantic segmentation model that is trained using a labeled source domain to generalize well in an unlabeled target domain. A similar problem has been studied extensively in the unsupervised domain…

Machine Learning · Computer Science 2021-01-12 Serban Stan , Mohammad Rostami

Domain Generalization (DG) aims to train models that can generalize to unseen testing domains by leveraging data from multiple training domains. However, traditional DG methods rely on the availability of multiple diverse training domains,…

Machine Learning · Computer Science 2025-03-11 Hao Yan , Marzi Heidari , Yuhong Guo

Efficiently utilizing rich knowledge in pretrained models has become a critical topic in the era of large models. This work focuses on adaptively utilizing knowledge from multiple source-pretrained models to an unlabeled target domain…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Xinyao Li , Jingjing Li , Fengling Li , Lei Zhu , Ke Lu

Distribution shift presents a significant challenge in machine learning, where models often underperform during the test stage when faced with a different distribution than the one they were trained on. This paper focuses on domain shifts,…

Machine Learning · Computer Science 2024-03-19 Huaxiu Yao , Xinyu Yang , Xinyi Pan , Shengchao Liu , Pang Wei Koh , Chelsea Finn

Pre-trained language models (PLMs) are widely used to derive semantic representations from item metadata in recommendation and search. In sequential recommendation, PLMs enhance ID-based embeddings through textual metadata, while in product…

Information Retrieval · Computer Science 2025-07-09 Matteo Attimonelli , Alessandro De Bellis , Claudio Pomo , Dietmar Jannach , Eugenio Di Sciascio , Tommaso Di Noia

Domain shift is a formidable issue in Machine Learning that causes a model to suffer from performance degradation when tested on unseen domains. Federated Domain Generalization (FedDG) attempts to train a global model using collaborative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Khiem Le , Long Ho , Cuong Do , Danh Le-Phuoc , Kok-Seng Wong

Deep neural networks often require copious amount of labeled-data to train their scads of parameters. Training larger and deeper networks is hard without appropriate regularization, particularly while using a small dataset. Laterally,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Xiang Xu , Xiong Zhou , Ragav Venkatesan , Gurumurthy Swaminathan , Orchid Majumder

Despite significant advances in deep learning, models often struggle to generalize well to new, unseen domains, especially when training data is limited. To address this challenge, we propose a novel approach for distribution-aware latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Ran Liu , Sahil Khose , Jingyun Xiao , Lakshmi Sathidevi , Keerthan Ramnath , Zsolt Kira , Eva L. Dyer

The single domain generalization(SDG) based on meta-learning has emerged as an effective technique for solving the domain-shift problem. However, the inadequate match of data distribution between source and augmented domains and difficult…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Can Sun , Hao Zheng , Zhigang Hu , Liu Yang , Meiguang Zheng , Bo Xu

The absence of well-structured large datasets in medical computer vision results in decreased performance of automated systems and, especially, of deep learning models. Domain generalization techniques aim to approach unknown domains from a…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Nikolaos Spanos , Anastasios Arsenos , Paraskevi-Antonia Theofilou , Paraskevi Tzouveli , Athanasios Voulodimos , Stefanos Kollias

Generalising deep models to new data from new centres (termed here domains) remains a challenge. This is largely attributed to shifts in data statistics (domain shifts) between source and unseen domains. Recently, gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xiao Liu , Spyridon Thermos , Alison O'Neil , Sotirios A. Tsaftaris

Face anti-spoofing approaches based on domain generalization (DG) have drawn growing attention due to their robustness for unseen scenarios. Previous methods treat each sample from multiple domains indiscriminately during the training…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Shubao Liu , Ke-Yue Zhang , Taiping Yao , Kekai Sheng , Shouhong Ding , Ying Tai , Jilin Li , Yuan Xie , Lizhuang Ma
‹ Prev 1 4 5 6 7 8 10 Next ›