English
Related papers

Related papers: Domain Generalization using Pretrained Models with…

200 papers

This paper strives for domain generalization, where models are trained exclusively on source domains before being deployed on unseen target domains. We follow the strict separation of source training and target testing, but exploit the…

Machine Learning · Computer Science 2024-07-02 Sameer Ambekar , Zehao Xiao , Jiayi Shen , Xiantong Zhen , Cees G. M. Snoek

Open Domain Generalization (ODG) is a challenging task as it not only deals with distribution shifts but also category shifts between the source and target datasets. To handle this task, the model has to learn a generalizable representation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Inseop Chung , KiYoon Yoo , Nojun Kwak

The problem of domain generalization is to take knowledge acquired from a number of related domains where training data is available, and to then successfully apply it to previously unseen domains. We propose a new feature learning…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Muhammad Ghifary , W. Bastiaan Kleijn , Mengjie Zhang , David Balduzzi

A dominant approach for addressing unsupervised domain adaptation is to map data points for the source and the target domains into an embedding space which is modeled as the output-space of a shared deep encoder. The encoder is trained to…

Machine Learning · Computer Science 2022-09-30 Mohammad Rostami

The annotation scarcity of medical image segmentation poses challenges in collecting sufficient training data for deep learning models. Specifically, models trained on limited data may not generalize well to other unseen data domains,…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Heng Li , Haojin Li , Wei Zhao , Huazhu Fu , Xiuyun Su , Yan Hu , Jiang Liu

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

Finetuning is a common practice widespread across different communities to adapt pretrained models to particular tasks. Text classification is one of these tasks for which many pretrained models are available. On the other hand, ensembles…

Computation and Language · Computer Science 2024-10-29 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

Federated domain generalization (FedDG) aims to improve the global model generalization in unseen domains by addressing data heterogeneity under privacy-preserving constraints. A common strategy in existing FedDG studies involves sharing…

Artificial Intelligence · Computer Science 2024-11-18 Shuai Gong , Chaoran Cui , Chunyun Zhang , Wenna Wang , Xiushan Nie , Lei Zhu

We propose $\textbf{UniDG}$, a novel and $\textbf{Uni}$fied framework for $\textbf{D}$omain $\textbf{G}$eneralization that is capable of significantly enhancing the out-of-distribution generalization performance of foundation models…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yiyuan Zhang , Kaixiong Gong , Xiaohan Ding , Kaipeng Zhang , Fangrui Lv , Kurt Keutzer , Xiangyu Yue

A pretrain-finetune strategy is widely used to reduce the overfitting that can occur when data is insufficient for CNN training. First few layers of a CNN pretrained on a large-scale RGB dataset are capable of acquiring general image…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Hyungtae Lee , Sungmin Eum , Heesung Kwon

Fine-grained domain generalization (FGDG) is a more challenging task than traditional DG tasks due to its small inter-class variations and relatively large intra-class disparities. When domain distribution changes, the vulnerability of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Wenlong Yu , Dongyue Chen , Qilong Wang , Qinghua Hu

Domain generalization requires identifying stable representations that support reliable classification across domains. Most existing methods seek such stability through improving the training process, for example, through model selection…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Dat Nguyen , Duc-Duy Nguyen

In many deployed systems (multilingual ASR, cross-hospital imaging, region-specific perception), multiple pretrained specialist models coexist. Yet, new target domains often require domain expansion: a generalized model that performs well…

Machine Learning · Computer Science 2026-01-30 Jong-Ik Park , Shreyas Chaudhari , Srinivasa Pranav , Carlee Joe-Wong , José M. F. Moura

Due to the scarcity of publicly available diarization data, the model performance can be improved by training a single model with data from different domains. In this work, we propose to incorporate domain information to train a single…

Sound · Computer Science 2023-12-13 Ivan Fung , Lahiru Samarakoon , Samuel J. Broughton

We consider unsupervised domain adaptation: given labelled examples from a source domain and unlabelled examples from a related target domain, the goal is to infer the labels of target examples. Under the assumption that features from…

Machine Learning · Statistics 2019-01-08 Jeroen Manders , Twan van Laarhoven , Elena Marchiori

In this paper, we introduce Active Learning framework in Federated Learning for Target Domain Generalisation, harnessing the strength from both learning paradigms. Our framework, FEDALV, composed of Active Learning (AL) and Federated Domain…

Machine Learning · Computer Science 2023-12-06 Razvan Caramalau , Binod Bhattarai , Danail Stoyanov

Domain generalization (DG) aims to avoid the performance degradation of the model when the distribution shift between the limited training data and unseen test data occurs. Recently, foundation models with enormous parameters have been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiajun Hu , Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Federated learning (FL) is emerging as a promising technique for collaborative learning without local data leaving their devices. However, clients' data originating from diverse domains may degrade model performance due to domain shifts,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zheng Wang , Zihui Wang , Zheng Wang , Xiaoliang Fan , Cheng Wang

We introduce an unsupervised domain adaption (UDA) strategy that combines multiple image translations, ensemble learning and self-supervised learning in one coherent approach. We focus on one of the standard tasks of UDA in which a semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Fabrizio J. Piva , Gijs Dubbelman

Domain Generalized Semantic Segmentation (DGSS) is a critical yet challenging task, as domain shifts in unseen environments can severely compromise model performance. While recent studies enhance feature alignment by projecting features…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 I-Hsiang Chen , Hua-En Chang , Wei-Ting Chen , Jenq-Neng Hwang , Sy-Yen Kuo