English
Related papers

Related papers: Preserving Domain Generalization in Fine-Tuning vi…

200 papers

Recent advances in deep learning for medical image segmentation demonstrate expert-level accuracy. However, in clinically realistic environments, such methods have marginal performance due to differences in image domains, including…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Ling Zhang , Xiaosong Wang , Dong Yang , Thomas Sanford , Stephanie Harmon , Baris Turkbey , Holger Roth , Andriy Myronenko , Daguang Xu , Ziyue Xu

Domain generalization (DG) strives to address distribution shifts across diverse environments to enhance model's generalizability. Current DG approaches are confined to acquiring robust representations with continuous features, specifically…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Shaocong Long , Qianyu Zhou , Xikun Jiang , Chenhao Ying , Lizhuang Ma , Yuan Luo

Domain generalization (DG) aims to avoid the performance degradation of the model when the distribution shift between the limited training data and unseen test data occurs. Recently, foundation models with enormous parameters have been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiajun Hu , Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Preference tuning aligns pretrained language models to human judgments of quality, helpfulness, or safety by optimizing over explicit preference signals rather than likelihood alone. Prior work has shown that preference-tuning degrades…

Computation and Language · Computer Science 2026-01-12 Constantinos Karouzos , Xingwei Tan , Nikolaos Aletras

Domain generalization is a technique aimed at enabling models to maintain high accuracy when applied to new environments or datasets (unseen domains) that differ from the datasets used in training. Generally, the accuracy of models trained…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Reiji Saito , Kazuhiro Hotta

Few-shot semantic segmentation (FSS) has achieved great success on segmenting objects of novel classes, supported by only a few annotated samples. However, existing FSS methods often underperform in the presence of domain shifts, especially…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Jiapeng Su , Qi Fan , Guangming Lu , Fanglin Chen , Wenjie Pei

Open-set single-source domain generalization aims to use a single-source domain to learn a robust model that can be generalized to unknown target domains with both domain shifts and label shifts. The scarcity of the source domain and the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Pengkun Jiao , Na Zhao , Jingjing Chen , Yu-Gang Jiang

A practical limitation of deep neural networks is their high degree of specialization to a single task and visual domain. Recently, inspired by the successes of transfer learning, several authors have proposed to learn instead universal,…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Sylvestre-Alvise Rebuffi , Hakan Bilen , Andrea Vedaldi

Domain generalization (DG) aims to train a model to perform well in unseen domains under different distributions. This paper considers a more realistic yet more challenging scenario,namely Single Domain Generalization (Single-DG), where…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Jiajin Zhang , Hanqing Chao , Amit Dhurandhar , Pin-Yu Chen , Ali Tajer , Yangyang Xu , Pingkun Yan

To learn models or features that generalize across tasks and domains is one of the grand goals of machine learning. In this paper, we propose to use cross-domain, cross-task data as validation objective for hyper-parameter optimization…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Tonmoy Saikia , Thomas Brox , Cordelia Schmid

In this work, we propose to tackle the problem of domain generalization in the context of \textit{insufficient samples}. Instead of extracting latent feature embeddings based on deterministic models, we propose to learn a domain-invariant…

Machine Learning · Computer Science 2024-02-12 Kecheng Chen , Elena Gal , Hong Yan , Haoliang Li

Domain shift, characterized by degraded model performance during transition from labeled source domains to unlabeled target domains, poses a persistent challenge for deploying deep learning systems. Current unsupervised domain adaptation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Zhitong Cheng , Yiran Jiang , Yulong Ge , Yufeng Li , Zhongheng Qin , Rongzhi Lin , Jianwei Ma

In most practical applications such as recommendation systems, display advertising, and so forth, the collected data often contains missing values and those missing values are generally missing-not-at-random, which deteriorates the…

Machine Learning · Computer Science 2024-05-27 Mingming Ha , Xuewen Tao , Wenfang Lin , Qionxu Ma , Wujiang Xu , Linxun Chen

Domain generalization aims at training machine learning models to perform robustly across different and unseen domains. Several recent methods use multiple datasets to train models to extract domain-invariant features, hoping to generalize…

Machine Learning · Computer Science 2021-05-19 Mattia Segu , Alessio Tonioni , Federico Tombari

Foundation models and their checkpoints have significantly advanced deep learning, boosting performance across various applications. However, fine-tuned models often struggle outside their specific domains and exhibit considerable…

We introduce Domain-specific Masks for Generalization, a model for improving both in-domain and out-of-domain generalization performance. For domain generalization, the goal is to learn from a set of source domains to produce a single model…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Prithvijit Chattopadhyay , Yogesh Balaji , Judy Hoffman

We propose a novel parameter-efficient training (PET) method for large language models that adapts models to downstream tasks by optimizing a small subset of the existing model parameters. Unlike prior methods, this subset is not fixed in…

Computation and Language · Computer Science 2024-11-14 Felix Stahlberg , Jared Lichtarge , Shankar Kumar

Unsupervised domain adaptation studies the problem of utilizing a relevant source domain with abundant labels to build predictive modeling for an unannotated target domain. Recent work observe that the popular adversarial approach of…

Machine Learning · Statistics 2020-01-06 Shen Yan , Huan Song , Nanxiang Li , Lincan Zou , Liu Ren

To generalize the model trained in source domains to unseen target domains, domain generalization (DG) has recently attracted lots of attention. Since target domains can not be involved in training, overfitting source domains is inevitable.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Histopathological images are essential for medical diagnosis and treatment planning, but interpreting them accurately using machine learning can be challenging due to variations in tissue preparation, staining and imaging protocols. Domain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Vaibhav Khamankar , Sutanu Bera , Saumik Bhattacharya , Debashis Sen , Prabir Kumar Biswas