English
Related papers

Related papers: Domain Generalization using Pretrained Models with…

200 papers

Despite being very powerful in standard learning settings, deep learning models can be extremely brittle when deployed in scenarios different from those on which they were trained. Domain generalization methods investigate this problem and…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Francesco Cappio Borlino , Antonio D'Innocente , Tatiana Tommasi

Unsupervised domain adaptation (UDA) with pre-trained language models (PrLM) has achieved promising results since these pre-trained models embed generic knowledge learned from various domains. However, fine-tuning all the parameters of the…

Computation and Language · Computer Science 2021-11-02 Rongsheng Zhang , Yinhe Zheng , Xiaoxi Mao , Minlie Huang

Although deep learning has achieved remarkable successes over the past years, few reports have been published about applying deep neural networks to Wireless Sensor Networks (WSNs) for image targets recognition where data, energy,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Qianwei Zhou , Yuhang Chen , Baoqing Li , Xiaoxin Li , Chen Zhou , Jingchang Huang , Haigen Hu

Recent advances in generative deep learning have enabled the creation of high-quality synthetic images in text-to-image generation. Prior work shows that fine-tuning a pretrained diffusion model on ImageNet and generating synthetic training…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhuoran Yu , Chenchen Zhu , Sean Culatana , Raghuraman Krishnamoorthi , Fanyi Xiao , Yong Jae Lee

Unsupervised domain adaptation (UDA) tries to overcome the need for a large labeled dataset by transferring knowledge from a source dataset, with lots of labeled data, to a target dataset, that has no labeled data. Since there are no labels…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Thomas Westfechtel , Hao-Wei Yeh , Dexuan Zhang , Tatsuya Harada

Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain…

Computation and Language · Computer Science 2022-10-26 Md Arafat Sultan , Avirup Sil , Radu Florian

Introduction. We investigate the generalization ability of models built on datasets containing a small number of subjects, recorded in single study protocols. Next, we propose and evaluate methods combining these datasets into a single,…

Machine Learning · Computer Science 2023-12-05 Gideon Vos , Kelly Trinh , Zoltan Sarnyai , Mostafa Rahimi Azghadi

Recent deep networks achieved state of the art performance on a variety of semantic segmentation tasks. Despite such progress, these models often face challenges in real world `wild tasks' where large difference between labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-10-26 Yang Zou , Zhiding Yu , B. V. K. Vijaya Kumar , Jinsong Wang

Transferring knowledge across different datasets is an important approach to successfully train deep models with a small-scale target dataset or when few labeled instances are available. In this paper, we aim at developing a model that can…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Eman T. Hassan , Xin Chen , David Crandall

Domain adaptation investigates the problem of leveraging knowledge from a well-labeled source domain to an unlabeled target domain, where the two domains are drawn from different data distributions. Because of the distribution shifts,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Jingjing Li , Mengmeng Jing , Yue Xie , Ke Lu , Zi Huang

This paper narrows the performance gap between small, specialized models and significantly larger general-purpose models through domain adaptation via continual pre-training and merging. We address the scarcity of specialized non-English…

Computation and Language · Computer Science 2026-04-22 Niclas Doll , Jasper Schulze Buschhoff , Shalaka Satheesh , Hammam Abdelwahab , Héctor Allende-Cid , Katrin Klug

Domain generalization (DG) aims to learn a generalizable model from multiple training domains such that it can perform well on unseen target domains. A popular strategy is to augment training data to benefit generalization through methods…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Wang Lu , Jindong Wang , Han Yu , Lei Huang , Xiang Zhang , Yiqiang Chen , Xing Xie

Recent advances in deep learning for medical image segmentation demonstrate expert-level accuracy. However, in clinically realistic environments, such methods have marginal performance due to differences in image domains, including…

Computer Vision and Pattern Recognition · Computer Science 2019-06-13 Ling Zhang , Xiaosong Wang , Dong Yang , Thomas Sanford , Stephanie Harmon , Baris Turkbey , Holger Roth , Andriy Myronenko , Daguang Xu , Ziyue Xu

Unsupervised domain adaptation (UDA) and domain generalization (DG) enable machine learning models trained on a source domain to perform well on unlabeled or even unseen target domains. As previous UDA&DG semantic segmentation methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Lukas Hoyer , Dengxin Dai , Luc Van Gool

In the absence of labeled target data, unsupervised domain adaptation approaches seek to align the marginal distributions of the source and target domains in order to train a classifier for the target. Unsupervised domain alignment…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Sachin Chhabra , Hemanth Venkateswara , Baoxin Li

Data augmentation is a ubiquitous technique for increasing the size of labeled training sets by leveraging task-specific data transformations that preserve class labels. While it is often easy for domain experts to specify individual…

Machine Learning · Statistics 2018-12-10 Alexander J. Ratner , Henry R. Ehrenberg , Zeshan Hussain , Jared Dunnmon , Christopher Ré

We propose associative domain adaptation, a novel technique for end-to-end domain adaptation with neural networks, the task of inferring class labels for an unlabeled target domain based on the statistical properties of a labeled source…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Philip Haeusser , Thomas Frerix , Alexander Mordvintsev , Daniel Cremers

Classical machine learning assumes that the training and test sets come from the same distributions. Therefore, a model learned from the labeled training data is expected to perform well on the test data. However, This assumption may not…

Machine Learning · Computer Science 2020-10-12 Abolfazl Farahani , Sahar Voghoei , Khaled Rasheed , Hamid R. Arabnia

Agnostic domain shift is the main reason of model degradation on the unknown target domains, which brings an urgent need to develop Domain Generalization (DG). Recent advances at DG use dynamic networks to achieve training-free adaptation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Luojun Lin , Zhifeng Shen , Zhishu Sun , Yuanlong Yu , Lei Zhang , Weijie Chen

Domain adaptive semantic segmentation is the task of generating precise and dense predictions for an unlabeled target domain using a model trained on a labeled source domain. While significant efforts have been devoted to improving…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Nazanin Moradinasab , Hassan Jafarzadeh , Donald E. Brown