English
Related papers

Related papers: Adapting to Distribution Shift by Visual Domain Pr…

200 papers

Graphs are able to model interconnected entities in many online services, supporting a wide range of applications on the Web. This raises an important question: How can we train a graph foundational model on multiple source domains and…

Computation and Language · Computer Science 2025-04-15 Xingtong Yu , Zechuan Gong , Chang Zhou , Yuan Fang , Hui Zhang

Models should be able to adapt to unseen data during test-time to avoid performance drops caused by inevitable distribution shifts in real-world deployment scenarios. In this work, we tackle the practical yet challenging test-time…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yunhe Gao , Xingjian Shi , Yi Zhu , Hao Wang , Zhiqiang Tang , Xiong Zhou , Mu Li , Dimitris N. Metaxas

Large pre-trained models have achieved great success in many natural language processing tasks. However, when they are applied in specific domains, these models suffer from domain shift and bring challenges in fine-tuning and online serving…

Computation and Language · Computer Science 2021-06-30 Yunzhi Yao , Shaohan Huang , Wenhui Wang , Li Dong , Furu Wei

Domain adaptation is a sub-field of machine learning that involves transferring knowledge from a source domain to perform the same task in the target domain. It is a typical challenge in machine learning that arises, e.g., when data is…

Machine Learning · Computer Science 2025-01-09 Philipp Spitzer , Dominik Martin , Laurin Eichberger , Niklas Kühl

In recent years, deep learning-based methods have shown promising results in computer vision area. However, a common deep learning model requires a large amount of labeled data, which is labor-intensive to collect and label. What's more,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Shuhao Qiu , Chuang Zhu , Wenli Zhou

The objective of unsupervised domain adaptation is to leverage features from a labeled source domain and learn a classifier for an unlabeled target domain, with a similar but different data distribution. Most deep learning approaches to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-19 Pedro O. Pinheiro

Unsupervised Domain Adaptation (UDA) endeavors to adjust models trained on a source domain to perform well on a target domain without requiring additional annotations. In the context of domain adaptive semantic segmentation, which tackles…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Wenlve Zhou , Zhiheng Zhou , Tianlei Wang , Delu Zeng

As a novel and effective fine-tuning paradigm based on large-scale pre-trained language models (PLMs), prompt-tuning aims to reduce the gap between downstream tasks and pre-training objectives. While prompt-tuning has yielded continuous…

Computation and Language · Computer Science 2024-03-21 Jiangmeng Li , Fei Song , Yifan Jin , Wenwen Qiang , Changwen Zheng , Fuchun Sun , Hui Xiong

Top-performing deep architectures are trained on massive amounts of labeled data. In the absence of labeled data for a certain task, domain adaptation often provides an attractive option given that labeled data of similar nature but from a…

Machine Learning · Statistics 2015-03-02 Yaroslav Ganin , Victor Lempitsky

How to handle domain shifts when recognizing or segmenting visual data across domains has been studied by learning and vision communities. In this paper, we address domain generalized semantic segmentation, in which the segmentation model…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Zu-Yun Shiau , Wei-Wei Lin , Ci-Siang Lin , Yu-Chiang Frank Wang

We study a new highly-practical problem setting that enables resource-constrained edge devices to adapt a pre-trained model to their local data distributions. Recognizing that device's data are likely to come from multiple latent domains…

Machine Learning · Computer Science 2024-02-02 Ondrej Bohdal , Da Li , Shell Xu Hu , Timothy Hospedales

Domain adaptation is critical for learning in new and unseen environments. With domain adversarial training, deep networks can learn disentangled and transferable features that effectively diminish the dataset shift between the source and…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Zhangjie Cao , Kaichao You , Mingsheng Long , Jianmin Wang , Qiang Yang

Domain adaptive semantic segmentation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. However, existing methods primarily focus on directly learning qualified target features, making it challenging to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Haochen Wang , Yujun Shen , Jingjing Fei , Wei Li , Liwei Wu , Yuxi Wang , Zhaoxiang Zhang

Transfer learning of diffusion models to smaller target domains is challenging, as naively fine-tuning the model often results in poor generalization. Test-time guidance methods help mitigate this by offering controllable improvements in…

Graphics · Computer Science 2026-01-21 Yara Bahram , Mohammadhadi Shateri , Eric Granger

A complex combination of simultaneous supervised-unsupervised learning is believed to be the key to humans performing tasks seamlessly across multiple domains or tasks. This phenomenon of cross-domain learning has been very well studied in…

Machine Learning · Computer Science 2021-04-14 Sourabh Balgi , Ambedkar Dukkipati

In real applications, object detectors based on deep networks still face challenges of the large domain gap between the labeled training data and unlabeled testing data. To reduce the gap, recent techniques are proposed by aligning the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Sanli Tang , Zhanzhan Cheng , Shiliang Pu , Dashan Guo , Yi Niu , Fei Wu

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

Machine Learning · Computer Science 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din

Domain Generalization (DG) is a fundamental challenge for machine learning models, which aims to improve model generalization on various domains. Previous methods focus on generating domain invariant features from various source domains.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Daoan Zhang , Mingkai Chen , Chenming Li , Lingyun Huang , Jianguo Zhang

Learning deep neural networks that are generalizable across different domains remains a challenge due to the problem of domain shift. Unsupervised domain adaptation is a promising avenue which transfers knowledge from a source domain to a…

Machine Learning · Computer Science 2020-08-20 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

The recent success of deep neural networks relies on massive amounts of labeled data. For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. In this paper, we propose a…

Machine Learning · Computer Science 2017-02-17 Mingsheng Long , Han Zhu , Jianmin Wang , Michael I. Jordan