English
Related papers

Related papers: MIDAS: Modeling Ground-Truth Distributions with Da…

200 papers

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

Machine Learning · Computer Science 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

Multi-Source Domain Generalization (DG) is the task of training on multiple source domains and achieving high classification performance on unseen target domains. Recent methods combine robust features from web-scale pretrained backbones…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Piotr Teterwak , Kuniaki Saito , Theodoros Tsiligkaridis , Bryan A. Plummer , Kate Saenko

Deep learning models for verification systems often fail to generalize to new users and new environments, even though they learn highly discriminative features. To address this problem, we propose a few-shot domain generalization framework…

Sound · Computer Science 2022-06-29 Seunghan Yang , Debasmit Das , Janghoon Cho , Hyoungwoo Park , Sungrack Yun

Knowledge distillation is classically a procedure where a neural network is trained on the output of another network along with the original targets in order to transfer knowledge between the architectures. The special case of…

Machine Learning · Computer Science 2021-10-18 Kenneth Borup , Lars N. Andersen

Domain generalization(DG) endeavors to develop robust models that possess strong generalizability while preserving excellent discriminability. Nonetheless, pivotal DG techniques tend to improve the feature generalizability by learning…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Shaocong Long , Qianyu Zhou , Chenhao Ying , Lizhuang Ma , Yuan Luo

The task of unsupervised domain adaptation is proposed to transfer the knowledge of a label-rich domain (source domain) to a label-scarce domain (target domain). Matching feature distributions between different domains is a widely applied…

Machine Learning · Computer Science 2018-12-19 Toshihiko Matsuura , Kuniaki Saito , Tatsuya Harada

Despite remarkable success in a variety of applications, it is well-known that deep learning can fail catastrophically when presented with out-of-distribution data. Toward addressing this challenge, we consider the domain generalization…

Machine Learning · Statistics 2021-11-16 Alexander Robey , George J. Pappas , Hamed Hassani

Universal domain adaptation (UniDA) is a practical but challenging problem, in which information about the relation between the source and the target domains is not given for knowledge transfer. Existing UniDA methods may suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Yanzuo Lu , Meng Shen , Andy J Ma , Xiaohua Xie , Jian-Huang Lai

This paper introduces Progressively Diffused Networks (PDNs) for unifying multi-scale context modeling with deep feature learning, by taking semantic image segmentation as an exemplar application. Prior neural networks, such as ResNet, tend…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Ruimao Zhang , Wei Yang , Zhanglin Peng , Xiaogang Wang , Liang Lin

Enhancing the generalization capability of deep neural networks to unseen domains is crucial for safety-critical applications in the real world such as autonomous driving. To address this issue, this paper proposes a novel instance…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Sungha Choi , Sanghun Jung , Huiwon Yun , Joanne Kim , Seungryong Kim , Jaegul Choo

Deep learning models face persistent challenges in training, particularly due to internal covariate shift and label shift. While single-mode normalization methods like Batch Normalization partially address these issues, they are constrained…

Machine Learning · Computer Science 2024-10-31 Bilal Faye , Hanane Azzag , Mustapha Lebbah , Djamel Bouchaffra

Transfer learning is a popular practice in deep neural networks, but fine-tuning of large number of parameters is a hard task due to the complex wiring of neurons between splitting layers and imbalance distributions of data in pretrained…

Machine Learning · Computer Science 2017-10-23 Arash Shahriari

Domain invariant learning aims to learn models that extract invariant features over various training domains, resulting in better generalization to unseen target domains. Recently, Bayesian Neural Networks have achieved promising results in…

Machine Learning · Computer Science 2023-10-26 Shiyu Shen , Bin Pan , Tianyang Shi , Tao Li , Zhenwei Shi

Deep neural networks (DNN) have demonstrated unprecedented success for medical imaging applications. However, due to the issue of limited dataset availability and the strict legal and ethical requirements for patient privacy protection, the…

Machine Learning · Computer Science 2023-09-19 Chris Xing Tian , Haoliang Li , Yufei Wang , Shiqi Wang

Despite recent stereo matching networks achieving impressive performance given sufficient training data, they suffer from domain shifts and generalize poorly to unseen domains. We argue that maintaining feature consistency between matching…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Jiawei Zhang , Xiang Wang , Xiao Bai , Chen Wang , Lei Huang , Yimin Chen , Lin Gu , Jun Zhou , Tatsuya Harada , Edwin R. Hancock

Recent advances in generic large models, such as GPT and DeepSeek, have motivated the introduction of universality to graph pre-training, aiming to learn rich and generalizable knowledge across diverse domains using graph representations to…

Machine Learning · Computer Science 2026-02-27 Lianze Shan , Jitao Zhao , Dongxiao He , Siqi Liu , Jiaxu Cui , Weixiong Zhang

The accurate target-background separation in infrared small target detection (IRSTD) highly depends on the discriminability of extracted representations. However, most existing methods are confined to domain-consistent settings, while…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yimin Fu , Songbo Wang , Feiyan Wu , Jialin Lyu , Zhunga Liu , Michael K. Ng

Due to domain shift, deep neural networks (DNNs) usually fail to generalize well on unknown test data in practice. Domain generalization (DG) aims to overcome this issue by capturing domain-invariant representations from source domains.…

Machine Learning · Computer Science 2022-11-10 Feng Hou , Yao Zhang , Yang Liu , Jin Yuan , Cheng Zhong , Yang Zhang , Zhongchao Shi , Jianping Fan , Zhiqiang He

The key challenge of multi-domain translation lies in simultaneously encoding both the general knowledge shared across domains and the particular knowledge distinctive to each domain in a unified model. Previous work shows that the standard…

Computation and Language · Computer Science 2019-11-25 Yong Wang , Longyue Wang , Shuming Shi , Victor O. K. Li , Zhaopeng Tu

We develop a new method for regularising neural networks. We learn a probability distribution over the activations of all layers of the model and then insert imputed values into the network during training. We obtain a posterior for an…

Machine Learning · Computer Science 2019-10-14 Matthew Willetts , Alexander Camuto , Stephen Roberts , Chris Holmes