English
Related papers

Related papers: Reducing the Covariate Shift by Mirror Samples in …

200 papers

Domain generalization aims to develop models that are robust to distribution shifts. Existing methods focus on learning invariance across domains to enhance model robustness, and data augmentation has been widely used to learn invariant…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Yingnan Liu , Yingtian Zou , Rui Qiao , Fusheng Liu , Mong Li Lee , Wynne Hsu

Stochastic Natural Gradient Variational Inference (NGVI) is a widely used method for approximating posterior distribution in probabilistic models. Despite its empirical success and foundational role in variational inference, its theoretical…

Machine Learning · Computer Science 2025-10-23 Fangyuan Sun , Ilyas Fatkhullin , Niao He

Domain shifts in the training data are common in practical applications of machine learning; they occur for instance when the data is coming from different sources. Ideally, a ML model should work well independently of these shifts, for…

In monocular depth estimation, unsupervised domain adaptation has recently been explored to relax the dependence on large annotated image-based depth datasets. However, this comes at the cost of training multiple models or requiring complex…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Amir El-Ghoussani , Julia Hornauer , Gustavo Carneiro , Vasileios Belagiannis

First person action recognition is an increasingly researched topic because of the growing popularity of wearable cameras. This is bringing to light cross-domain issues that are yet to be addressed in this context. Indeed, the information…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Mirco Planamente , Chiara Plizzari , Emanuele Alberti , Barbara Caputo

In this study, we focus on the unsupervised domain adaptation problem where an approximate inference model is to be learned from a labeled data domain and expected to generalize well to an unlabeled data domain. The success of unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Jing Wang , Jiahong Chen , Jianzhe Lin , Leonid Sigal , Clarence W. de Silva

Convolutional networks (ConvNets) have achieved great successes in various challenging vision tasks. However, the performance of ConvNets would degrade when encountering the domain shift. The domain adaptation is more significant while…

Computer Vision and Pattern Recognition · Computer Science 2018-06-20 Qi Dou , Cheng Ouyang , Cheng Chen , Hao Chen , Pheng-Ann Heng

Domain adaptation for Cross-LiDAR 3D detection is challenging due to the large gap on the raw data representation with disparate point densities and point arrangements. By exploring domain-invariant 3D geometric characteristics and motion…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Xidong Peng , Xinge Zhu , Yuexin Ma

Deep learning models usually suffer from domain shift issues, where models trained on one source domain do not generalize well to other unseen domains. In this work, we investigate the single-source domain generalization problem: training a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Cheng Ouyang , Chen Chen , Surui Li , Zeju Li , Chen Qin , Wenjia Bai , Daniel Rueckert

Traditional normalization techniques (e.g., Batch Normalization and Instance Normalization) generally and simplistically assume that training and test data follow the same distribution. As distribution shifts are inevitable in real-world…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Zhiqiang Tang , Yunhe Gao , Yi Zhu , Zhi Zhang , Mu Li , Dimitris Metaxas

Supervised learning results typically rely on assumptions of i.i.d. data. Unfortunately, those assumptions are commonly violated in practice. In this work, we tackle such problem by focusing on domain generalization: a formalization where…

Machine Learning · Computer Science 2024-10-30 Isabela Albuquerque , João Monteiro , Mohammad Darvishi , Tiago H. Falk , Ioannis Mitliagkas

Unsupervised domain adaptation (UDA) refers to a domain adaptation framework in which a learning model is trained based on the labeled samples on the source domain and unlabeled ones in the target domain. The dominant existing methods in…

Machine Learning · Computer Science 2024-12-31 Anh T Nguyen , Lam Tran , Anh Tong , Tuan-Duy H. Nguyen , Toan Tran

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

We study the problem of domain adaptation under distribution shift, where the shift is due to a change in the distribution of an unobserved, latent variable that confounds both the covariates and the labels. In this setting, neither the…

Our goal is to improve reliability of Machine Learning (ML) systems deployed in the wild. ML models perform exceedingly well when test examples are similar to train examples. However, real-world applications are required to perform on any…

Machine Learning · Computer Science 2023-03-07 Vihari Piratla

Standard supervised machine learning assumes that the distribution of the source samples used to train an algorithm is the same as the one of the target samples on which it is supposed to make predictions. However, as any data scientist…

Machine Learning · Computer Science 2020-02-12 Pirmin Lemberger , Ivan Panico

Model generalization capacity at domain shift (e.g., various imaging protocols and scanners) is crucial for deep learning methods in real-world clinical deployment. This paper tackles the challenging problem of domain generalization, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Quande Liu , Qi Dou , Pheng-Ann Heng

Matching information across image and text modalities is a fundamental challenge for many applications that involve both vision and natural language processing. The objective is to find efficient similarity metrics to compare the similarity…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Li Ren , Kai Li , LiQiang Wang , Kien Hua

Deep learning based medical imaging classification models usually suffer from the domain shift problem, where the classification performance drops when training data and real-world data differ in imaging equipment manufacturer, image…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Wenshuo Zhou , Dalu Yang , Binghong Wu , Yehui Yang , Junde Wu , Xiaorong Wang , Lei Wang , Haifeng Huang , Yanwu Xu

We propose Domain-Conditioned Meta-Contrastive Learning, a framework for improving the cross-domain generalization of vision-language models. While contrastive models such as CLIP achieve strong performance through large-scale training,…

Optimization and Control · Mathematics 2026-03-31 Merham Fouladvand , Peuroly Batra