English
Related papers

Related papers: Domain Generalisation with Bidirectional Encoder R…

200 papers

Conventional Domain Adaptation (DA) methods aim to learn domain-invariant feature representations to improve the target adaptation performance. However, we motivate that domain-specificity is equally important since in-domain trained models…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Sunandini Sanyal , Ashish Ramayee Asokan , Suvaansh Bhambri , Akshay Kulkarni , Jogendra Nath Kundu , R. Venkatesh Babu

Domain generalization (DG) is the problem of generalizing from several distributions (or domains), for which labeled training data are available, to a new test domain for which no labeled data is available. For the prevailing benchmark…

Machine Learning · Computer Science 2026-02-05 Yilun Zhu , Naihao Deng , Naichen Shi , Aditya Gangrade , Clayton Scott

The Vision-Language Foundation Model has recently shown outstanding performance in various perception learning tasks. The outstanding performance of the vision-language model mainly relies on large-scale pre-training datasets and different…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Thanh-Dat Truong , Xin Li , Bhiksha Raj , Jackson Cothren , Khoa Luu

Unsupervised domain adaptation aims to generalize the hypothesis trained in a source domain to an unlabeled target domain. One popular approach to this problem is to learn domain-invariant embeddings for both domains. In this work, we…

Machine Learning · Computer Science 2019-10-15 Ching-Yao Chuang , Antonio Torralba , Stefanie Jegelka

Deep learning models in medical image analysis often struggle with generalizability across domains and demographic groups due to data heterogeneity and scarcity. Traditional augmentation improves robustness, but fails under substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Sebastian Doerrich , Francesco Di Salvo , Jonas Alle , Christian Ledig

Machine learning models are prone to overfitting their training (source) domains, which is commonly believed to be the reason why they falter in novel target domains. Here we examine the contrasting view that multi-source domain…

Computation and Language · Computer Science 2022-10-26 Md Arafat Sultan , Avirup Sil , Radu Florian

We propose a general framework for unsupervised domain adaptation, which allows deep neural networks trained on a source domain to be tested on a different target domain without requiring any training annotations in the target domain. This…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Zak Murez , Soheil Kolouri , David Kriegman , Ravi Ramamoorthi , Kyungnam Kim

Domain generalization involves learning a classifier from a heterogeneous collection of training sources such that it generalizes to data drawn from similar unknown target domains, with applications in large-scale learning and personalized…

Machine Learning · Computer Science 2021-12-24 Xavier Thomas , Dhruv Mahajan , Alex Pentland , Abhimanyu Dubey

Despite the rapid progress in deep visual recognition, modern computer vision datasets significantly overrepresent the developed world and models trained on such datasets underperform on images from unseen geographies. We investigate the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Viraj Prabhu , Ramprasaath R. Selvaraju , Judy Hoffman , Nikhil Naik

The problem of domain generalization is to learn, given data from different source distributions, a model that can be expected to generalize well on new target distributions which are only seen through unlabeled samples. In this paper, we…

Machine Learning · Computer Science 2024-03-12 Markus Holzleitner , Sergei V. Pereverzyev , Werner Zellinger

Out-of-distribution (O.O.D.) generalization remains to be a key challenge for real-world machine learning systems. We describe a method for O.O.D. generalization that, through training, encourages models to only preserve features in the…

Machine Learning · Computer Science 2022-08-09 Arjun Ashok , Chaitanya Devaguptapu , Vineeth Balasubramanian

Deep learning (DL) has driven broad advances across scientific and engineering domains. Despite its success, DL models often exhibit limited interpretability and generalization, which can undermine trust, especially in safety-critical…

Machine Learning · Computer Science 2026-01-14 Atefeh Termehchi , Ekram Hossain , Isaac Woungang

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

Machine Learning · Computer Science 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen

Human visual perception can easily generalize to out-of-distributed visual data, which is far beyond the capability of modern machine learning models. Domain generalization (DG) aims to close this gap, with existing DG methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Bo Li , Yifei Shen , Jingkang Yang , Yezhen Wang , Jiawei Ren , Tong Che , Jun Zhang , Ziwei Liu

The goal of domain generalization algorithms is to predict well on distributions different from those seen during training. While a myriad of domain generalization algorithms exist, inconsistencies in experimental conditions -- datasets,…

Machine Learning · Computer Science 2020-07-06 Ishaan Gulrajani , David Lopez-Paz

Recent work studying the generalization of diffusion models with UNet-based denoisers reveals inductive biases that can be expressed via geometry-adaptive harmonic bases. However, in practice, more recent denoising networks are often based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Jie An , De Wang , Pengsheng Guo , Jiebo Luo , Alexander Schwing

Deep neural networks suffer from significant performance deterioration when there exists distribution shift between deployment and training. Domain Generalization (DG) aims to safely transfer a model to unseen target domains by only relying…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Xin Zhang , Ying-Cong Chen

Domain adaptation (DA) benefits from the rigorous theoretical works that study its insightful characteristics and various aspects, e.g., learning domain-invariant representations and its trade-off. However, it seems not the case for the…

Machine Learning · Computer Science 2023-11-07 Trung Phung , Trung Le , Long Vuong , Toan Tran , Anh Tran , Hung Bui , Dinh Phung

Spatial autocorrelation and spatial heterogeneity widely exist in spatial data, which make the traditional machine learning model perform badly. Spatial domain generalization is a spatial extension of domain generalization, which can…

Machine Learning · Computer Science 2022-12-29 Dazhou Yu , Guangji Bai , Yun Li , Liang Zhao

With the rapid development of deep learning methods, there have been many breakthroughs in the field of text classification. Models developed for this task have been shown to achieve high accuracy. However, most of these models are trained…

Machine Learning · Computer Science 2024-09-24 Yuxuan Hu , Chenwei Zhang , Min Yang , Xiaodan Liang , Chengming Li , Xiping Hu