English
Related papers

Related papers: Towards Multimodal Open-Set Domain Generalization …

200 papers

In this work, we address the challenge of multi-domain translation, where the objective is to learn mappings between arbitrary configurations of domains within a defined set (such as $(D_1, D_2)\rightarrow{}D_3$, $D_2\rightarrow{}(D_1,…

Computation and Language · Computer Science 2025-09-09 Tsiry Mayet , Simon Bernard , Romain Herault , Clement Chatelain

To generalize the model trained in source domains to unseen target domains, domain generalization (DG) has recently attracted lots of attention. Since target domains can not be involved in training, overfitting source domains is inevitable.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Multimodal Domain Generalization (MMDG) leverages the complementary strengths of multiple modalities to enhance model generalization on unseen domains. A central challenge in multimodal learning is optimization imbalance, where modalities…

Machine Learning · Computer Science 2026-03-17 Hongzhao Li , Guohao Shen , Shupan Li , Mingliang Xu , Muhammad Haris Khan

We introduce the problem of domain adaptation under Open Set Label Shift (OSLS) where the label distribution can change arbitrarily and a new class may arrive during deployment, but the class-conditional distributions p(x|y) are…

Machine Learning · Computer Science 2022-10-18 Saurabh Garg , Sivaraman Balakrishnan , Zachary C. Lipton

Open compound domain adaptation (OCDA) is a domain adaptation setting, where target domain is modeled as a compound of multiple unknown homogeneous domains, which brings the advantage of improved generalization to unseen domains. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Rui Gong , Yuhua Chen , Danda Pani Paudel , Yawei Li , Ajad Chhatkuli , Wen Li , Dengxin Dai , Luc Van Gool

Recent LiDAR-based 3D Object Detection (3DOD) methods show promising results, but they often do not generalize well to target domains outside the source (or training) data distribution. To reduce such domain gaps and thus to make 3DOD…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Gyusam Chang , Wonseok Roh , Sujin Jang , Dongwook Lee , Daehyun Ji , Gyeongrok Oh , Jinsun Park , Jinkyu Kim , Sangpil Kim

To ensure the out-of-distribution (OOD) generalization performance, traditional domain generalization (DG) methods resort to training on data from multiple sources with different underlying distributions. And the success of those DG methods…

Machine Learning · Computer Science 2023-05-26 Zheyan Shen , Han Yu , Peng Cui , Jiashuo Liu , Xingxuan Zhang , Linjun Zhou , Furui Liu

Domain Generalization (DG) aims to generalize a model trained on multiple source domains to an unseen target domain. The source domains always require precise annotations, which can be cumbersome or even infeasible to obtain in practice due…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Luojun Lin , Han Xie , Zhishu Sun , Weijie Chen , Wenxi Liu , Yuanlong Yu , Lei Zhang

We introduce MOSAIC (Masked Objective with Selective Adaptation for In-domain Contrastive learning), a multi-stage framework for domain adaptation of text embedding models that incorporates joint domain-specific masked supervision. Our…

Computation and Language · Computer Science 2026-01-30 Vera Pavlova , Mohammed Makhlouf

This paper presents a novel multi-task learning-based method for unsupervised domain adaptation. Specifically, the source and target domain classifiers are jointly learned by considering the geometry of target domain and the divergence…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jing Zhang , Wanqing Li , Philip Ogunbona

Multimodal self-supervised learning is getting more and more attention as it allows not only to train large networks without human supervision but also to search and retrieve data across various modalities. In this context, this paper…

Open-set domain adaptation (OSDA) considers that the target domain contains samples from novel categories unobserved in external source domain. Unfortunately, existing OSDA methods always ignore the demand for the information of unseen…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Taotao Jing , Hongfu Liu , Zhengming Ding

Domain Generalization (DG) seeks to transfer knowledge from multiple source domains to unseen target domains, even in the presence of domain shifts. Achieving effective generalization typically requires a large and diverse set of labeled…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Sumaiya Zoha , Jeong-Gun Lee , Young-Woong Ko

Unsupervised Domain Adaptation (UDA) is crucial to tackle the lack of annotations in a new domain. There are many multi-modal datasets, but most UDA approaches are uni-modal. In this work, we explore how to learn from multi-modality and…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Maximilian Jaritz , Tuan-Hung Vu , Raoul de Charette , Émilie Wirbel , Patrick Pérez

While deep learning has led to significant advances in visual recognition over the past few years, such advances often require a lot of annotated data. Unsupervised domain adaptation has emerged as an alternative approach that does not…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Yunhan Zhao , Haider Ali , Rene Vidal

Domain Generalization (DG), designed to enhance out-of-distribution (OOD) generalization, is all about learning invariance against domain shifts utilizing sufficient supervision signals. Yet, the scarcity of such labeled data has led to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 An Zhang , Han Wang , Xiang Wang , Tat-Seng Chua

Multimodal learning, which aims to understand and analyze information from multiple modalities, has achieved substantial progress in the supervised regime in recent years. However, the heavy dependence on data paired with expensive human…

Machine Learning · Computer Science 2024-08-19 Yongshuo Zong , Oisin Mac Aodha , Timothy Hospedales

Multi-modal learning has achieved remarkable success by integrating information from various modalities, achieving superior performance in tasks like recognition and retrieval compared to uni-modal approaches. However, real-world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Xiaohao Liu , Xiaobo Xia , Zhuo Huang , See-Kiong Ng , Tat-Seng Chua

Crisis classification in social media aims to extract actionable disaster-related information from multimodal posts, which is a crucial task for enhancing situational awareness and facilitating timely emergency responses. However, the wide…

In this work, we introduce a new concept, named source-free open compound domain adaptation (SF-OCDA), and study it in semantic segmentation. SF-OCDA is more challenging than the traditional domain adaptation but it is more practical. It…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Yuyang Zhao , Zhun Zhong , Zhiming Luo , Gim Hee Lee , Nicu Sebe