English
Related papers

Related papers: Balancing Multimodal Domain Generalization via Gra…

200 papers

Machine learning algorithms minimizing the average training loss usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts.…

Machine Learning · Computer Science 2022-07-29 Xi Leng , Xiaoying Tang , Yatao Bian

In many personalized recommendation scenarios, the generalization ability of a target task can be improved via learning with additional auxiliary tasks alongside this target task on a multi-task network. However, this method often suffers…

Machine Learning · Computer Science 2022-03-15 Yun He , Xue Feng , Cheng Cheng , Geng Ji , Yunsong Guo , James Caverlee

Model merging integrates multiple task-specific models into a single consolidated one. Recent research has made progress in improving merging performance for in-distribution or multi-task scenarios, but domain generalization in model…

Machine Learning · Computer Science 2026-03-10 Levy Chaves , Chao Zhou , Rebekka Burkholz , Eduardo Valle , Sandra Avila

Recent MLLMs have shown emerging visual understanding and reasoning abilities after being pre-trained on large-scale multimodal datasets. Unlike pre-training, where MLLMs receive rich visual-text alignment, instruction-tuning is often…

Machine Learning · Computer Science 2026-01-27 Junda Wu , Yuxin Xiong , Xintong Li , Yu Xia , Ruoyu Wang , Yu Wang , Tong Yu , Sungchul Kim , Ryan A. Rossi , Lina Yao , Jingbo Shang , Julian McAuley

This paper presents a gradient-informed fine-tuning method for large language models under few-shot conditions. The goal is to enhance task adaptability and training stability when data is limited. The method builds on a base loss function…

Computation and Language · Computer Science 2025-06-03 Hongye Zheng , Yichen Wang , Ray Pan , Guiran Liu , Binrong Zhu , Hanlu Zhang

Existing domain adaptation methods aim to reduce the distributional difference between the source and target domains and respect their specific discriminative information, by establishing the Maximum Mean Discrepancy (MMD) and the…

Machine Learning · Computer Science 2020-07-03 Wei Wang , Haojie Li , Zhengming Ding , Zhihui Wang

A long standing problem in visual object categorization is the ability of algorithms to generalize across different testing conditions. The problem has been formalized as a covariate shift among the probability distributions generating the…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Massimiliano Mancini , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

In real-life applications, machine learning models often face scenarios where there is a change in data distribution between training and test domains. When the aim is to make predictions on distributions different from those seen at…

Machine Learning · Computer Science 2021-11-04 Lucas Mansilla , Rodrigo Echeveste , Diego H. Milone , Enzo Ferrante

Multimodal deep learning, especially vision-language models, have gained significant traction in recent years, greatly improving performance on many downstream tasks, including content moderation and violence detection. However, standard…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zhuokai Zhao , Harish Palani , Tianyi Liu , Lena Evans , Ruth Toner

Measuring learning progress is essential for curiosity-driven exploration in reinforcement learning, but widely used signals such as prediction error often fail to distinguish meaningful, learnable patterns from random noise. This paper…

Machine Learning · Computer Science 2026-05-08 Samuel Blad , Martin Längkvist , Amy Loutfi

Reinforcement learning (RL) has played a central role in recent advances in large reasoning models (LRMs), yielding strong gains in verifiable and open-ended reasoning. However, training a single general-purpose LRM across diverse domains…

Computation and Language · Computer Science 2026-02-11 Min Cai , Yu Liang , Longzheng Wang , Yan Wang , Yueyang Zhang , Long Xia , Zhiyuan Sun , Xi Ye , Daiting Shi

Deep networks trained on the source domain show degraded performance when tested on unseen target domain data. To enhance the model's generalization ability, most existing domain generalization methods learn domain invariant features by…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Liwei Yang , Xiang Gu , Jian Sun

When modeling class-imbalanced data, it is crucial to address the imbalance, as models trained on such data tend to be biased towards the majority classes. This problem is amplified under partial supervision, where pseudo-labels for…

Machine Learning · Statistics 2026-05-08 Heegeon Yoon , Heeyoung Kim

Domain generalization (DG) aims to improve the generalization performance for an unseen target domain by using the knowledge of multiple seen source domains. Mainstream DG methods typically assume that the domain label of each source sample…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Chaoqi Chen , Jiongcheng Li , Xiaoguang Han , Xiaoqing Liu , Yizhou Yu

Merging multiple expert models offers a promising approach for performing multi-task learning without accessing their original data. Existing methods attempt to alleviate task conflicts by sparsifying task vectors or promoting orthogonality…

Machine Learning · Computer Science 2025-05-27 Yongxian Wei , Anke Tang , Li Shen , Zixuan Hu , Chun Yuan , Xiaochun Cao

A dominant approach for addressing unsupervised domain adaptation is to map data points for the source and the target domains into an embedding space which is modeled as the output-space of a shared deep encoder. The encoder is trained to…

Machine Learning · Computer Science 2022-09-30 Mohammad Rostami

In recent years, there has been a growing interest in combining learnable modules with numerical optimization to solve low-level vision tasks. However, most existing approaches focus on designing specialized schemes to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Risheng Liu , Zhu Liu , Pan Mu , Xin Fan , Zhongxuan Luo

The ability to learn sequentially from different data sites is crucial for a deep network in solving practical medical image diagnosis problems due to privacy restrictions and storage limitations. However, adapting on incoming site leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Dunyuan Xu , Xi Wang , Jingyang Zhang , Pheng-Ann Heng

While deep neural networks demonstrate state-of-the-art performance on a variety of learning tasks, their performance relies on the assumption that train and test distributions are the same, which may not hold in real-world applications.…

Machine Learning · Computer Science 2021-02-18 Wenyu Zhang , Mohamed Ragab , Ramon Sagarna

Learning from multiple modalities, such as audio and video, offers opportunities for leveraging complementary information, enhancing robustness, and improving contextual understanding and performance. However, combining such modalities…

Multimedia · Computer Science 2024-10-15 Konstantinos Kontras , Christos Chatzichristos , Matthew Blaschko , Maarten De Vos