English
Related papers

Related papers: GradMix: Multi-source Transfer across Domains and …

200 papers

The human ability to synchronize the feedback from all their senses inspired recent works in multi-task and multi-modal learning. While these works rely on expensive supervision, our multi-task graph requires only pseudo-labels from expert…

Machine Learning · Computer Science 2021-11-05 Emanuela Haller , Elena Burceanu , Marius Leordeanu

Deep neural networks have been shown to be very powerful modeling tools for many supervised learning tasks involving complex input patterns. However, they can also easily overfit to training set biases and label noises. In addition to…

Machine Learning · Computer Science 2019-05-07 Mengye Ren , Wenyuan Zeng , Bin Yang , Raquel Urtasun

In recent years, deep learning-based methods have shown promising results in computer vision area. However, a common deep learning model requires a large amount of labeled data, which is labor-intensive to collect and label. What's more,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Shuhao Qiu , Chuang Zhu , Wenli Zhou

Deep neural networks are a promising approach towards multi-task learning because of their capability to leverage knowledge across domains and learn general purpose representations. Nevertheless, they can fail to live up to these promises…

Machine Learning · Computer Science 2019-12-17 Mihai Suteu , Yike Guo

Meta-Learning has emerged as a research direction to better transfer knowledge from related tasks to unseen but related tasks. However, Meta-Learning requires many training tasks to learn representations that transfer well to unseen tasks;…

Computation and Language · Computer Science 2022-10-13 Surya Kant Sahu

In the context of continual learning, acquiring new knowledge while maintaining previous knowledge presents a significant challenge. Existing methods often use experience replay techniques that store a small portion of previous task data…

Machine Learning · Computer Science 2025-12-24 Minsu Kim , Seong-Hyeon Hwang , Steven Euijong Whang

Multi-task learning (MTL) trains deep neural networks to optimize several objectives simultaneously using a shared backbone, which leads to reduced computational costs, improved data efficiency, and enhanced performance through cross-task…

Machine Learning · Computer Science 2025-09-30 Hoang Phan , Lam Tran , Quyen Tran , Ngoc N. Tran , Tuan Truong , Qi Lei , Nhat Ho , Dinh Phung , Trung Le

The successful application of deep learning to many visual recognition tasks relies heavily on the availability of a large amount of labeled data which is usually expensive to obtain. The few-shot learning problem has attracted increasing…

Machine Learning · Computer Science 2020-03-11 Zhongjie Yu , Lin Chen , Zhongwei Cheng , Jiebo Luo

Multi-Source Domain Adaptation (MSDA) deals with the transfer of task knowledge from multiple labeled source domains to an unlabeled target domain, under a domain-shift. Existing methods aim to minimize this domain-shift using auxiliary…

Machine Learning · Computer Science 2021-03-23 Naveen Venkat , Jogendra Nath Kundu , Durgesh Kumar Singh , Ambareesh Revanur , R. Venkatesh Babu

We use information-theoretic tools to derive a novel analysis of Multi-source Domain Adaptation (MDA) from the representation learning perspective. Concretely, we study joint distribution alignment for supervised MDA with few target labels…

Machine Learning · Computer Science 2023-04-06 Qi Chen , Mario Marchand

Leveraging datasets available to learn a model with high generalization ability to unseen domains is important for computer vision, especially when the unseen domain's annotated data are unavailable. We study a novel and practical problem…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Yang Shu , Zhangjie Cao , Chenyu Wang , Jianmin Wang , Mingsheng Long

Knowledge transfer between heterogeneous source and target networks and tasks has received a lot of attention in recent times as large amounts of quality labeled data can be difficult to obtain in many applications. Existing approaches…

Machine Learning · Computer Science 2022-03-17 Keerthiram Murugesan , Vijay Sadashivaiah , Ronny Luss , Karthikeyan Shanmugam , Pin-Yu Chen , Amit Dhurandhar

Previous transfer learning methods based on deep network assume the knowledge should be transferred between the same hidden layers of the source domain and the target domains. This assumption doesn't always hold true, especially when the…

Machine Learning · Computer Science 2018-09-25 Jianzhe Lin , Qi Wang , Rabab Ward , Z. Jane Wang

We propose a unified cross-domain transfer learning framework that leverages knowledge from multiple heterogeneous medical imaging datasets to improve performance across segmentation, classification, and object detection tasks. Our approach…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Ceausescu Ciprian-Mihai , Anghelina Ion-Marian , Alexe Dumitru-Bogdan

As the application of deep learning has expanded to real-world problems with insufficient volume of training data, transfer learning recently has gained much attention as means of improving the performance in such small-data regime.…

Machine Learning · Computer Science 2019-05-16 Yunhun Jang , Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Generalization under the distribution shift has been a great challenge in computer vision. The prevailing practice of directly employing the one-hot labels as the training targets in domain generalization~(DG) can lead to gradient…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Shaocong Long , Qianyu Zhou , Chenhao Ying , Lizhuang Ma , Yuan Luo

Sharing knowledge between tasks is vital for efficient learning in a multi-task setting. However, most research so far has focused on the easier case where knowledge transfer is not harmful, i.e., where knowledge from one task cannot…

Machine Learning · Computer Science 2019-07-08 Timo Bram , Gino Brunner , Oliver Richter , Roger Wattenhofer

Transfer learning can be applied in deep reinforcement learning to accelerate the training of a policy in a target task by transferring knowledge from a policy learned in a related source task. This is commonly achieved by copying…

Machine Learning · Computer Science 2023-06-22 Joseph Campbell , Yue Guo , Fiona Xie , Simon Stepputtis , Katia Sycara

Domain adaptation (DA) tries to tackle the scenarios when the test data does not fully follow the same distribution of the training data, and multi-source domain adaptation (MSDA) is very attractive for real world applications. By learning…

Machine Learning · Computer Science 2024-01-17 Jin Yuan , Feng Hou , Yangzhou Du , Zhongchao Shi , Xin Geng , Jianping Fan , Yong Rui

Semi-supervised learning is a challenging problem which aims to construct a model by learning from a limited number of labeled examples. Numerous methods have been proposed to tackle this problem, with most focusing on utilizing the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Peng Tu , Yawen Huang , Rongrong Ji , Feng Zheng , Ling Shao