中文
相关论文

相关论文: GradMix: Multi-source Transfer across Domains and …

200 篇论文

Deep multitask networks, in which one neural network produces multiple predictive outputs, can offer better speed and performance than their single-task counterparts but are challenging to train properly. We present a gradient normalization…

计算机视觉与模式识别 · 计算机科学 2018-07-16 Zhao Chen , Vijay Badrinarayanan , Chen-Yu Lee , Andrew Rabinovich

Despite the remarkable success achieved by graph convolutional networks for functional brain activity analysis, the heterogeneity of functional patterns and the scarcity of imaging data still pose challenges in many tasks. Transferring…

机器学习 · 计算机科学 2022-12-19 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or…

图像与视频处理 · 电气工程与系统科学 2022-10-27 Weinan Song , Gaurav Fotedar , Nima Tajbakhsh , Ziheng Zhou , Lei He , Xiaowei Ding

Multitask learning is a widely used paradigm for training models on diverse tasks, with applications ranging from graph neural networks to language model fine-tuning. Since tasks may interfere with each other, a key notion for modeling…

机器学习 · 计算机科学 2024-11-22 Dongyue Li , Aneesh Sharma , Hongyang R. Zhang

In real-world applications, it is often expensive and time-consuming to obtain labeled examples. In such cases, knowledge transfer from related domains, where labels are abundant, could greatly reduce the need for extensive labeling…

机器学习 · 计算机科学 2018-12-10 Marouan Belhaj , Pavlos Protopapas , Weiwei Pan

This paper presents a novel optimization method for maximizing generalization over tasks in meta-learning. The goal of meta-learning is to learn a model for an agent adapting rapidly when presented with previously unseen tasks. Tasks are…

机器学习 · 计算机科学 2018-10-19 Amir Erfan Eshratifar , David Eigen , Massoud Pedram

Deep learning has gained broad interest in remote sensing image scene classification thanks to the effectiveness of deep neural networks in extracting the semantics from complex data. However, deep networks require large amounts of training…

计算机视觉与模式识别 · 计算机科学 2025-10-08 Gianmarco Perantoni , Lorenzo Bruzzone

Recognizing new objects by learning from a few labeled examples in an evolving environment is crucial to obtain excellent generalization ability for real-world machine learning systems. A typical setting across current meta learning…

机器学习 · 计算机科学 2021-09-30 Zhenyi Wang , Tiehang Duan , Le Fang , Qiuling Suo , Mingchen Gao

Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks. However, in many applications, it is prohibitively expensive and time-consuming to obtain large quantities of…

Gradient-based meta-learning methods leverage gradient descent to learn the commonalities among various tasks. While previous such methods have been successful in meta-learning tasks, they resort to simple gradient descent during…

机器学习 · 统计学 2018-06-15 Yoonho Lee , Seungjin Choi

Many real-world machine learning applications involve several learning tasks which are inter-related. For example, in healthcare domain, we need to learn a predictive model of a certain disease for many hospitals. The models for each…

机器学习 · 计算机科学 2016-10-03 Inci M. Baytas , Ming Yan , Anil K. Jain , Jiayu Zhou

Deep learning models exhibit limited generalizability across different domains. Specifically, transferring knowledge from available entangled domain features(source/target domain) and categorical features to new unseen categorical features…

计算机视觉与模式识别 · 计算机科学 2020-03-03 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

Multi-task learning (MTL) has been widely applied in online advertising and recommender systems. To address the negative transfer issue, recent studies have proposed optimization methods that thoroughly focus on the gradient alignment of…

信息检索 · 计算机科学 2023-03-13 Xuanhua Yang , Jianxin Zhao , Shaoguo Liu , Liang Wang , Bo Zheng

Multitask learning is a methodology to boost generalization performance and also reduce computational intensity and memory usage. However, learning multiple tasks simultaneously can be more difficult than learning a single task because it…

机器学习 · 计算机科学 2020-06-03 Sungjae Lee , Youngdoo Son

Gradient-based attention modeling has been used widely as a way to visualize and understand convolutional neural networks. However, exploiting these visual explanations during the training of generative adversarial networks (GANs) is an…

计算机视觉与模式识别 · 计算机科学 2021-08-18 Runze Li , Tomaso Fontanini , Luca Donati , Andrea Prati , Bir Bhanu

Unsupervised domain transfer is the task of transferring or translating samples from a source distribution to a different target distribution. Current solutions unsupervised domain transfer often operate on data on which the modes of the…

机器学习 · 计算机科学 2019-05-31 Mikołaj Bińkowski , R Devon Hjelm , Aaron Courville

Transfer learning is a very important tool in deep learning as it allows propagating information from one "source dataset" to another "target dataset", especially in the case of a small number of training examples in the latter. Yet,…

机器学习 · 计算机科学 2020-01-24 Daniel Jakubovitz , Miguel R. D. Rodrigues , Raja Giryes

Deep neural networks require a large amount of labeled training data during supervised learning. However, collecting and labeling so much data might be infeasible in many cases. In this paper, we introduce a source-target selective joint…

计算机视觉与模式识别 · 计算机科学 2018-03-06 Weifeng Ge , Yizhou Yu

The recent success of deep neural networks relies on massive amounts of labeled data. For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. In this paper, we propose a…

机器学习 · 计算机科学 2017-02-17 Mingsheng Long , Han Zhu , Jianmin Wang , Michael I. Jordan

We propose a new semi-supervised learning method on face-related tasks based on Multi-Task Learning (MTL) and data distillation. The proposed method exploits multiple datasets with different labels for different-but-related tasks such as…

计算机视觉与模式识别 · 计算机科学 2019-07-10 Sepidehsadat Hosseini , Mohammad Amin Shabani , Nam Ik Cho