中文
相关论文

相关论文: Synergistic Learning with Multi-Task DeepONet for …

200 篇论文

The terms multi-task learning and multitasking are easily confused. Multi-task learning refers to a paradigm in machine learning in which a network is trained on various related tasks to facilitate the acquisition of tasks. In contrast,…

机器学习 · 计算机科学 2021-01-06 Sachin Ravi , Sebastian Musslick , Maia Hamin , Theodore L. Willke , Jonathan D. Cohen

Student assessment is one of the most fundamental tasks in the field of AI Education (AIEd). One of the most common approach to student assessment is Knowledge Tracing (KT), which evaluates a student's knowledge state by predicting whether…

计算机与社会 · 计算机科学 2022-05-02 Suyeong An , Junghoon Kim , Minsam Kim , Juneyoung Park

One of the main motivations of MTL is to develop neural networks capable of inferring multiple tasks simultaneously. While countless methods have been proposed in the past decade investigating robust model architectures and efficient…

计算机视觉与模式识别 · 计算机科学 2024-04-18 Dayou Mao , Yuhao Chen , Yifan Wu , Maximilian Gilles , Alexander Wong

Multi-task learning (MTL) is frequently used in settings where a target task has to be learnt based on limited training data, but knowledge can be leveraged from related auxiliary tasks. While MTL can improve task performance overall…

机器学习 · 计算机科学 2020-12-18 Rafael Peres da Silva , Chayaporn Suphavilai , Niranjan Nagarajan

Multi-task learning (MTL) is an efficient way to improve the performance of related tasks by sharing knowledge. However, most existing MTL networks run on a single end and are not suitable for collaborative intelligence (CI) scenarios. In…

计算机视觉与模式识别 · 计算机科学 2021-11-03 Mengyang Wang , Zhicong Zhang , Jiahui Li , Mengyao Ma , Xiaopeng Fan

Multi-task learning (MTL) has been successfully used in many real-world applications, which aims to simultaneously solve multiple tasks with a single model. The general idea of multi-task learning is designing kinds of global parameter…

机器学习 · 计算机科学 2023-01-24 Xuewen Tao , Mingming Ha , Xiaobo Guo , Qiongxu Ma , Hongwei Cheng , Wenfang Lin

We introduce a novel method that enables parameter-efficient transfer and multi-task learning with deep neural networks. The basic approach is to learn a model patch - a small set of parameters - that will specialize to each task, instead…

机器学习 · 计算机科学 2019-02-26 Pramod Kaushik Mudrakarta , Mark Sandler , Andrey Zhmoginov , Andrew Howard

Code completion, one of the most useful features in the Integrated Development Environments (IDEs), can accelerate software development by suggesting the libraries, APIs, and method names in real-time. Recent studies have shown that…

软件工程 · 计算机科学 2020-06-29 Fang Liu , Ge Li , Bolin Wei , Xin Xia , Zhiyi Fu , Zhi Jin

Distributed multi-task learning (DMTL) effectively improves model generalization performance through the collaborative training of multiple related models. However, in large-scale learning scenarios, communication bottlenecks severely limit…

信息论 · 计算机科学 2025-07-25 Minquan Cheng , Yongkang Wang , Lingyu Zhang , Youlong Wu

Deep learning (DL) advances state-of-the-art reinforcement learning (RL), by incorporating deep neural networks in learning representations from the input to RL. However, the conventional deep neural network architecture is limited in…

机器学习 · 计算机科学 2018-01-03 Yuhang Song , Main Xu , Songyang Zhang , Liangyu Huo

This paper explores multi-task learning (MTL) for face recognition. We answer the questions of how and why MTL can improve the face recognition performance. First, we propose a multi-task Convolutional Neural Network (CNN) for face…

计算机视觉与模式识别 · 计算机科学 2018-02-14 Xi Yin , Xiaoming Liu

Efficient machine learning (ML) has become increasingly important as models grow larger and data volumes expand. In this work, we address the trade-off between generalization in multi-task learning (MTL) and precision in single-task…

机器学习 · 计算机科学 2025-05-02 Dong Liu , Yanxuan Yu

Multi-task learning (MTL) aims at achieving a better model by leveraging data and knowledge from multiple tasks. However, MTL does not always work -- sometimes negative transfer occurs between tasks, especially when aggregating loosely…

计算与语言 · 计算机科学 2023-05-24 Jingwei Ni , Zhijing Jin , Qian Wang , Mrinmaya Sachan , Markus Leippold

Multi-task learning (MTL) aims to empower a model to tackle multiple tasks simultaneously. A recent development known as task arithmetic has revealed that several models, each fine-tuned for distinct tasks, can be directly merged into a…

机器学习 · 计算机科学 2024-05-29 Enneng Yang , Zhenyi Wang , Li Shen , Shiwei Liu , Guibing Guo , Xingwei Wang , Dacheng Tao

The multi-task learning ($MTL$) paradigm aims to simultaneously learn multiple tasks within a single model capturing higher-level, more general hidden patterns that are shared by the tasks. In deep learning, a significant challenge in the…

机器学习 · 计算机科学 2025-06-09 Thomas Borsani , Andrea Rosani , Giuseppe Nicosia , Giuseppe Di Fatta

In this paper, we propose a novel multi-task learning (MTL) framework, called Self-Paced Multi-Task Learning (SPMTL). Different from previous works treating all tasks and instances equally when training, SPMTL attempts to jointly learn the…

机器学习 · 计算机科学 2017-04-04 Changsheng Li , Junchi Yan , Fan Wei , Weishan Dong , Qingshan Liu , Hongyuan Zha

Deep transfer learning (DTL) is a fundamental method in the field of Intelligent Fault Detection (IFD). It aims to mitigate the degradation of method performance that arises from the discrepancies in data distribution between training set…

机器学习 · 计算机科学 2024-02-21 Zhongzhi Li , Jingqi Tu , Jiacheng Zhu , Jianliang Ai , Yiqun Dong

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

机器学习 · 计算机科学 2019-01-14 Ozan Sener , Vladlen Koltun

Multi-task learning (MTL) refers to the paradigm of learning multiple related tasks together. In contrast, in single-task learning (STL) each individual task is learned independently. MTL often leads to better trained models because they…

机器学习 · 统计学 2019-07-03 Jian Liang , Ziqi Liu , Jiayu Zhou , Xiaoqian Jiang , Changshui Zhang , Fei Wang

This paper presents meta-sparsity, a framework for learning model sparsity, basically learning the parameter that controls the degree of sparsity, that allows deep neural networks (DNNs) to inherently generate optimal sparse shared…

机器学习 · 计算机科学 2025-01-22 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki