English
Related papers

Related papers: Synergistic Learning with Multi-Task DeepONet for …

200 papers

Traditional multi-task learning (MTL) methods use dense networks that use the same set of shared weights across several different tasks. This often creates interference where two or more tasks compete to pull model parameters in different…

Learning two tasks in a single shared function has some benefits. Firstly by acquiring information from the second task, the shared function leverages useful information that could have been neglected or underestimated in the first task.…

Machine Learning · Computer Science 2020-08-06 Jonghwa Yim , Sang Hwan Kim

Most uses of machine learning today involve training a model from scratch for a particular task, or sometimes starting with a model pretrained on a related task and then fine-tuning on a downstream task. Both approaches offer limited…

Machine Learning · Computer Science 2022-05-26 Andrea Gesmundo , Jeff Dean

Multi-task learning (MTL) seeks to improve the generalized performance of learning specific tasks, exploiting useful information incorporated in related tasks. As a promising area, this paper studies an MTL-based control approach…

Systems and Control · Electrical Eng. & Systems 2024-08-01 Andres Arias , Chuangchuang Sun

A traditional and intuitively appealing Multi-Task Multiple Kernel Learning (MT-MKL) method is to optimize the sum (thus, the average) of objective functions with (partially) shared kernel function, which allows information sharing amongst…

Machine Learning · Computer Science 2014-04-14 Cong Li , Michael Georgiopoulos , Georgios C. Anagnostopoulos

Multi-task learning (MTL) is a supervised learning paradigm in which the prediction models for several related tasks are learned jointly to achieve better generalization performance. When there are only a few training examples per task, MTL…

Machine Learning · Computer Science 2017-06-07 Azad Naik , Anveshi Charuvaka , Huzefa Rangwala

With the rise of neural networks in various domains, multi-task learning (MTL) gained significant relevance. A key challenge in MTL is balancing individual task losses during neural network training to improve performance and efficiency…

Machine Learning · Computer Science 2024-08-16 Lukas Kirchdorfer , Cathrin Elich , Simon Kutsche , Heiner Stuckenschmidt , Lukas Schott , Jan M. Köhler

Jointly learning multiple tasks with a unified model can improve accuracy and data efficiency, but it faces the challenge of task interference, where optimizing one task objective may inadvertently compromise the performance of another. A…

We aim to address Multi-Task Learning (MTL) with a large number of tasks by Multi-Task Grouping (MTG). Given N tasks, we propose to simultaneously identify the best task groups from 2^N candidates and train the model weights simultaneously…

Machine Learning · Computer Science 2024-07-09 Yuan Gao , Shuguo Jiang , Moran Li , Jin-Gang Yu , Gui-Song Xia

Multi-task learning aims to learn multiple related tasks simultaneously and has achieved great success in various fields. However, the disparity in loss and gradient scales among tasks often leads to performance compromises, and the…

Machine Learning · Computer Science 2025-11-27 Baijiong Lin , Weisen Jiang , Feiyang Ye , Yu Zhang , Pengguang Chen , Ying-Cong Chen , Shu Liu , Ivor W. Tsang , James T. Kwok

Deep reinforcement learning (RL) is a powerful approach to complex decision making. However, one issue that limits its practical application is its brittleness, sometimes failing to train in the presence of small changes in the environment.…

Machine Learning · Computer Science 2025-01-27 Jung-Hoon Cho , Vindula Jayawardana , Sirui Li , Cathy Wu

Multi-Task Learning (MTL) seeks to boost statistical power and learning efficiency by discovering structure shared across related tasks. State-of-the-art MTL representation methods, however, usually treat the latent representation matrix as…

Machine Learning · Statistics 2025-05-07 Aoran Chen , Yang Feng

Over the past decade a wide spectrum of machine learning models have been developed to model the neurodegenerative diseases, associating biomarkers, especially non-intrusive neuroimaging markers, with key clinical scores measuring the…

Machine Learning · Computer Science 2018-03-02 Mengying Sun , Inci M. Baytas , Liang Zhan , Zhangyang Wang , Jiayu Zhou

Recently, a class of machine learning methods called physics-informed neural networks (PINNs) has been proposed and gained prevalence in solving various scientific computing problems. This approach enables the solution of partial…

Computational Engineering, Finance, and Science · Computer Science 2023-11-06 Chen Xu , Ba Trung Cao , Yong Yuan , Günther Meschke

Solving partial differential equations (PDEs) by numerical methods meet computational cost challenge for getting the accurate solution since fine grids and small time steps are required. Machine learning can accelerate this process, but…

Numerical Analysis · Mathematics 2025-01-28 Qi Wang , Yuan Mi , Haoyun Wang , Yi Zhang , Ruizhi Chengze , Hongsheng Liu , Ji-Rong Wen , Hao Sun

In this paper, we present a Multi-Task Deep Neural Network (MT-DNN) for learning representations across multiple natural language understanding (NLU) tasks. MT-DNN not only leverages large amounts of cross-task data, but also benefits from…

Computation and Language · Computer Science 2019-05-31 Xiaodong Liu , Pengcheng He , Weizhu Chen , Jianfeng Gao

Multitask learning is a framework that enforces multiple learning tasks to share knowledge to improve their generalization abilities. While shallow multitask learning can learn task relations, it can only handle predefined features. Modern…

Machine Learning · Computer Science 2022-07-05 Guangji Bai , Liang Zhao

Multitask learning (MTL) aims to develop a unified model that can handle a set of closely related tasks simultaneously. By optimizing the model across multiple tasks, MTL generally surpasses its non-MTL counterparts in terms of…

Machine Learning · Computer Science 2023-10-11 Chin-Chia Michael Yeh , Xin Dai , Yan Zheng , Junpeng Wang , Huiyuan Chen , Yujie Fan , Audrey Der , Zhongfang Zhuang , Liang Wang , Wei Zhang

In driving scenarios, automobile active safety systems are increasingly incorporating deep learning technology. These systems typically need to handle multiple tasks simultaneously, such as detecting fatigue driving and recognizing the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Shulei Qu , Zhenguo Gao , Xiaowei Chen , Na Li , Yakai Wang , Xiaoxiao Wu

Federated learning enables many applications benefiting distributed and private datasets of a large number of potential data-holding clients. However, different clients usually have their own particular objectives in terms of the tasks to…

Machine Learning · Computer Science 2022-07-19 Cihat Keçeci , Mohammad Shaqfeh , Hayat Mbayed , Erchin Serpedin