中文
相关论文

相关论文: Robust-Multi-Task Gradient Boosting

200 篇论文

Multi-task learning (MTL) is an active field in deep learning in which we train a model to jointly learn multiple tasks by exploiting relationships between the tasks. It has been shown that MTL helps the model share the learned features…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Akihiro Nakano , Shi Chen , Kazuyuki Demachi

We propose generative multitask learning (GMTL), a simple and scalable approach to causal representation learning for multitask learning. Our approach makes a minor change to the conventional multitask inference objective, and improves…

机器学习 · 计算机科学 2022-10-25 Taro Makino , Krzysztof J. Geras , Kyunghyun Cho

Representation-based multi-task learning (MTL) improves efficiency by learning a shared structure across tasks, but its practical application is often hindered by contamination, outliers, or adversarial tasks. Most existing methods and…

机器学习 · 统计学 2025-09-09 Yian Huang , Yang Feng , Zhiliang Ying

We propose an approach to Multitask Learning (MTL) to make deep learning models faster and lighter for applications in which multiple tasks need to be solved simultaneously, which is particularly useful in embedded, real-time systems. We…

计算机视觉与模式识别 · 计算机科学 2017-11-02 Miquel Martí , Atsuto Maki

Shared training approaches, such as multi-task learning (MTL) and gradient-based meta-learning, are widely used in various machine learning applications, but they often suffer from negative transfer, leading to performance degradation in…

机器学习 · 计算机科学 2024-12-10 Anshul Thakur , Yichen Huang , Soheila Molaei , Yujiang Wang , David A. Clifton

The optimal solution to an optimization problem depends on the problem's objective function, constraints, and size. While deep neural networks (DNNs) have proven effective in solving optimization problems, changes in the problem's size,…

While deep learning and deep reinforcement learning (RL) systems have demonstrated impressive results in domains such as image classification, game playing, and robotic control, data efficiency remains a major challenge. Multi-task learning…

机器学习 · 计算机科学 2020-12-23 Tianhe Yu , Saurabh Kumar , Abhishek Gupta , Sergey Levine , Karol Hausman , Chelsea Finn

Multi-task large language models (MTLLMs) are important for many applications at the wireless edge, where users demand specialized models to handle multiple tasks efficiently. However, training MTLLMs is complex and exhaustive, particularly…

信号处理 · 电气工程与系统科学 2026-02-09 Aladin Djuhera , Vlad C. Andrei , Mohsen Pourghasemian , Haris Gacanin , Holger Boche , Walid Saad

Multi-task learning (MTL) has received considerable attention, and numerous deep learning applications benefit from MTL with multiple objectives. However, constructing multiple related tasks is difficult, and sometimes only a single task is…

计算机视觉与模式识别 · 计算机科学 2019-11-25 Tao Gui , Lizhi Qing , Qi Zhang , Jiacheng Ye , Hang Yan , Zichu Fei , Xuanjing Huang

Fine-tuning large language models (LLMs) is computationally expensive, and Low-Rank Adaptation (LoRA) provides a cost-effective solution by approximating weight updates through low-rank matrices. In real-world scenarios, LLMs are fine-tuned…

机器学习 · 计算机科学 2025-06-03 Jinda Liu , Yi Chang , Yuan Wu

Multi-task reinforcement learning (MTRL) aims to train a single agent to efficiently optimize performance across multiple tasks simultaneously. However, jointly optimizing all tasks often yields imbalanced learning: agents quickly solve…

机器学习 · 计算机科学 2026-05-15 Nicholas E. Corrado , Wenyuan Huang , Josiah P. Hanna

Multi-task learning (MTL) has become an essential machine learning tool for addressing multiple learning tasks simultaneously and has been effectively applied across fields such as healthcare, marketing, and biomedical research. However, to…

机器学习 · 统计学 2025-06-02 Yang Sui , Qi Xu , Yang Bai , Annie Qu

Gradient-based meta-learning (GBML) algorithms are able to fast adapt to new tasks by transferring the learned meta-knowledge, while assuming that all tasks come from the same distribution (in-distribution, ID). However, in the real world,…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Min Zhang , Zifeng Zhuang , Zhitao Wang , Donglin Wang , Wenbin Li

Multi-task learning (MTL) aims to improve the generalization performance of multiple tasks by exploiting the shared factors among them. Various metrics (e.g., F-score, Area Under the ROC Curve) are used to evaluate the performances of MTL…

机器学习 · 计算机科学 2022-10-13 Ge-Yang Ke , Yan Pan , Jian Yin , Chang-Qin Huang

Multi-task-learning(MTL) is a multi-target optimization task. Neural networks try to realize each target using a shared interpretative space within MTL. However, as the scale of datasets expands and the complexity of tasks increases,…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Ruiyuan Zhang , Yuyao Chen , Yuchi Huo , Jiaxiang Liu , Dianbing Xi , Jie Liu , Chao Wu

Multi-task learning (MTL) has emerged as a promising approach for deploying deep learning models in real-life applications. Recent studies have proposed optimization-based learning paradigms to establish task-shared representations in MTL.…

机器学习 · 计算机科学 2025-03-12 Zhipeng Zhou , Liu Liu , Peilin Zhao , Wei Gong

Multi-task learning (MTL) has been widely adopted for its ability to simultaneously learn multiple tasks. While existing gradient manipulation methods often yield more balanced solutions than simple scalarization-based approaches, they…

机器学习 · 计算机科学 2025-09-29 Peiyao Xiao , Chaosheng Dong , Shaofeng Zou , Kaiyi Ji

Deep reinforcement learning (RL) is a powerful approach to complex decision making. However, one issue that limits its practical application is its brittleness, sometimes failing to train in the presence of small changes in the environment.…

机器学习 · 计算机科学 2025-01-27 Jung-Hoon Cho , Vindula Jayawardana , Sirui Li , Cathy Wu

Multi-Task Learning (MTL) has achieved success in various fields. However, how to balance different tasks to achieve good performance is a key problem. To achieve the task balancing, there are many works to carefully design dynamical…

机器学习 · 计算机科学 2022-07-28 Baijiong Lin , Feiyang Ye , Yu Zhang , Ivor W. Tsang

Multi-task learning (MTL) is a novel framework to learn several tasks simultaneously with a single shared network where each task has its distinct personalized header network for fine-tuning. MTL can be implemented in federated learning…

机器学习 · 计算机科学 2022-03-28 Matin Mortaheb , Cemil Vahapoglu , Sennur Ulukus