中文
相关论文

相关论文: Gradient Similarity Surgery in Multi-Task Deep Lea…

200 篇论文

By jointly learning multiple tasks, multi-task learning (MTL) can leverage the shared knowledge across tasks, resulting in improved data efficiency and generalization performance. However, a major challenge in MTL lies in the presence of…

机器学习 · 计算机科学 2024-07-03 Hao Ban , Kaiyi Ji

Since annotating medical images for segmentation tasks commonly incurs expensive costs, it is highly desirable to design an annotation-efficient method to alleviate the annotation burden. Recently, contrastive learning has exhibited a great…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Yixuan Wu , Jintai Chen , Jiahuan Yan , Yiheng Zhu , Danny Z. Chen , Jian Wu

The goal of multi-task learning is to enable more efficient learning than single task learning by sharing model structures for a diverse set of tasks. A standard multi-task learning objective is to minimize the average loss across all…

机器学习 · 计算机科学 2024-02-22 Bo Liu , Xingchao Liu , Xiaojie Jin , Peter Stone , Qiang Liu

Minimally invasive surgery (MIS) has revolutionized many procedures and led to reduced recovery time and risk of patient injury. However, MIS poses additional complexity and burden on surgical teams. Data-driven surgical vision algorithms…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Oluwatosin Alabi , Tom Vercauteren , Miaojing Shi

The ability to learn sequentially from different data sites is crucial for a deep network in solving practical medical image diagnosis problems due to privacy restrictions and storage limitations. However, adapting on incoming site leads to…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Dunyuan Xu , Xi Wang , Jingyang Zhang , Pheng-Ann Heng

When a number of similar tasks have to be learned simultaneously, multi-task learning (MTL) models can attain significantly higher accuracy than single-task learning (STL) models. However, the advantage of MTL depends on various factors,…

机器学习 · 计算机科学 2023-10-26 Afiya Ayman , Ayan Mukhopadhyay , Aron Laszka

A fundamental challenge for multi-task learning is that different tasks may conflict with each other when they are solved jointly, and a cause of this phenomenon is conflicting gradients during optimization. Recent works attempt to mitigate…

机器学习 · 计算机科学 2023-02-23 Guangyuan Shi , Qimai Li , Wenlong Zhang , Jiaxin Chen , Xiao-Ming Wu

Deep learning-based semi-supervised learning (SSL) algorithms have led to promising results in medical images segmentation and can alleviate doctors' expensive annotations by leveraging unlabeled data. However, most of the existing SSL…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Xiangde Luo , Jieneng Chen , Tao Song , Yinan Chen , Guotai Wang , Shaoting Zhang

We aim to address Multi-Task Learning (MTL) with a large number of tasks by Multi-Task Grouping (MTG). Given N tasks, we propose to simultaneously identify the best task groups from 2^N candidates and train the model weights simultaneously…

机器学习 · 计算机科学 2024-07-09 Yuan Gao , Shuguo Jiang , Moran Li , Jin-Gang Yu , Gui-Song Xia

Sharpness-aware and gradient-alignment methods have been shown to improve generalization, however each family of methods targets a single geometric property of the loss landscape, while ignoring the other. In this paper, we show that this…

机器学习 · 计算机科学 2026-05-11 Aristotelis Ballas , Christos Diou

Multi-task learning (MTL) is an active field in deep learning in which we train a model to jointly learn multiple tasks by exploiting relationships between the tasks. It has been shown that MTL helps the model share the learned features…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Akihiro Nakano , Shi Chen , Kazuyuki Demachi

We propose an approach to Multitask Learning (MTL) to make deep learning models faster and lighter for applications in which multiple tasks need to be solved simultaneously, which is particularly useful in embedded, real-time systems. We…

计算机视觉与模式识别 · 计算机科学 2017-11-02 Miquel Martí , Atsuto Maki

Multi-task-learning(MTL) is a multi-target optimization task. Neural networks try to realize each target using a shared interpretative space within MTL. However, as the scale of datasets expands and the complexity of tasks increases,…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Ruiyuan Zhang , Yuyao Chen , Yuchi Huo , Jiaxiang Liu , Dianbing Xi , Jie Liu , Chao Wu

Model merging-based multitask learning (MTL) offers a promising approach for performing MTL by merging multiple expert models without requiring access to raw training data. However, in this paper, we examine the merged model's…

机器学习 · 计算机科学 2024-10-21 Enneng Yang , Li Shen , Zhenyi Wang , Guibing Guo , Xingwei Wang , Xiaocun Cao , Jie Zhang , Dacheng Tao

Multi-task learning (MTL) seeks to improve the generalized performance of learning specific tasks, exploiting useful information incorporated in related tasks. As a promising area, this paper studies an MTL-based control approach…

系统与控制 · 电气工程与系统科学 2024-08-01 Andres Arias , Chuangchuang Sun

Multi-task learning (MTL) is an efficient solution to solve multiple tasks simultaneously in order to get better speed and performance than handling each single-task in turn. The most current methods can be categorized as either: (i) hard…

计算机视觉与模式识别 · 计算机科学 2019-12-02 Yifan Liu , Bohan Zhuang , Chunhua Shen , Hao Chen , Wei Yin

This paper presents a novel optimization method for maximizing generalization over tasks in meta-learning. The goal of meta-learning is to learn a model for an agent adapting rapidly when presented with previously unseen tasks. Tasks are…

机器学习 · 计算机科学 2018-10-19 Amir Erfan Eshratifar , David Eigen , Massoud Pedram

Despite significant progress in pixel-level medical image analysis, existing medical image segmentation models rarely explore medical segmentation and diagnosis tasks jointly. However, it is crucial for patients that models can provide…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Lingran Song , Yucheng Zhou , Jianbing Shen

Self-supervised learning (SSL) has emerged as a promising paradigm for addressing the annotation bottleneck in medical imaging by learning representations from unlabeled data. However, its effectiveness depends heavily on the design of the…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Chathura Wimalasiri

Gradient-based meta-learning methods leverage gradient descent to learn the commonalities among various tasks. While previous such methods have been successful in meta-learning tasks, they resort to simple gradient descent during…

机器学习 · 统计学 2018-06-15 Yoonho Lee , Seungjin Choi