中文
相关论文

相关论文: AP-MTL: Attention Pruned Multi-task Learning Model…

200 篇论文

Pruning is a promising approach to compress deep learning models in order to deploy them on resource-constrained edge devices. However, many existing pruning solutions are based on unstructured pruning, which yields models that cannot…

机器学习 · 计算机科学 2023-03-16 Kaiqi Zhao , Animesh Jain , Ming Zhao

Multi-task learning (MTL) aims to improve the generalization of several related tasks by learning them jointly. As a comparison, in addition to the joint training scheme, modern meta-learning allows unseen tasks with limited labels during…

机器学习 · 计算机科学 2021-06-17 Haoxiang Wang , Han Zhao , Bo Li

Vision Transformers (ViTs) have emerged as the backbone of many segmentation models, consistently achieving state-of-the-art (SOTA) performance. However, their success comes at a significant computational cost. Image token pruning is one of…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Hanning Chen , Yang Ni , Wenjun Huang , Yezi Liu , SungHeon Jeong , Fei Wen , Nathaniel Bastian , Hugo Latapie , Mohsen Imani

One of the main motivations of MTL is to develop neural networks capable of inferring multiple tasks simultaneously. While countless methods have been proposed in the past decade investigating robust model architectures and efficient…

计算机视觉与模式识别 · 计算机科学 2024-04-18 Dayou Mao , Yuhao Chen , Yifan Wu , Maximilian Gilles , Alexander Wong

Multi-task learning (MTL) considers learning a joint model for multiple tasks by optimizing a convex combination of all task losses. To solve the optimization problem, existing methods use an adaptive weight updating scheme, where task…

机器学习 · 计算机科学 2024-07-22 Yifei He , Shiji Zhou , Guojun Zhang , Hyokun Yun , Yi Xu , Belinda Zeng , Trishul Chilimbi , Han Zhao

Multi-task learning (MTL) has been widely adopted for its ability to simultaneously learn multiple tasks. While existing gradient manipulation methods often yield more balanced solutions than simple scalarization-based approaches, they…

机器学习 · 计算机科学 2025-09-29 Peiyao Xiao , Chaosheng Dong , Shaofeng Zou , Kaiyi Ji

Automated detection and segmentation of surgical devices, such as catheters or wires, in X-ray fluoroscopic images have the potential to enhance image guidance in minimally invasive heart surgeries. In this paper, we present a convolutional…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Lin Xi , Yingliang Ma , Ethan Koland , Sandra Howell , Aldo Rinaldi , Kawal S. Rhode

Spatio-Temporal prediction plays a critical role in smart city construction. Jointly modeling multiple spatio-temporal tasks can further promote an intelligent city life by integrating their inseparable relationship. However, existing…

机器学习 · 计算机科学 2023-04-20 Zijian Zhang , Xiangyu Zhao , Hao Miao , Chunxu Zhang , Hongwei Zhao , Junbo Zhang

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

机器学习 · 计算机科学 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are simultaneously learned by a shared model. Such approaches offer advantages like improved data efficiency, reduced overfitting through shared…

机器学习 · 计算机科学 2020-09-22 Michael Crawshaw

Multi-task learning (MTL) seeks to improve the generalized performance of learning specific tasks, exploiting useful information incorporated in related tasks. As a promising area, this paper studies an MTL-based control approach…

系统与控制 · 电气工程与系统科学 2024-08-01 Andres Arias , Chuangchuang Sun

Multi-task learning (MTL) aims to empower a model to tackle multiple tasks simultaneously. A recent development known as task arithmetic has revealed that several models, each fine-tuned for distinct tasks, can be directly merged into a…

机器学习 · 计算机科学 2024-05-29 Enneng Yang , Zhenyi Wang , Li Shen , Shiwei Liu , Guibing Guo , Xingwei Wang , Dacheng Tao

Pre-trained language models (PLMs) demonstrate remarkable intelligence but struggle with emerging tasks unseen during training in real-world applications. Training separate models for each new task is usually impractical. Multi-task…

计算与语言 · 计算机科学 2025-05-02 Xiao Zhang , Kangsheng Wang , Tianyu Hu , Huimin Ma

Many real-world large-scale regression problems can be formulated as Multi-task Learning (MTL) problems with a massive number of tasks, as in retail and transportation domains. However, existing MTL methods still fail to offer both the…

机器学习 · 计算机科学 2018-11-15 Xiao He , Francesco Alesiani , Ammar Shaker

In the field of medical imaging, AI-assisted techniques such as object detection, segmentation, and classification are widely employed to alleviate the workload of physicians and doctors. However, single-task models are predominantly used,…

图像与视频处理 · 电气工程与系统科学 2025-11-18 Fan Li , Arun Iyengar , Lanyu Xu

We propose a novel semi-supervised image segmentation method that simultaneously optimizes a supervised segmentation and an unsupervised reconstruction objectives. The reconstruction objective uses an attention mechanism that separates the…

计算机视觉与模式识别 · 计算机科学 2019-07-30 Shuai Chen , Gerda Bortsova , Antonio Garcia-Uceda Juarez , Gijs van Tulder , Marleen de Bruijne

Multitask learning (MTL) has recently gained a lot of popularity as a learning paradigm that can lead to improved per-task performance while also using fewer per-task model parameters compared to single task learning. One of the biggest…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Dimitrios Sinodinos , Narges Armanfard

Multi-task learning (MTL) can improve the generalization performance of neural networks by sharing representations with related tasks. Nonetheless, MTL can also degrade performance through harmful interference between tasks. Recent work has…

机器学习 · 计算机科学 2023-06-08 Emilie Grégoire , Hafeez Chaudhary , Sam Verboven

Object detection, segmentation and classification are three common tasks in medical image analysis. Multi-task deep learning (MTL) tackles these three tasks jointly, which provides several advantages saving computing time and resources and…

计算机视觉与模式识别 · 计算机科学 2019-06-06 Fei Gao , Hyunsoo Yoon , Teresa Wu , Xianghua Chu

Anomaly detection in medical images is a challenging task, since anomalies are not typically available during training. Recent methods leverage a single pretext task coupled with a large-scale pre-trained model to reach state-of-the-art…