中文
相关论文

相关论文: Multi-Task Zipping via Layer-wise Neuron Sharing

200 篇论文

As the development of neural networks, more and more deep neural networks are adopted in various tasks, such as image classification. However, as the huge computational overhead, these networks could not be applied on mobile devices or…

计算机视觉与模式识别 · 计算机科学 2019-12-03 Yunteng Luan , Hanyu Zhao , Zhi Yang , Yafei Dai

Tree-structured multi-task architectures have been employed to jointly tackle multiple vision tasks in the context of multi-task learning (MTL). The major challenge is to determine where to branch out for each task given a backbone model to…

机器学习 · 计算机科学 2022-05-26 Lijun Zhang , Xiao Liu , Hui Guan

Multimedia applications often require concurrent solutions to multiple tasks. These tasks hold clues to each-others solutions, however as these relations can be complex this remains a rarely utilized property. When task relations are…

计算机视觉与模式识别 · 计算机科学 2019-04-08 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

Computation offloading has become a popular solution to support computationally intensive and latency-sensitive applications by transferring computing tasks to mobile edge servers (MESs) for execution, which is known as mobile/multi-access…

信号处理 · 电气工程与系统科学 2023-09-06 Ruihuai Liang , Bo Yang , Zhiwen Yu , Xuelin Cao , Derrick Wing Kwan Ng , Chau Yuen

The goal of metric learning is to learn a function that maps samples to a lower-dimensional space where similar samples lie closer than dissimilar ones. Particularly, deep metric learning utilizes neural networks to learn such a mapping.…

计算机视觉与模式识别 · 计算机科学 2021-06-14 Jenny Seidenschwarz , Ismail Elezi , Laura Leal-Taixé

Learning multiple domains/tasks with a single model is important for improving data efficiency and lowering inference cost for numerous vision tasks, especially on resource-constrained mobile devices. However, hand-crafting a…

计算机视觉与模式识别 · 计算机科学 2021-01-11 Qifei Wang , Junjie Ke , Joshua Greaves , Grace Chu , Gabriel Bender , Luciano Sbaiz , Alec Go , Andrew Howard , Feng Yang , Ming-Hsuan Yang , Jeff Gilbert , Peyman Milanfar

Multi-task learning (MTL) considers learning a joint model for multiple tasks by optimizing a convex combination of all task losses. To solve the optimization problem, existing methods use an adaptive weight updating scheme, where task…

机器学习 · 计算机科学 2024-07-22 Yifei He , Shiji Zhou , Guojun Zhang , Hyokun Yun , Yi Xu , Belinda Zeng , Trishul Chilimbi , Han Zhao

In deep multi-task learning, weights of task-specific networks are shared between tasks to improve performance on each single one. Since the question, which weights to share between layers, is difficult to answer, human-designed…

机器学习 · 计算机科学 2020-03-24 Jonas Prellberg , Oliver Kramer

Multiplex networks are collections of networks with identical nodes but distinct layers of edges. They are genuine representations for a large variety of real systems whose elements interact in multiple fashions or flavors. However,…

物理与社会 · 物理学 2024-02-27 Daniel Kaiser , Siddharth Patwardhan , Minsuk Kim , Filippo Radicchi

Multi-task learning (MTL) has received considerable attention, and numerous deep learning applications benefit from MTL with multiple objectives. However, constructing multiple related tasks is difficult, and sometimes only a single task is…

计算机视觉与模式识别 · 计算机科学 2019-11-25 Tao Gui , Lizhi Qing , Qi Zhang , Jiacheng Ye , Hang Yan , Zichu Fei , Xuanjing Huang

Model merging-based multitask learning (MTL) offers a promising approach for performing MTL by merging multiple expert models without requiring access to raw training data. However, in this paper, we examine the merged model's…

机器学习 · 计算机科学 2024-10-21 Enneng Yang , Li Shen , Zhenyi Wang , Guibing Guo , Xingwei Wang , Xiaocun Cao , Jie Zhang , Dacheng Tao

Neural-based multi-task learning (MTL) has gained significant improvement, and it has been successfully applied to recommendation system (RS). Recent deep MTL methods for RS (e.g. MMoE, PLE) focus on designing soft gating-based…

人工智能 · 计算机科学 2023-08-21 Qi Liu , Zhilong Zhou , Gangwei Jiang , Tiezheng Ge , Defu Lian

Multi-Task Learning (MTL) aims to boost predictive performance by sharing information across related tasks, yet conventional methods often suffer from negative transfer when unrelated or noisy tasks are forced to share representations. We…

机器学习 · 计算机科学 2026-02-17 Seyedsaman Emami , Daniel Hernández-Lobato , Gonzalo Martínez-Muñoz

State-of-the-art deep model compression methods exploit the low-rank approximation and sparsity pruning to remove redundant parameters from a learned hidden layer. However, they process each hidden layer individually while neglecting the…

计算机视觉与模式识别 · 计算机科学 2019-02-05 Jie Zhang , Xiaolong Wang , Dawei Li , Shalini Ghosh , Abhishek Kolagunda , Yalin Wang

Optical neural networks (ONN) based on micro-ring resonators (MRR) have emerged as a promising alternative to significantly accelerating the massive matrix-vector multiplication (MVM) operations in artificial intelligence (AI) applications.…

硬件体系结构 · 计算机科学 2024-09-10 Bo Xu , Yuetong Fang , Shaoliang Yu , Renjing Xu

Integrating multiple generative foundation models, especially those trained on different modalities, into something greater than the sum of its parts poses significant challenges. Two key hurdles are the availability of aligned data…

机器学习 · 计算机科学 2024-06-03 Vicky Zayats , Peter Chen , Melissa Ferrari , Dirk Padfield

Neuroimaging is essential in brain studies for the diagnosis and identification of disease, structure, and function of the brain in its healthy and disease states. Literature shows that there are advantages of multitasking with some deep…

图像与视频处理 · 电气工程与系统科学 2021-06-01 Mohammad Eslami , Solale Tabarestani , Malek Adjouadi

Multi-task learning (MTL) is a learning paradigm that enables the simultaneous training of multiple communicating algorithms. Although MTL has been successfully applied to ether regression or classification tasks alone, incorporating mixed…

Multitask learning is a common approach in machine learning, which allows to train multiple objectives with a shared architecture. It has been shown that by training multiple tasks together inference time and compute resources can be saved,…

计算机视觉与模式识别 · 计算机科学 2021-09-13 Falk Heuer , Sven Mantowsky , Syed Saqib Bukhari , Georg Schneider

Traditional deep learning methods in medical imaging often focus solely on segmentation or classification, limiting their ability to leverage shared information. Multi-task learning (MTL) addresses this by combining both tasks through…

图像与视频处理 · 电气工程与系统科学 2024-12-03 Phuoc-Nguyen Bui , Duc-Tai Le , Junghyun Bum , Hyunseung Choo