English
Related papers

Related papers: Efficient Controllable Multi-Task Architectures

200 papers

With the rise of neural networks in various domains, multi-task learning (MTL) gained significant relevance. A key challenge in MTL is balancing individual task losses during neural network training to improve performance and efficiency…

Machine Learning · Computer Science 2024-08-16 Lukas Kirchdorfer , Cathrin Elich , Simon Kutsche , Heiner Stuckenschmidt , Lukas Schott , Jan M. Köhler

In the Multi-task Learning (MTL) framework, every task demands distinct feature representations, ranging from low-level to high-level attributes. It is vital to address the specific (feature/parameter) needs of each task, especially in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Multi-Task Learning (MTL) is a learning paradigm in machine learning and its aim is to leverage useful information contained in multiple related tasks to help improve the generalization performance of all the tasks. In this paper, we give a…

Machine Learning · Computer Science 2021-03-30 Yu Zhang , Qiang Yang

Convolution neural networks (CNNs) and Transformers have their own advantages and both have been widely used for dense prediction in multi-task learning (MTL). Most of the current studies on MTL solely rely on CNN or Transformer. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Yangyang Xu , Yibo Yang , Lefei Zhang

Multi-task learning (MTL) aims to improve the performance of multiple related prediction tasks by leveraging useful information from them. Due to their flexibility and ability to reduce unknown coefficients substantially, the…

Machine Learning · Computer Science 2022-12-01 Yuzhao Zhang , Yifan Sun

In the domain of multimedia and multimodal processing, the efficient handling of diverse data streams such as images, video, and sensor data is paramount. Model compression and multitask learning (MTL) are crucial in this field, offering…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Mingcan Xiang , Steven Jiaxun Tang , Qizheng Yang , Hui Guan , Tongping Liu

On edge devices, data scarcity occurs as a common problem where transfer learning serves as a widely-suggested remedy. Nevertheless, transfer learning imposes a heavy computation burden to resource-constrained edge devices. Existing task…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-07 Zimu Zheng , Qiong Chen , Chuang Hu , Dan Wang , Fangming Liu

The multi-modal nature of many vision problems calls for neural network architectures that can perform multiple tasks concurrently. Typically, such architectures have been handcrafted in the literature. However, given the size and…

Computer Vision and Pattern Recognition · Computer Science 2021-05-12 David Bruggemann , Menelaos Kanakis , Stamatios Georgoulis , Luc Van Gool

A Task Decomposition method for iterative learning Model Predictive Control (TDMPC) for linear time-varying systems is presented. We consider the availability of state-input trajectories which solve an original task T1, and design a…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Charlott Vallon , Francesco Borrelli

Deep learning-based massive MIMO CSI feedback has received a lot of attention in recent years. Now, there exists a plethora of CSI feedback models mostly based on auto-encoders (AE) architecture with an encoder network at the user equipment…

Information Theory · Computer Science 2022-12-02 Sharan Mourya , SaiDhiraj Amuru , Kiran Kumar Kuchi

In distributed applications, such as energy demand forecasting at the substation level or federated learning, a large number of related tasks must be learned by different models, while the exact task relationships are unknown. We propose…

Machine Learning · Computer Science 2026-05-25 Eloi Campagne , Yvenn Amara-Ouali , Yannig Goude , Mathilde Mougeot , Argyris Kalogeratos

The recent advance of edge computing technology enables significant sensing performance improvement of Internet of Things (IoT) networks. In particular, an edge server (ES) is responsible for gathering sensing data from distributed sensing…

Signal Processing · Electrical Eng. & Systems 2025-04-17 Huawei Hou , Suzhi Bi , Xian Li , Shuoyao Wang , Liping Qian , Zhi Quan

Multi-Task Learning (MTL) is a powerful technique that has gained popularity due to its performance improvement over traditional Single-Task Learning (STL). However, MTL is often challenging because there is an exponential number of…

Machine Learning · Computer Science 2024-05-28 Ammar Sherif , Abubakar Abid , Mustafa Elattar , Mohamed ElHelw

Given the ubiquity of multi-task in practical systems, Multi-Task Learning (MTL) has found widespread application across diverse domains. In real-world scenarios, these tasks often have different priorities. For instance, In web search,…

Machine Learning · Computer Science 2024-12-17 Zhengxing Cheng , Yuheng Huang , Zhixuan Zhang , Dan Ou , Qingwen Liu

Deep learning has been effectively applied to many discrete optimization problems. However, learning-based scheduling on unrelated parallel machines remains particularly difficult to design. Not only do the numbers of jobs and machines…

Machine Learning · Computer Science 2025-12-23 Diego Hitzges , Guillaume Sagnol

Meta-learning methods aim to build learning algorithms capable of quickly adapting to new tasks in low-data regime. One of the most difficult benchmarks of such algorithms is a one-shot learning problem. In this setting many algorithms face…

Machine Learning · Computer Science 2022-10-04 Andrei Boiarov , Kostiantyn Khabarlak , Igor Yastrebov

Representation learning of the task-oriented attention while tracking instrument holds vast potential in image-guided robotic surgery. Incorporating cognitive ability to automate the camera control enables the surgeon to concentrate more on…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Mobarakol Islam , Vibashan VS , Chwee Ming Lim , Hongliang Ren

This paper addresses key challenges in task scheduling for multi-tenant distributed systems, including dynamic resource variation, heterogeneous tenant demands, and fairness assurance. An adaptive scheduling method based on reinforcement…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-13 Xiaopei Zhang , Xingang Wang , Xin Wang

In mobile edge computing systems, an edge node may have a high load when a large number of mobile devices offload their tasks to it. Those offloaded tasks may experience large processing delay or even be dropped when their deadlines expire.…

Networking and Internet Architecture · Computer Science 2020-05-07 Ming Tang , Vincent W. S. Wong

Designing shared neural architecture plays an important role in multi-task learning. The challenge is that finding an optimal sharing scheme heavily relies on the expert knowledge and is not scalable to a large number of diverse tasks.…

Artificial Intelligence · Computer Science 2018-08-24 Junkun Chen , Kaiyu Chen , Xinchi Chen , Xipeng Qiu , Xuanjing Huang