English
Related papers

Related papers: Multi-Task Optimization over Networks of Tasks

200 papers

A multi-task learning (MTL) system aims at solving multiple related tasks at the same time. With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of…

Machine Learning · Computer Science 2021-02-16 Xi Lin , Zhiyuan Yang , Qingfu Zhang , Sam Kwong

Mobile edge computing (MEC) can enhance the computing capability of mobile devices, and non-orthogonal multiple access (NOMA) can provide high data rates. Combining these two technologies can effectively benefit the network with spectrum…

Information Theory · Computer Science 2019-04-30 Fang Fang , Yanqing Xu , Zhiguo Ding , Chao Shen , Mugen Peng , George K. Karagiannidis

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front…

Machine Learning · Computer Science 2024-06-17 Anke Tang , Li Shen , Yong Luo , Shiwei Liu , Han Hu , Bo Du

It is often the case that the performance of a neural network can be improved by adding layers. In real-world practices, we always train dozens of neural network architectures in parallel which is a wasteful process. We explored $CompNet$,…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Jun Lu , Wei Ma , Boi Faltings

Multi-task learning (MTL) is a methodology that aims to improve the general performance of estimation and prediction by sharing common information among related tasks. In the MTL, there are several assumptions for the relationships and…

Methodology · Statistics 2023-04-27 Akira Okazaki , Shuichi Kawano

In the Multi-task Learning (MTL) framework, every task demands distinct feature representations, ranging from low-level to high-level attributes. It is vital to address the specific (feature/parameter) needs of each task, especially in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Deep reinforcement learning has achieved remarkable performance in various domains by leveraging deep neural networks for approximating value functions and policies. However, using neural networks to approximate value functions or policy…

Machine Learning · Computer Science 2023-10-31 Yiqin Tan , Ling Pan , Longbo Huang

One simplifying assumption in existing and well-performing task allocation methods is that the robots are single-tasking: each robot operates on a single task at any given time. While this assumption is harmless to make in some situations,…

Robotics · Computer Science 2026-03-10 Winston Smith , Yu Zhang

Tasks in multi-task learning often correlate, conflict, or even compete with each other. As a result, a single solution that is optimal for all tasks rarely exists. Recent papers introduced the concept of Pareto optimality to this field and…

Machine Learning · Computer Science 2020-08-28 Pingchuan Ma , Tao Du , Wojciech Matusik

Topology Optimization (TO) provides a systematic approach for obtaining structure design with optimum performance of interest. However, the process requires numerical evaluation of objective function and constraints at each iteration, which…

Machine Learning · Computer Science 2022-03-22 Ren Kai Tan , Chao Qian , Dan Xu , Wenjing Ye

Many tasks in data mining and related fields can be formalized as matching between objects in two heterogeneous domains, including collaborative filtering, link prediction, image tagging, and web search. Machine learning techniques,…

Machine Learning · Computer Science 2014-10-24 Jingbo Shang , Tianqi Chen , Hang Li , Zhengdong Lu , Yong Yu

Multi-robot decision-making is the process where multiple robots coordinate actions. In this paper, we aim for efficient and effective multi-robot decision-making despite the robots' limited on-board resources and the often…

Optimization and Control · Mathematics 2026-02-24 Zirui Xu , Vasileios Tzoumas

Meta-learning approaches enable machine learning systems to adapt to new tasks given few examples by leveraging knowledge from related tasks. However, a large number of meta-training tasks are still required for generalization to unseen…

Machine Learning · Computer Science 2024-10-24 Seanie Lee , Bruno Andreis , Kenji Kawaguchi , Juho Lee , Sung Ju Hwang

We consider a multitask learning problem, in which several predictors are learned jointly. Prior research has shown that learning the relations between tasks, and between the input features, together with the predictor, can lead to better…

Machine Learning · Computer Science 2019-07-11 Han Zhao , Otilia Stretcu , Alex Smola , Geoff Gordon

Multimarginal optimal transport (MOT) is a powerful framework for modeling interactions between multiple distributions, yet its applicability is bottlenecked by a high computational overhead. Entropic regularization provides computational…

Machine Learning · Computer Science 2025-06-03 Dor Tsur , Ziv Goldfeld , Kristjan Greenewald , Haim Permuter

Neural network based models have achieved impressive results on various specific tasks. However, in previous works, most models are learned separately based on single-task supervised objectives, which often suffer from insufficient training…

Computation and Language · Computer Science 2016-09-26 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

This study deals with the problem of task and motion planning of autonomous systems within the context of high-level tasks. Specifically, a task comprises logical requirements (conjunctions, disjunctions, and negations) on the trajectories…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Zhou He , Shilong Yuan , Ning Ran , Dimitri Lefebvre

Effective modeling of heterogeneous subpopulations presents a significant challenge due to variations in individual characteristics and behaviors. This paper proposes a novel approach to address this issue through multi-task learning (MTL)…

Machine Learning · Computer Science 2025-08-22 Elif Konyar , Mostafa Reisi Gahrooei , Kamran Paynabar

Compact neural network offers many benefits for real-world applications. However, it is usually challenging to train the compact neural networks with small parameter sizes and low computational costs to achieve the same or better model…

Machine Learning · Computer Science 2023-08-28 Shen Ren , Haosen Shi

Multi-objective optimization (MOO) problems require balancing competing objectives, often under constraints. The Pareto optimal solution set defines all possible optimal trade-offs over such objectives. In this work, we present a novel…

Machine Learning · Computer Science 2022-04-19 Soumyajit Gupta , Gurpreet Singh , Raghu Bollapragada , Matthew Lease