English
Related papers

Related papers: Exploring Shared Structures and Hierarchies for Mu…

200 papers

Neural network models have shown their promising opportunities for multi-task learning, which focus on learning the shared layers to extract the common and task-invariant features. However, in most existing approaches, the extracted shared…

Computation and Language · Computer Science 2017-04-20 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

This work introduces a growable and modular neural network architecture that naturally avoids catastrophic forgetting and interference in continual reinforcement learning. The structure of each module allows the selective combination of…

Machine Learning · Computer Science 2025-06-19 Mikel Malagón , Josu Ceberio , Jose A. Lozano

Massively multitask neural architectures provide a learning framework for drug discovery that synthesizes information from many distinct biological sources. To train these architectures at scale, we gather large amounts of data from public…

Machine Learning · Statistics 2015-02-10 Bharath Ramsundar , Steven Kearnes , Patrick Riley , Dale Webster , David Konerding , Vijay Pande

Multi-task learning holds the promise of less data, parameters, and time than training of separate models. We propose a method to automatically search over multi-task architectures while taking resource constraints into consideration. We…

Machine Learning · Computer Science 2019-08-14 Alejandro Newell , Lu Jiang , Chong Wang , Li-Jia Li , Jia Deng

Multi-task multi-agent reinforcement learning (MT-MARL) has recently gained attention for its potential to enhance MARL's adaptability across multiple tasks. However, it is challenging for existing multi-task learning methods to handle…

Robotics · Computer Science 2025-07-10 Guobin Zhu , Rui Zhou , Wenkang Ji , Hongyin Zhang , Donglin Wang , Shiyu Zhao

Multi-task learning can leverage information learned by one task to benefit the training of other tasks. Despite this capacity, naively training all tasks together in one model often degrades performance, and exhaustively searching through…

Machine Learning · Computer Science 2021-10-27 Christopher Fifty , Ehsan Amid , Zhe Zhao , Tianhe Yu , Rohan Anil , Chelsea Finn

Agentic systems solve complex tasks by coordinating multiple agents that iteratively reason, invoke tools, and exchange intermediate results. To improve robustness and solution quality, recent approaches deploy multiple agent teams running…

Multiagent Systems · Computer Science 2026-02-06 Joseph Fioresi , Parth Parag Kulkarni , Ashmal Vayani , Song Wang , Mubarak Shah

To improve the efficiency of warehousing system and meet huge customer orders, we aim to solve the challenges of dimension disaster and dynamic properties in hyper scale multi-robot task planning (MRTP) for robotic mobile fulfillment system…

Robotics · Computer Science 2026-05-06 Xuan Zhou , Xiang Shi , Lele Zhang , Chen Chen , Hongbo Li , Lin Ma , Fang Deng , Jie Chen

Multi-task learning, as it is understood nowadays, consists of using one single model to carry out several similar tasks. From classifying hand-written characters of different alphabets to figuring out how to play several Atari games using…

Machine Learning · Computer Science 2019-03-25 Unai Garciarena , Alexander Mendiburu , Roberto Santana

We address the task of assessing discourse coherence, an aspect of text quality that is essential for many NLP tasks, such as summarization and language assessment. We propose a hierarchical neural network trained in a multi-task fashion…

Computation and Language · Computer Science 2020-05-01 Youmna Farag , Helen Yannakoudakis

Multi-task learning (MTL) is an efficient solution to solve multiple tasks simultaneously in order to get better speed and performance than handling each single-task in turn. The most current methods can be categorized as either: (i) hard…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Yifan Liu , Bohan Zhuang , Chunhua Shen , Hao Chen , Wei Yin

This paper presents a novel method that allows a machine learning algorithm following the transformation-based learning paradigm \cite{brill95:tagging} to be applied to multiple classification tasks by training jointly and simultaneously on…

Computation and Language · Computer Science 2007-05-23 Radu Florian , Grace Ngai

Many NLP learning tasks can be decomposed into several distinct sub-tasks, each associated with a partial label. In this paper we focus on a popular class of learning problems, sequence prediction applied to several sentiment analysis…

Computation and Language · Computer Science 2019-06-05 Xiao Zhang , Dan Goldwasser

We study learning to learn for the multi-task structured bandit problem where the goal is to learn a near-optimal algorithm that minimizes cumulative regret. The tasks share a common structure and an algorithm should exploit the shared…

Machine Learning · Computer Science 2025-10-24 Subhojyoti Mukherjee , Josiah P. Hanna , Qiaomin Xie , Robert Nowak

Traditional multi-task learning architectures train a single model across multiple tasks through a shared encoder followed by task-specific decoders. Learning these models often requires specialized training algorithms that address…

Computation and Language · Computer Science 2022-12-14 David Mueller , Nicholas Andrews , Mark Dredze

Automatic methods for generating state-of-the-art neural network architectures without human experts have generated significant attention recently. This is because of the potential to remove human experts from the design loop which can…

Machine Learning · Computer Science 2019-11-22 George Adam , Jonathan Lorraine

Key to multitask learning is exploiting relationships between different tasks to improve prediction performance. If the relations are linear, regularization approaches can be used successfully. However, in practice assuming the tasks to be…

Machine Learning · Computer Science 2017-08-11 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco , Massimiliano Pontil

To create efficient-high performing processes, one must find an optimal design with its corresponding controller that ensures optimal operation in the presence of uncertainty. When comparing different process designs, for the comparison to…

Systems and Control · Electrical Eng. & Systems 2021-08-12 Steven Sachio , Max Mowbray , Maria Papathanasiou , Ehecatl Antonio del Rio-Chanona , Panagiotis Petsagkourakis

Adequate labeled data and expensive compute resources are the prerequisites for the success of neural architecture search(NAS). It is challenging to apply NAS in meta-learning scenarios with limited compute resources and data. In this…

Machine Learning · Computer Science 2021-10-13 Jingtao Rong , Xinyi Yu , Mingyang Zhang , Linlin Ou

The last decade has witnessed growth in the computational requirements for training deep neural networks. Current approaches (e.g., data/model parallelism, pipeline parallelism) parallelize training tasks onto multiple devices. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-09 Siyu Wang , Yi Rong , Shiqing Fan , Zhen Zheng , LanSong Diao , Guoping Long , Jun Yang , Xiaoyong Liu , Wei Lin