English
Related papers

Related papers: Creating Multi-Level Skill Hierarchies in Reinforc…

200 papers

Reinforcement learning (RL) algorithms can find an optimal policy for a single agent to accomplish a particular task. However, many real-world problems require multiple agents to collaborate in order to achieve a common goal. For example, a…

Machine Learning · Computer Science 2025-10-20 Jan Corazza , Hadi Partovi Aria , Hyohun Kim , Daniel Neider , Zhe Xu

Real Time Strategy (RTS) games require macro strategies as well as micro strategies to obtain satisfactory performance since it has large state space, action space, and hidden information. This paper presents a novel hierarchical…

Machine Learning · Computer Science 2019-06-24 Zhijian Zhang , Haozheng Li , Luo Zhang , Tianyin Zheng , Ting Zhang , Xiong Hao , Xiaoxin Chen , Min Chen , Fangxu Xiao , Wei Zhou

When autonomous agents interact in the same environment, they must often cooperate to achieve their goals. One way for agents to cooperate effectively is to form a team, make a binding agreement on a joint plan, and execute it. However,…

Most LLM-based agent frameworks adopt a top-down philosophy: humans decompose tasks, define workflows, and assign agents to execute each step. While effective on benchmark-style tasks, such systems rely on designer updates and overlook…

Artificial Intelligence · Computer Science 2025-05-26 Jiawei Du , Jinlong Wu , Yuzheng Chen , Yucheng Hu , Bing Li , Joey Tianyi Zhou

Self-interested individuals often fail to cooperate, posing a fundamental challenge for multi-agent learning. How can we achieve cooperation among self-interested, independent learning agents? Promising recent work has shown that in certain…

This paper develops a control-theoretic framework for analyzing agentic systems embedded within feedback control loops, where an AI agent may adapt controller parameters, select among control strategies, invoke external tools, reconfigure…

Systems and Control · Electrical Eng. & Systems 2026-03-26 Ali Eslami , Jiangbo Yu

Equipping large language models with explicit skills has emerged as a promising paradigm for enabling autonomous agents to solve complex tasks. Agent skills can be inherently divided into general skills for broad cognitive transfer and…

Computation and Language · Computer Science 2026-05-28 Jiapeng Zhu , Jianxiang Yu , Yibo Zhao , Chengcheng Han , Qi Gu , Xunliang Cai , Xiang Li , Weining Qian

We present a novel method for learning hierarchical abstractions that prioritize competing objectives, leading to improved global expected rewards. Our approach employs a secondary rewarding agent with multiple scalar outputs, each…

Machine Learning · Computer Science 2024-12-03 Tofara Moyo

Solving complex problems using reinforcement learning necessitates breaking down the problem into manageable tasks and learning policies to solve these tasks. These policies, in turn, have to be controlled by a master policy that takes…

Artificial Intelligence · Computer Science 2022-08-09 Ambedkar Dukkipati , Rajarshi Banerjee , Ranga Shaarad Ayyagari , Dhaval Parmar Udaybhai

Deep reinforcement learning provides a promising approach for text-based games in studying natural language communication between humans and artificial agents. However, the generalization still remains a big challenge as the agents depend…

Computation and Language · Computer Science 2021-09-22 Yunqiu Xu , Meng Fang , Ling Chen , Yali Du , Chengqi Zhang

Robotic in-hand manipulation has been a long-standing challenge due to the complexity of modelling hand and object in contact and of coordinating finger motion for complex manipulation sequences. To address these challenges, the majority of…

Robotics · Computer Science 2019-10-25 Tingguang Li , Krishnan Srinivasan , Max Qing-Hu Meng , Wenzhen Yuan , Jeannette Bohg

This article introduces a formal model to specify, model and validate hierarchical complex systems described at different levels of analysis. It relies on concepts that have been developed in the multi-agent-based simulation (MABS)…

Multiagent Systems · Computer Science 2012-06-01 Gildas Morvan , Daniel Dupont , Jean-Baptiste Soyez , Rochdi Merzouki

Language agents increasingly improve by reusing \emph{skills} -- structured procedural artifacts distilled from past experience. In particular, \emph{domain-level} and \emph{model-generated} skills are especially promising. They offer fast…

Hierarchical Reinforcement Learning (HRL) is well-suitedd for solving complex tasks by breaking them down into structured policies. However, HRL agents often struggle with efficient exploration and quick adaptation. To overcome these…

Machine Learning · Computer Science 2025-03-18 Arash Khajooeinejad , Fatemeh Sadat Masoumi , Masoumeh Chapariniya

Recent breakthroughs in large language model-driven autonomous agents have revealed that multi-agent collaboration often surpasses each individual through collective reasoning. Inspired by the neural scaling law--increasing neurons enhances…

Artificial Intelligence · Computer Science 2025-03-18 Chen Qian , Zihao Xie , YiFei Wang , Wei Liu , Kunlun Zhu , Hanchen Xia , Yufan Dang , Zhuoyun Du , Weize Chen , Cheng Yang , Zhiyuan Liu , Maosong Sun

We consider a warehouse in which dozens of mobile robots and human pickers work together to collect and deliver items within the warehouse. The fundamental problem we tackle, called the order-picking problem, is how these worker agents must…

The transition from monolithic language models to modular, skill-equipped agents marks a defining shift in how large language models (LLMs) are deployed in practice. Rather than encoding all procedural knowledge within model weights, agent…

Multiagent Systems · Computer Science 2026-02-18 Renjun Xu , Yang Yan

Long-horizon contact-rich bimanual manipulation presents a significant challenge, requiring complex coordination involving a mixture of parallel execution and sequential collaboration between arms. In this paper, we introduce a hierarchical…

Robotics · Computer Science 2026-02-06 Weikang Wan , Fabio Ramos , Xuning Yang , Caelan Garrett

The authors present an overview of a hierarchical framework for coordinating task- and motion-level operations in multirobot systems. Their framework is based on the idea of using simple temporal networks to simultaneously reason about…

Artificial Intelligence · Computer Science 2018-04-03 Hang Ma , Wolfgang Hönig , Liron Cohen , Tansel Uras , Hong Xu , T. K. Satish Kumar , Nora Ayanian , Sven Koenig

Large language model agents increasingly rely on external skills to solve complex tasks, where skills act as modular units that extend their capabilities beyond what parametric memory alone supports. Existing methods assume external skills…

Machine Learning · Computer Science 2026-05-19 Junhao Shen , Teng Zhang , Xiaoyan Zhao , Hong Cheng