English
Related papers

Related papers: Hierarchical Reinforcement Learning with Augmented…

200 papers

General purpose agents will require large repertoires of skills. Empowerment -- the maximum mutual information between skills and states -- provides a pathway for learning large collections of distinct skills, but mutual information is…

Machine Learning · Computer Science 2023-10-05 Andrew Levy , Sreehari Rammohan , Alessandro Allievi , Scott Niekum , George Konidaris

Large Language Model (LLM) agents trained with reinforcement learning (RL) show great promise for solving complex, multi-step tasks. However, their performance is often crippled by "Context Explosion", where the accumulation of long text…

Computation and Language · Computer Science 2025-12-16 Xuanzhang Liu , Jianglun Feng , Zhuoran Zhuang , Junzhe Zhao , Maofei Que , Jieting Li , Dianlei Wang , Hao Tong , Ye Chen , Pan Li

Hierarchical reinforcement learning (HRL) decomposes the policy into a manager and a worker, enabling long-horizon planning but introducing a performance gap on tasks requiring agility. We identify a root cause: in subgoal-based HRL, the…

Artificial Intelligence · Computer Science 2026-04-22 Shashank Sharma , Janina Hoffmann , Vinay Namboodiri

Open-ended learning benefits immensely from the use of symbolic methods for goal representation as they offer ways to structure knowledge for efficient and transferable learning. However, the existing Hierarchical Reinforcement Learning…

Machine Learning · Computer Science 2024-12-20 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

Recent studies have uncovered the potential of Large Language Models (LLMs) in addressing complex sequential decision-making tasks through the provision of high-level instructions. However, LLM-based agents lack specialization in tackling…

Artificial Intelligence · Computer Science 2024-05-28 Zihao Zhou , Bin Hu , Chenyang Zhao , Pu Zhang , Bin Liu

Large language model (LLM)-based agents have shown promise in tackling complex tasks by interacting dynamically with the environment. Existing work primarily focuses on behavior cloning from expert demonstrations or preference learning…

Machine Learning · Computer Science 2025-05-30 Hanlin Wang , Jian Wang , Chak Tou Leong , Wenjie Li

Recently, collaborative robots have begun to train humans to achieve complex tasks, and the mutual information exchange between them can lead to successful robot-human collaborations. In this paper we demonstrate the application and…

Robotics · Computer Science 2019-09-24 Sayanti Roy , Emily Kieson , Charles Abramson , Christopher Crick

Large-scale heterogeneous multiagent systems feature various realistic factors in the real world, such as agents with diverse abilities and overall system cost. In comparison to homogeneous systems, heterogeneous systems offer significant…

Artificial Intelligence · Computer Science 2024-03-28 Qingxu Fu , Zhiqiang Pu , Min Chen , Tenghai Qiu , Jianqiang Yi

Large Language Models (LLMs) have shown remarkable promise in reasoning and decision-making, yet their integration with Reinforcement Learning (RL) for complex robotic tasks remains underexplored. In this paper, we propose an LLM-guided…

Machine Learning · Computer Science 2025-03-26 Chak Lam Shek , Pratap Tokekar

Recent advances in agent development have focused on scaling model size and raw interaction data, mirroring successes in large language models. However, for complex, long-horizon multi-agent tasks such as robotic soccer, this end-to-end…

Artificial Intelligence · Computer Science 2025-11-05 Brennen Hill

Existing agents for solving tasks such as ML engineering rely on prompting powerful language models. As a result, these agents do not improve with more experience. In this paper, we show that agents backed by weaker models that improve via…

Machine Learning · Computer Science 2025-09-04 Sherry Yang , Joy He-Yueya , Percy Liang

Planning safe trajectories under uncertain and dynamic conditions makes the autonomous driving problem significantly complex. Current sampling-based methods such as Rapidly Exploring Random Trees (RRTs) are not ideal for this problem…

Robotics · Computer Science 2020-11-11 Kaleb Ben Naveed , Zhiqian Qiao , John M. Dolan

Hierarchical Imitation Learning (HIL) is a promising approach for tackling long-horizon decision-making tasks. While it is a challenging task due to the lack of detailed supervisory labels for sub-goal learning, and reliance on hundreds to…

Artificial Intelligence · Computer Science 2024-10-04 Chengyang Gu , Yuxin Pan , Haotian Bai , Hui Xiong , Yize Chen

Hierarchical learning (HL) is key to solving complex sequential decision problems with long horizons and sparse rewards. It allows learning agents to break-up large problems into smaller, more manageable subtasks. A common approach to HL,…

Artificial Intelligence · Computer Science 2018-03-01 Garrett Andersen , Peter Vrancx , Haitham Bou-Ammar

Feature selection aims to preprocess the target dataset, find an optimal and most streamlined feature subset, and enhance the downstream machine learning task. Among filter, wrapper, and embedded-based approaches, the reinforcement learning…

Artificial Intelligence · Computer Science 2025-09-17 Weiliang Zhang , Xiaohan Huang , Yi Du , Ziyue Qiao , Qingqing Long , Zhen Meng , Yuanchun Zhou , Meng Xiao

Goal-conditioned hierarchical reinforcement learning (GCHRL) provides a promising approach to solving long-horizon tasks. Recently, its success has been extended to more general settings by concurrently learning hierarchical policies and…

Machine Learning · Computer Science 2022-03-08 Siyuan Li , Jin Zhang , Jianhao Wang , Yang Yu , Chongjie Zhang

How do people decide how long to continue in a task, when to switch, and to which other task? Understanding the mechanisms that underpin task interleaving is a long-standing goal in the cognitive sciences. Prior work suggests greedy…

Artificial Intelligence · Computer Science 2020-01-08 Christoph Gebhardt , Antti Oulasvirta , Otmar Hilliges

Reinforcement learning (RL) provides a naturalistic framing for learning through trial and error, which is appealing both because of its simplicity and effectiveness and because of its resemblance to how humans and animals acquire skills…

Machine Learning · Computer Science 2022-08-09 Archit Sharma , Kelvin Xu , Nikhil Sardana , Abhishek Gupta , Karol Hausman , Sergey Levine , Chelsea Finn

Language agents have shown promising adaptability in dynamic environments to perform complex tasks. However, despite the versatile knowledge embedded in large language models, these agents still fall short when it comes to tasks that…

Computation and Language · Computer Science 2024-11-14 Minh Nguyen , Ehsan Shareghi

The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision-making. This paper present a novel DRL framework, termed \emph{$f$-Divergence Reinforcement…

Machine Learning · Computer Science 2021-12-15 Chen Gong , Qiang He , Yunpeng Bai , Zhou Yang , Xiaoyu Chen , Xinwen Hou , Xianjie Zhang , Yu Liu , Guoliang Fan