English
Related papers

Related papers: HiMAC: Hierarchical Macro-Micro Learning for Long-…

200 papers

Decentralized Multi-Agent Reinforcement Learning (MARL) methods allow for learning scalable multi-agent policies, but suffer from partial observability and induced non-stationarity. These challenges can be addressed by introducing…

Machine Learning · Computer Science 2025-08-01 Tommaso Marzi , Cesare Alippi , Andrea Cini

Large Language Models (LLMs) have demonstrated remarkable planning abilities across various domains, including robotics manipulation and navigation. While recent efforts in robotics have leveraged LLMs both for high-level and low-level…

Robotics · Computer Science 2025-08-26 Harsh Singh , Rocktim Jyoti Das , Mingfei Han , Preslav Nakov , Ivan Laptev

This work presents a Hierarchical Multi-Agent Reinforcement Learning framework for analyzing simulated air combat scenarios involving heterogeneous agents. The objective is to identify effective Courses of Action that lead to mission…

Artificial Intelligence · Computer Science 2025-05-15 Ardian Selmonaj , Oleg Szehr , Giacomo Del Rio , Alessandro Antonucci , Adrian Schneider , Michael Rüegsegger

Hierarchical agents have the potential to solve sequential decision making tasks with greater sample efficiency than their non-hierarchical counterparts because hierarchical agents can break down tasks into sets of subtasks that only…

Artificial Intelligence · Computer Science 2019-09-05 Andrew Levy , George Konidaris , Robert Platt , Kate Saenko

Enabling robots to flexibly schedule and compose learned skills for novel long-horizon manipulation under diverse perturbations remains a core challenge. Early explorations with end-to-end VLA models show limited success, as these models…

Robotics · Computer Science 2025-10-16 Yangtao Chen , Zixuan Chen , Nga Teng Chan , Junting Chen , Junhui Yin , Jieqi Shi , Yang Gao , Yong-Lu Li , Jing Huo

While showing sophisticated reasoning abilities, large language models (LLMs) still struggle with long-horizon decision-making tasks due to deficient exploration and long-term credit assignment, especially in sparse-reward scenarios.…

Artificial Intelligence · Computer Science 2025-05-27 Zican Hu , Wei Liu , Xiaoye Qu , Xiangyu Yue , Chunlin Chen , Zhi Wang , Yu Cheng

Cooperative Multi-Agent Reinforcement Learning (MARL) solves complex tasks that require coordination from multiple agents, but is often limited to either local (independent learning) or global (centralized learning) perspectives. In this…

Machine Learning · Computer Science 2026-02-26 David Eckel , Henri Meeß

While scaling individual Large Language Models (LLMs) has delivered remarkable progress, the next frontier lies in scaling collaboration through multi-agent systems (MAS). However, purely autonomous MAS remain ''closed-world'' systems,…

Artificial Intelligence · Computer Science 2026-03-10 Wei Yang , Defu Cao , Jiacheng Pang , Muyan Weng , Yan Liu

Combining Large Language Models (LLMs) with external specialized tools (LLMs+tools) is a recent paradigm to solve multimodal tasks such as Visual Question Answering (VQA). While this approach was demonstrated to work well when optimized and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Lluis Castrejon , Thomas Mensink , Howard Zhou , Vittorio Ferrari , Andre Araujo , Jasper Uijlings

Heterogeneous multirobot systems show great potential in complex tasks requiring coordinated hybrid cooperation. However, existing methods that rely on static or task-specific models often lack generalizability across diverse tasks and…

Robotics · Computer Science 2025-10-28 Haokun Liu , Zhaoqi Ma , Yunong Li , Junichiro Sugihara , Yicheng Chen , Jinjie Li , Moju Zhao

Large language models (LLMs) have shown great progress in responding to user questions, allowing for a multitude of diverse applications. Yet, the quality of LLM outputs heavily depends on the prompt design, where a good prompt might enable…

Computation and Language · Computer Science 2025-04-16 Yuchi Liu , Jaskirat Singh , Gaowen Liu , Ali Payani , Liang Zheng

Recent advances in Large Language Models (LLMs) are fostering their integration into several reasoning-related fields, including Automated Planning (AP). However, their integration into Hierarchical Planning (HP), a subfield of AP that…

Artificial Intelligence · Computer Science 2025-11-25 Israel Puerta-Merino , Carlos Núñez-Molina , Pablo Mesejo , Juan Fernández-Olivares

Long-horizon manipulation tasks such as stacking represent a longstanding challenge in the field of robotic manipulation, particularly when using reinforcement learning (RL) methods which often struggle to learn the correct sequence of…

Robotics · Computer Science 2024-07-01 Jing Zhang , Emmanuel Dean , Karinne Ramirez-Amaro

Reinforcement learning has been successful in many tasks ranging from robotic control, games, energy management etc. In complex real world environments with sparse rewards and long task horizons, sample efficiency is still a major…

Artificial Intelligence · Computer Science 2021-10-12 Bharat Prakash , Nicholas Waytowich , Tim Oates , Tinoosh Mohsenin

Large language model (LLM)-based agents exhibit strong step-by-step reasoning capabilities over short horizons, yet often fail to sustain coherent behavior over long planning horizons. We argue that this failure reflects a fundamental…

Artificial Intelligence · Computer Science 2026-02-02 Zehong Wang , Fang Wu , Hongru Wang , Xiangru Tang , Bolian Li , Zhenfei Yin , Yijun Ma , Yiyang Li , Weixiang Sun , Xiusi Chen , Yanfang Ye

This paper introduces a methodology based on agentic workflows for economic research that leverages Large Language Models (LLMs) and multimodal AI to enhance research efficiency and reproducibility. Our approach features autonomous and…

General Economics · Economics 2025-04-15 Herbert Dawid , Philipp Harting , Hankui Wang , Zhongli Wang , Jiachen Yi

Large language models (LLMs) as autonomous agents offer a novel avenue for tackling real-world challenges through a knowledge-driven manner. These LLM-enhanced methodologies excel in generalization and interpretability. However, the…

Artificial Intelligence · Computer Science 2024-07-22 Kemou Jiang , Xuan Cai , Zhiyong Cui , Aoyong Li , Yilong Ren , Haiyang Yu , Hao Yang , Daocheng Fu , Licheng Wen , Pinlong Cai

Hierarchies of temporally decoupled policies present a promising approach for enabling structured exploration in complex long-term planning problems. To fully achieve this approach an end-to-end training paradigm is needed. However,…

Machine Learning · Computer Science 2021-11-19 Abdul Rahman Kreidieh , Glen Berseth , Brandon Trabucco , Samyak Parajuli , Sergey Levine , Alexandre M. Bayen

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Large Language Models (LLMs) enable intelligent multi-robot collaboration but face fundamental trade-offs: open-loop methods that compile tasks into formal representations for external executors produce sound plans but lack adaptability in…

Artificial Intelligence · Computer Science 2026-03-10 Shaobin Ling , Yun Wang , Chenyou Fan , Tin Lun Lam , Junjie Hu