English
Related papers

Related papers: Mastering Multi-Drone Volleyball through Hierarchi…

200 papers

The framework of mixed observable Markov decision processes (MOMDP) models many robotic domains in which some state variables are fully observable while others are not. In this work, we identify a significant subclass of MOMDPs defined by…

Robotics · Computer Science 2022-06-07 Hai Nguyen , Zhihan Yang , Andrea Baisero , Xiao Ma , Robert Platt , Christopher Amato

We argue that hierarchical methods can become the key for modular robots achieving reconfigurability. We present a hierarchical approach for modular robots that allows a robot to simultaneously learn multiple tasks. Our evaluation results…

Robotics · Computer Science 2018-02-13 Risto Kojcev , Nora Etxezarreta , Alejandro Hernández , Víctor Mayoral

Humanoid robots must master numerous tasks with sparse rewards, posing a challenge for reinforcement learning (RL). We propose a method combining RL and automated planning to address this. Our approach uses short goal-conditioned policies…

Artificial Intelligence · Computer Science 2025-01-06 Gavin B. Rens

To improve the efficiency of warehousing system and meet huge customer orders, we aim to solve the challenges of dimension disaster and dynamic properties in hyper scale multi-robot task planning (MRTP) for robotic mobile fulfillment system…

Robotics · Computer Science 2026-05-06 Xuan Zhou , Xiang Shi , Lele Zhang , Chen Chen , Hongbo Li , Lin Ma , Fang Deng , Jie Chen

Many strategic decision-making problems, such as environment design for warehouse robots, can be naturally formulated as bi-level reinforcement learning (RL), where a leader agent optimizes its objective while a follower solves a Markov…

Machine Learning · Computer Science 2026-04-01 Mikoto Kudo , Takumi Tanabe , Akifumi Wachi , Youhei Akimoto

The coordination of multiple autonomous agents in high-speed, competitive environments represents a significant engineering challenge. This paper presents CRUISE (Curriculum-Based Iterative Self-Play for Scalable Multi-Drone Racing), a…

Robotics · Computer Science 2025-10-28 Onur Akgün

Designing intelligent microrobots that can autonomously navigate and perform instructed routines in blood vessels, a complex and crowded environment with obstacles including dense cells, different flow patterns and diverse vascular…

Soft Condensed Matter · Physics 2021-03-25 Yuguang Yang , Michael A. Bevan , Bo Li

A core challenge of multi-robot interactions is collision avoidance among robots with potentially conflicting objectives. We propose a game-theoretic method for collision avoidance based on rotating hyperplane constraints. These constraints…

Robotics · Computer Science 2023-11-17 Fernando Palafox , Yue Yu , David Fridovich-Keil

Targets search and detection encompasses a variety of decision problems such as coverage, surveillance, search, observing and pursuit-evasion along with others. In this paper we develop a multi-agent deep reinforcement learning (MADRL)…

Robotics · Computer Science 2021-03-18 Roi Yehoshua , Juan Heredia-Juesas , Yushu Wu , Christopher Amato , Jose Martinez-Lorenzo

In this paper, we present a novel developmental reinforcement learning-based controller for a quadcopter with thrust vectoring capabilities. This multirotor UAV design has tilt-enabled rotors. It utilizes the rotor force magnitude and…

Robotics · Computer Science 2020-07-16 Aditya M. Deshpande , Rumit Kumar , Ali A. Minai , Manish Kumar

The simulation-to-real gap problem and the high computational burden of whole-body Model Predictive Control (whole-body MPC) continue to present challenges in generating a wide variety of movements using whole-body MPC for real humanoid…

Robotics · Computer Science 2024-09-16 Koji Ishihara , Hiroaki Gomi , Jun Morimoto

Learning a control policy for a multi-phase, long-horizon task, such as basketball maneuvers, remains challenging for reinforcement learning approaches due to the need for seamless policy composition and transitions between skills. A…

In reinforcement learning, pre-trained low-level skills have the potential to greatly facilitate exploration. However, prior knowledge of the downstream task is required to strike the right balance between generality (fine-grained control)…

Machine Learning · Computer Science 2021-10-22 Jonas Gehring , Gabriel Synnaeve , Andreas Krause , Nicolas Usunier

In cooperative Multi-Agent Reinforcement Learning (MARL), efficient exploration is crucial for optimizing the performance of joint policy. However, existing methods often update joint policies via independent agent exploration, without…

Machine Learning · Computer Science 2025-11-18 Zejiao Liu , Junqi Tu , Yitian Hong , Luolin Xiong , Yaochu Jin , Yang Tang , Fangfei Li

We address the problem of learning hierarchical deep neural network policies for reinforcement learning. In contrast to methods that explicitly restrict or cripple lower layers of a hierarchy to force them to use higher-level modulating…

Machine Learning · Computer Science 2018-09-05 Tuomas Haarnoja , Kristian Hartikainen , Pieter Abbeel , Sergey Levine

Despite the recent successes of multi-agent reinforcement learning (MARL) algorithms, efficiently adapting to co-players in mixed-motive environments remains a significant challenge. One feasible approach is to hierarchically model…

Artificial Intelligence · Computer Science 2024-07-15 Yizhe Huang , Anji Liu , Fanqi Kong , Yaodong Yang , Song-Chun Zhu , Xue Feng

Deep Reinforcement Learning (DRL) enables robots to perform some intelligent tasks end-to-end. However, there are still many challenges for long-horizon sparse-reward robotic manipulator tasks. On the one hand, a sparse-reward setting…

Robotics · Computer Science 2021-12-07 Guangming Wang , Minjian Xin , Wenhua Wu , Zhe Liu , Hesheng Wang

Enabling humanoid robots to reliably execute complex multi-step manipulation tasks is crucial for their effective deployment in industrial and household environments. This paper presents a hierarchical planning and control framework…

Robotics · Computer Science 2025-07-11 André Schakkal , Ben Zandonati , Zhutian Yang , Navid Azizan

This paper introduces SPIRAL (Self-Play Incremental Racing Algorithm for Learning), a novel approach for training autonomous drones in multi-agent racing competitions. SPIRAL distinctively employs a self-play mechanism to incrementally…

Robotics · Computer Science 2025-11-21 Onur Akgün

It is often necessary for drones to complete delivery, photography, and rescue in the shortest time to increase efficiency. Many autonomous drone races provide platforms to pursue algorithms to finish races as quickly as possible for the…

Robotics · Computer Science 2023-06-29 Shuli Lv , Yan Gao , Jiaxing Che , Quan Quan