English
Related papers

Related papers: Hierarchical Learning-Enhanced MPC for Safe Crowd …

200 papers

This work is dedicated to the study of how uncertainty estimation of the human motion prediction can be embedded into constrained optimization techniques, such as Model Predictive Control (MPC) for the social robot navigation. We propose…

Robotics · Computer Science 2023-07-19 Timur Akhtyamov , Aleksandr Kashirin , Aleksey Postnikov , Gonzalo Ferrer

Long-term Human-Robot Collaboration (HRC) is crucial for enabling flexible manufacturing systems and integrating companion robots into daily human environments over extended periods. This paper identifies several key challenges for such…

Robotics · Computer Science 2025-02-05 Peiqi Yu , Abulikemu Abuduweili , Ruixuan Liu , Changliu Liu

We propose a novel hierarchical reinforcement learning framework for quadruped locomotion over challenging terrain. Our approach incorporates a two-layer hierarchy in which a high-level policy (HLP) selects optimal goals for a low-level…

Robotics · Computer Science 2025-06-26 Jeremiah Coholich , Muhammad Ali Murtaza , Seth Hutchinson , Zsolt Kira

This paper describes and analyzes a reactive navigation framework for mobile robots in unknown environments. The approach does not rely on a global map and only considers the local occupancy in its robot-centered 3D grid structure. The…

Robotics · Computer Science 2021-08-24 Neşet Ünver Akmandor , Taşkın Padır

This paper describes a hierarchical solution consisting of a multi-phase planner and a low-level safe controller to jointly solve the safe navigation problem in crowded, dynamic, and uncertain environments. The planner employs dynamic gap…

Robotics · Computer Science 2023-03-28 Hongyi Chen , Shiyu Feng , Ye Zhao , Changliu Liu , Patricio A. Vela

Hierarchical Reinforcement Learning (HRL) is well-suitedd for solving complex tasks by breaking them down into structured policies. However, HRL agents often struggle with efficient exploration and quick adaptation. To overcome these…

Machine Learning · Computer Science 2025-03-18 Arash Khajooeinejad , Fatemeh Sadat Masoumi , Masoumeh Chapariniya

Learning-based driving solution, a new branch for autonomous driving, is expected to simplify the modeling of driving by learning the underlying mechanisms from data. To improve the tactical decision-making for learning-based driving…

Robotics · Computer Science 2020-05-11 Jingke Wang , Yue Wang , Dongkun Zhang , Yezhou Yang , Rong Xiong

Signal control in urban corridors faces the dual challenge of maintaining arterial traffic progression while adapting to demand variations at local intersections. We propose a hierarchical traffic signal coordination and control scheme that…

Systems and Control · Electrical Eng. & Systems 2025-08-29 Xianyue Peng , Shenyang Chen , H. Michael Zhang

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

For autonomous vehicles, effective behavior planning is crucial to ensure safety of the ego car. In many urban scenarios, it is hard to create sufficiently general heuristic rules, especially for challenging scenarios that some new human…

Robotics · Computer Science 2020-11-11 Zhiqian Qiao , Jeff Schneider , John M. Dolan

Classical snake robot control leverages mimicking snake-like gaits tuned for specific environments. However, to operate adaptively in unstructured environments, gait generation must be dynamically scheduled. In this work, we present a…

Robotics · Computer Science 2023-12-07 Shuo Jiang , Adarsh Salagame , Alireza Ramezani , Lawson Wong

Motion generation in cluttered, dense, and dynamic environments is a central topic in robotics, rendered as a multi-objective decision-making problem. Current approaches trade-off between safety and performance. On the one hand, reactive…

Robotics · Computer Science 2024-07-30 Kay Hansel , Julen Urain , Jan Peters , Georgia Chalvatzaki

This article proposes a hierarchical learning architecture for safe data-driven control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control…

Systems and Control · Electrical Eng. & Systems 2021-07-15 Charlott Vallon , Francesco Borrelli

Humanoid robots must master numerous tasks with sparse rewards, posing a challenge for reinforcement learning (RL). We propose a method combining RL and automated planning to address this. Our approach uses short goal-conditioned policies…

Artificial Intelligence · Computer Science 2025-01-06 Gavin B. Rens

While classical approaches to autonomous robot navigation currently enable operation in certain environments, they break down in tightly constrained spaces, e.g., where the robot needs to engage in agile maneuvers to squeeze between…

Robotics · Computer Science 2021-01-21 Xuesu Xiao , Bo Liu , Garrett Warnell , Peter Stone

Safety in goal directed Reinforcement Learning (RL) settings has typically been handled through constraints over trajectories and have demonstrated good performance in primarily short horizon tasks. In this paper, we are specifically…

Artificial Intelligence · Computer Science 2024-01-10 Yuxiao Lu , Arunesh Sinha , Pradeep Varakantham

We investigate the feasibility of deploying reinforcement learning (RL) policies for constrained crowd navigation using a low-fidelity simulator. We introduce a representation of the dynamic environment, separating human and obstacle…

Robotics · Computer Science 2024-05-29 Shuijing Liu , Kaiwen Hong , Neeloy Chakraborty , Katherine Driggs-Campbell

Human navigation is facilitated through the association of actions with landmarks, tapping into our ability to recognize salient features in our environment. Consequently, navigational instructions for humans can be extremely concise, such…

There are many challenges for robot navigation in densely populated dynamic environments. This paper presents a survey of the path planning methods for robot navigation in dense environments. Particularly, the path planning in the…

Robotics · Computer Science 2021-03-23 Kuanqi Cai , Chaoqun Wang , Jiyu Cheng , Clarence W De Silva , Max Q. -H. Meng

We consider a Continual Reinforcement Learning setup, where a learning agent must continuously adapt to new tasks while retaining previously acquired skill sets, with a focus on the challenge of avoiding forgetting past gathered knowledge…

Machine Learning · Computer Science 2026-02-06 Anthony Kobanda , Rémy Portelas , Odalric-Ambrym Maillard , Ludovic Denoyer