English
Related papers

Related papers: HierKick: Hierarchical Reinforcement Learning for …

200 papers

Hierarchical reinforcement learning (HRL) holds great potential for sample-efficient learning on challenging long-horizon tasks. In particular, letting a higher level assign subgoals to a lower level has been shown to enable fast learning…

Machine Learning · Computer Science 2021-12-07 Nico Gürtler , Dieter Büchler , Georg Martius

Animals such as rabbits and birds can instantly generate locomotion behavior in reaction to a dynamic, approaching object, such as a person or a rock, despite having possibly never seen the object before and having limited perception of the…

Robotics · Computer Science 2022-03-22 Shangqun Yu , Sreehari Rammohan , Kaiyu Zheng , George Konidaris

Urban search and rescue missions require rapid first response to minimize loss of life and damage. Often, such efforts are assisted by humanitarian robots which need to handle dynamic operational conditions such as uneven and rough…

Robotics · Computer Science 2024-01-09 Nishaant Shah , Kshitij Tiwari , Aniket Bera

A key challenge in contact-rich dexterous manipulation is the need to jointly reason over geometry, kinematic constraints, and intricate, nonsmooth contact dynamics. End-to-end visuomotor policies bypass this structure, but often require…

Robotics · Computer Science 2026-01-26 Zhixian Xie , Yu Xiang , Michael Posa , Wanxin Jin

Dynamic ball-interaction tasks remain challenging for robots because they require tight perception-action coupling under limited reaction time. This challenge is especially pronounced in humanoid racket sports, where successful interception…

Robotics · Computer Science 2026-03-17 Peng Ren , Chuan Qi , Haoyang Ge , Qiyuan Su , Xuguo He , Cong Huang , Pei Chi , Jiang Zhao , Kai Chen

Enabling humanoid robots to reliably execute complex multi-step manipulation tasks is crucial for their effective deployment in industrial and household environments. This paper presents a hierarchical planning and control framework…

Robotics · Computer Science 2025-07-11 André Schakkal , Ben Zandonati , Zhutian Yang , Navid Azizan

Deep reinforcement learning (DRL) has achieved super-human performance on complex video games (e.g., StarCraft II and Dota II). However, current DRL systems still suffer from challenges of multi-agent coordination, sparse rewards,…

Artificial Intelligence · Computer Science 2021-12-01 Shiyu Huang , Wenze Chen , Longfei Zhang , Shizhen Xu , Ziyang Li , Fengming Zhu , Deheng Ye , Ting Chen , Jun Zhu

Advancing the dynamic loco-manipulation capabilities of quadruped robots in complex terrains is crucial for performing diverse tasks. Specifically, dynamic ball manipulation in rugged environments presents two key challenges. The first is…

Robotics · Computer Science 2025-04-22 Dongjie Zhu , Zhuo Yang , Tianhang Wu , Luzhou Ge , Xuesong Li , Qi Liu , Xiang Li

Long-term Human-Robot Collaboration (HRC) is crucial for enabling flexible manufacturing systems and integrating companion robots into daily human environments over extended periods. This paper identifies several key challenges for such…

Robotics · Computer Science 2025-02-05 Peiqi Yu , Abulikemu Abuduweili , Ruixuan Liu , Changliu Liu

In swarm robotics, confrontation including the pursuit-evasion game is a key scenario. High uncertainty caused by unknown opponents' strategies, dynamic obstacles, and insufficient training complicates the action space into a hybrid…

Robotics · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen , Jinhu Lü

Dexterous manipulation tasks usually have multiple objectives, and the priorities of these objectives may vary at different phases of a manipulation task. Varying priority makes a robot hardly or even failed to learn an optimal policy with…

Robotics · Computer Science 2023-09-15 Lingfeng Tao , Jiucai Zhang , Xiaoli Zhang

This paper presents a technique to train a robot to perform kick-motion in AI soccer by using reinforcement learning (RL). In RL, an agent interacts with an environment and learns to choose an action in a state at each step. When training…

Robotics · Computer Science 2022-12-02 Bumgeun Park , Jihui Lee , Taeyoung Kim , Dongsoo Har

Hierarchical reinforcement learning (HRL) is hypothesized to be able to leverage the inherent hierarchy in learning tasks where traditional reinforcement learning (RL) often fails. In this research, HRL is evaluated and contrasted with…

Artificial Intelligence · Computer Science 2025-08-20 Brendon Johnson , Alfredo Weitzenfeld

Mobile manipulators are envisioned to serve more complex roles in people's everyday lives. With recent breakthroughs in large language models, task planners have become better at translating human verbal instructions into a sequence of…

Robotics · Computer Science 2026-03-12 Xintong Du , Siqi Zhou , Angela P. Schoellig

This work presents a hierarchical framework for bipedal locomotion that combines a Reinforcement Learning (RL)-based high-level (HL) planner policy for the online generation of task space commands with a model-based low-level (LL)…

Robotics · Computer Science 2023-09-28 Guillermo A. Castillo , Bowen Weng , Shunpeng Yang , Wei Zhang , Ayonga Hereid

The design of feedback controllers for bipedal robots is challenging due to the hybrid nature of its dynamics and the complexity imposed by high-dimensional bipedal models. In this paper, we present a novel approach for the design of…

Robotics · Computer Science 2018-10-05 Guillermo A. Castillo , Bowen Weng , Ayonga Hereid , Wei Zhang

Hierarchical reinforcement learning (HRL) is a promising approach to extend traditional reinforcement learning (RL) methods to solve more complex tasks. Yet, the majority of current HRL methods require careful task-specific design and…

Machine Learning · Computer Science 2018-10-08 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

RoboCup represents an International testbed for advancing research in AI and robotics, focusing on a definite goal: developing a robot team that can win against the human world soccer champion team by the year 2050. To achieve this goal,…

Autonomous vehicles need to handle various traffic conditions and make safe and efficient decisions and maneuvers. However, on the one hand, a single optimization/sampling-based motion planner cannot efficiently generate safe trajectories…

Robotics · Computer Science 2021-06-10 Jinning Li , Liting Sun , Jianyu Chen , Masayoshi Tomizuka , Wei Zhan

The simulation-to-real gap problem and the high computational burden of whole-body Model Predictive Control (whole-body MPC) continue to present challenges in generating a wide variety of movements using whole-body MPC for real humanoid…

Robotics · Computer Science 2024-09-16 Koji Ishihara , Hiroaki Gomi , Jun Morimoto