English
Related papers

Related papers: Gait-Conditioned Reinforcement Learning with Multi…

200 papers

Humanoid robots have attracted significant attention in recent years. Reinforcement Learning (RL) is one of the main ways to control the whole body of humanoid robots. RL enables agents to complete tasks by learning from environment…

Robotics · Computer Science 2025-03-31 Xianqi Zhang , Hongliang Wei , Wenrui Wang , Xingtao Wang , Xiaopeng Fan , Debin Zhao

Interaction is one of the core abilities of humanoid robots. However, most existing frameworks focus on non-interactive whole-body control, which limits their practical applicability. In this work, we develop InterReal, a unified…

Robotics · Computer Science 2026-03-10 Dayang Liang , Yuhang Lin , Xinzhe Liu , Jiyuan Shi , Yunlong Liu , Chenjia Bai

Humanoid robots that can autonomously operate in diverse environments have the potential to help address labour shortages in factories, assist elderly at homes, and colonize new planets. While classical controllers for humanoid robots have…

Robotics · Computer Science 2023-12-15 Ilija Radosavovic , Tete Xiao , Bike Zhang , Trevor Darrell , Jitendra Malik , Koushil Sreenath

Learning a locomotion controller for a musculoskeletal system is challenging due to over-actuation and high-dimensional action space. While many reinforcement learning methods attempt to address this issue, they often struggle to learn…

Robotics · Computer Science 2024-07-17 Henri-Jacques Geiß , Firas Al-Hafez , Andre Seyfarth , Jan Peters , Davide Tateo

Developing agile behaviors for legged robots remains a challenging problem. While deep reinforcement learning is a promising approach, learning truly agile behaviors typically requires tedious reward shaping and careful curriculum design.…

Robotics · Computer Science 2020-11-12 Atil Iscen , George Yu , Alejandro Escontrela , Deepali Jain , Jie Tan , Ken Caluwaerts

This paper proposes a modular framework to generate robust biped locomotion using a tight coupling between an analytical walking approach and deep reinforcement learning. This framework is composed of six main modules which are…

Robotics · Computer Science 2021-12-23 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis

We present a unified framework for multi-task locomotion and manipulation policy learning grounded in a contact-explicit representation. Instead of designing different policies for different tasks, our approach unifies the definition of a…

Robotics · Computer Science 2026-05-05 Shafeef Omar , Majid Khadiv

Humanoid robots have the potential to mimic human motions with high visual fidelity, yet translating these motions into practical, physical execution remains a significant challenge. Existing techniques in the graphics community often…

Robotics · Computer Science 2025-02-18 Yashuai Yan , Esteve Valls Mascaro , Tobias Egle , Dongheui Lee

This paper presents a method for achieving high-speed running of a quadruped robot by considering the actuator torque-speed operating region in reinforcement learning. The physical properties and constraints of the actuator are included in…

Robotics · Computer Science 2024-01-01 Young-Ha Shin , Tae-Gyu Song , Gwanghyeon Ji , Hae-Won Park

Humanoid robots promise transformative capabilities for industrial and service applications. While recent advances in Reinforcement Learning (RL) yield impressive results in locomotion, manipulation, and navigation, the proposed methods…

Robotics · Computer Science 2025-08-12 Feiyang Wu , Xavier Nal , Jaehwi Jang , Wei Zhu , Zhaoyuan Gu , Anqi Wu , Ye Zhao

Learning-based methods have proven useful at generating complex motions for robots, including humanoids. Reinforcement learning (RL) has been used to learn locomotion policies, some of which leverage a periodic reward formulation. This work…

Robotics · Computer Science 2024-09-13 William Thibault , Vidyasagar Rajendran , William Melek , Katja Mombaur

Developing robust walking controllers for bipedal robots is a challenging endeavor. Traditional model-based locomotion controllers require simplifying assumptions and careful modelling; any small errors can result in unstable control. To…

Robotics · Computer Science 2021-03-29 Zhongyu Li , Xuxin Cheng , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

High-speed legged locomotion struggles with stability and transfer losses at higher command velocities during deployment. One reason is that most curricula vary difficulty along single axis, for example increase the range of command…

Robotics · Computer Science 2026-03-17 Prakhar Mishra , Amir Hossain Raj , Xuesu Xiao , Dinesh Manocha

Quadrupedal robots are increasingly deployed for load-carrying tasks across diverse terrains. While Model Predictive Control (MPC)-based methods can account for payload variations, they often depend on predefined gait schedules or…

Robotics · Computer Science 2025-05-02 Vamshi Kumar Kurva , Shishir Kolathaya

Generating dynamic motions for legged robots remains a challenging problem. While reinforcement learning has achieved notable success in various legged locomotion tasks, producing highly dynamic behaviors often requires extensive reward…

Robotics · Computer Science 2026-01-01 Dongyun Kang , Min-Gyu Kim , Tae-Gyu Song , Hajun Kim , Sehoon Ha , Hae-Won Park

Humanoid robots are expected to operate in human-centered environments where safe and natural physical interaction is essential. However, most recent reinforcement learning (RL) policies emphasize rigid tracking and suppress external…

Robotics · Computer Science 2025-11-07 Qingzhou Lu , Yao Feng , Baiyu Shi , Michael Piseno , Zhenan Bao , C. Karen Liu

Quadruped animals seamlessly transition between gaits as they change locomotion speeds. While the most widely accepted explanation for gait transitions is energy efficiency, there is no clear consensus on the determining factor, nor on the…

Robotics · Computer Science 2023-06-16 Milad Shafiee , Guillaume Bellegarda , Auke Ijspeert

Humanoid robots encounter considerable difficulties in autonomously recovering from falls, especially within dynamic and unstructured environments. Conventional control methodologies are often inadequate in addressing the complexities…

Robotics · Computer Science 2025-03-03 Penghui Chen , Yushi Wang , Changsheng Luo , Wenhan Cai , Mingguo Zhao

Humanoid robots hold great potential for diverse interactions and daily service tasks within human-centered environments, necessitating controllers that seamlessly integrate precise locomotion with dexterous manipulation. However, most…

Robotics · Computer Science 2026-01-27 Xinru Cui , Linxi Feng , Yixuan Zhou , Haoqi Han , Zhe Liu , Hesheng Wang

Deep Reinforcement Learning is a promising tool for robotic control, yet practical application is often hindered by the difficulty of designing effective reward functions. Real-world tasks typically require optimizing multiple objectives…

Machine Learning · Computer Science 2026-03-06 Kilian Freitag , Knut Åkesson , Morteza Haghir Chehreghani