English
Related papers

Related papers: Real-World Humanoid Locomotion with Reinforcement …

200 papers

Reproducing the diverse and agile locomotion skills of animals has been a longstanding challenge in robotics. While manually-designed controllers have been able to emulate many complex behaviors, building such controllers involves a…

Robotics · Computer Science 2020-07-22 Xue Bin Peng , Erwin Coumans , Tingnan Zhang , Tsang-Wei Lee , Jie Tan , Sergey Levine

Humanoid soccer poses a representative challenge for embodied intelligence, requiring robots to operate within a tightly coupled perception-action loop. However, existing systems typically rely on decoupled modules, resulting in delayed…

Recently, model-free reinforcement learning algorithms have been shown to solve challenging problems by learning from extensive interaction with the environment. A significant issue with transferring this success to the robotics domain is…

Artificial Intelligence · Computer Science 2017-11-30 Jake Bruce , Niko Suenderhauf , Piotr Mirowski , Raia Hadsell , Michael Milford

In recent years, reinforcement learning (RL) based quadrupedal locomotion control has emerged as an extensively researched field, driven by the potential advantages of autonomous learning and adaptation compared to traditional control…

Robotics · Computer Science 2024-10-15 Maurya Gurram , Prakash Kumar Uttam , Shantipal S. Ohol

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real…

Robotics · Computer Science 2025-06-06 Haoyu Wang , Ruyi Zhou , Liang Ding , Tie Liu , Zhelin Zhang , Peng Xu , Haibo Gao , Zongquan Deng

Deep reinforcement learning produces robust locomotion policies for legged robots over challenging terrains. To date, few studies have leveraged model-based methods to combine these locomotion skills with the precise control of…

Robotics · Computer Science 2022-01-12 Yuntao Ma , Farbod Farshidian , Takahiro Miki , Joonho Lee , Marco Hutter

While quadruped robots usually have good stability and load capacity, bipedal robots offer a higher level of flexibility / adaptability to different tasks and environments. A multi-modal legged robot can take the best of both worlds. In…

Robotics · Computer Science 2022-02-25 Chen Yu , Andre Rosendo

Multi-legged robots offer enhanced stability to navigate complex terrains with their multiple legs interacting with the environment. However, how to effectively coordinate the multiple legs in a larger action exploration space to generate…

Robotics · Computer Science 2025-11-06 Xin Liu , Jinze Wu , Yinghui Li , Chenkun Qi , Yufei Xue , Feng Gao

Current approaches to humanoid control generally fall into two paradigms: perceptive locomotion, which handles terrain well but is limited to pedal gaits, and general motion tracking, which reproduces complex skills but ignores…

Robotics · Computer Science 2026-01-13 Ziwen Zhuang , Shaoting Zhu , Mengjie Zhao , Hang Zhao

Developing robust walking controllers for bipedal robots is a challenging endeavor. Traditional model-based locomotion controllers require simplifying assumptions and careful modelling; any small errors can result in unstable control. To…

Robotics · Computer Science 2021-03-29 Zhongyu Li , Xuxin Cheng , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

Humans' ability to smoothly switch between locomotion and manipulation is a remarkable feature of sensorimotor coordination. Leaning and replication of such human-like strategies can lead to the development of more sophisticated robots…

Robotics · Computer Science 2024-02-22 Jianzhuang Zhao , Francesco Tassi , Yanlong Huang , Elena De Momi , Arash Ajoudani

As mobile robots become useful performing everyday tasks in complex real-world environments, they must be able to traverse a range of difficult terrain types such as stairs, stepping stones, gaps, jumps and narrow passages. This work…

Robotics · Computer Science 2023-03-06 Brendan Tidd

Legged robots have significant potential to operate in highly unstructured environments. The design of locomotion control is, however, still challenging. Currently, controllers must be either manually designed for specific robots and tasks,…

Robotics · Computer Science 2021-07-19 Mathias Thor , Poramate Manoonpong

Human-humanoid collaboration shows significant promise for applications in healthcare, domestic assistance, and manufacturing. While compliant robot-human collaboration has been extensively developed for robotic arms, enabling compliant…

Robotics · Computer Science 2025-10-17 Yushi Du , Yixuan Li , Baoxiong Jia , Yutang Lin , Pei Zhou , Wei Liang , Yanchao Yang , Siyuan Huang

We propose to address quadrupedal locomotion tasks using Reinforcement Learning (RL) with a Transformer-based model that learns to combine proprioceptive information and high-dimensional depth sensor inputs. While learning-based locomotion…

Machine Learning · Computer Science 2022-05-27 Ruihan Yang , Minghao Zhang , Nicklas Hansen , Huazhe Xu , Xiaolong Wang

Seeing-eye robots are very useful tools for guiding visually impaired people, potentially producing a huge societal impact given the low availability and high cost of real guide dogs. Although a few seeing-eye robot systems have already…

Robotics · Computer Science 2023-10-13 David DeFazio , Eisuke Hirota , Shiqi Zhang

Humanoid robots with behavioral autonomy have consistently been regarded as ideal collaborators in our daily lives and promising representations of embodied intelligence. Compared to fixed-based robotic arms, humanoid robots offer a larger…

Robotics · Computer Science 2024-09-04 Jin Wang , Nikos Tsagarakis

Parkour is a grand challenge for legged locomotion that requires robots to overcome various obstacles rapidly in complex environments. Existing methods can generate either diverse but blind locomotion skills or vision-based but specialized…

Animals have remarkable abilities to adapt locomotion to different terrains and tasks. However, robots trained by means of reinforcement learning are typically able to solve only a single task and a transferred policy is usually inferior to…

Robotics · Computer Science 2021-07-09 Arsen Kuzhamuratov , Dmitry Sorokin , Alexander Ulanov , A. I. Lvovsky

Humanoid robots are promising to learn a diverse set of human-like locomotion behaviors, including standing up, walking, running, and jumping. However, existing methods predominantly require training independent policies for each skill,…

Robotics · Computer Science 2026-05-07 Yingnan Zhao , Xinmiao Wang , Dewei Wang , Xinzhe Liu , Dan Lu , Qilong Han , Peng Liu , Chenjia Bai