English
Related papers

Related papers: Learning Humanoid Locomotion with World Model Reco…

200 papers

Compact quadrupedal robots are proving increasingly suitable for deployment in real-world scenarios. Their smaller size fosters easy integration into human environments. Nevertheless, real-time locomotion on uneven terrains remains…

Robotics · Computer Science 2026-02-20 Davide Plozza , Patricia Apostol , Paul Joseph , Simon Schläpfer , Michele Magno

Legged robots are becoming increasingly powerful and popular in recent years for their potential to bring the mobility of autonomous agents to the next level. This work presents a deep reinforcement learning approach that learns a robust…

Robotics · Computer Science 2021-09-10 Zhaocheng Liu , Fernando Acero , Zhibin Li

Moving in dynamic pedestrian environments is one of the important requirements for autonomous mobile robots. We present a model-based reinforcement learning approach for robots to navigate through crowded environments. The navigation policy…

Robotics · Computer Science 2020-11-10 Yuxiang Cui , Haodong Zhang , Yue Wang , Rong Xiong

Humans exhibit diverse and expressive whole-body movements. However, attaining human-like whole-body coordination in humanoid robots remains challenging, as conventional approaches that mimic whole-body motions often neglect the distinct…

Robotics · Computer Science 2025-10-28 Jiyuan Shi , Xinzhe Liu , Dewei Wang , Ouyang Lu , Sören Schwertfeger , Chi Zhang , Fuchun Sun , Chenjia Bai , Xuelong Li

We introduce Reduced-Order Model-Guided Reinforcement Learning (ROM-GRL), a two-stage reinforcement learning framework for humanoid walking that requires no motion capture data or elaborate reward shaping. In the first stage, a compact…

Robotics · Computer Science 2025-09-24 Shuai Liu , Meng Cheng Lau

Model-based approaches for planning and control for bipedal locomotion have a long history of success. It can provide stability and safety guarantees while being effective in accomplishing many locomotion tasks. Model-free reinforcement…

Robotics · Computer Science 2023-10-17 Yu-Ming Chen , Hien Bui , Michael Posa

Achieving safe quadrupedal locomotion in real-world environments has attracted much attention in recent years. When walking over uneven terrain, achieving reliable estimation and realising safety-critical control based on the obtained…

Robotics · Computer Science 2026-03-11 Peiyu Yang , Jiatao Ding , Wei Pan , Claudio Semini , Cosimo Della Santina

Most autonomous navigation systems assume wheeled robots are rigid bodies and their 2D planar workspaces can be divided into free spaces and obstacles. However, recent wheeled mobility research, showing that wheeled platforms have the…

Robotics · Computer Science 2023-09-26 Aniket Datar , Chenhui Pan , Xuesu Xiao

Training perceptive humanoid locomotion policies that traverse complex terrains with natural gaits remains an open challenge, typically demanding multi-stage training pipelines, adversarial objectives, or extensive real-world calibration.…

Robotics · Computer Science 2026-03-20 Chenxi Han , Shilu He , Yi Cheng , Linqi Ye , Houde Liu

Previous studies have successfully demonstrated agile and robust locomotion in challenging terrains for quadrupedal robots. However, the bipedal locomotion mode for quadruped robots remains unverified. This paper explores the adaptation of…

A necessary capability for humanoid robots is the ability to stand and walk while rejecting natural disturbances. Recent progress has been made using sim-to-real reinforcement learning (RL) to train such locomotion controllers, with…

Robotics · Computer Science 2024-09-02 Bart van Marum , Aayam Shrestha , Helei Duan , Pranay Dugar , Jeremy Dao , Alan Fern

This paper introduces a framework for state estimation on a humanoid robot platform using only common proprioceptive sensors and knowledge of leg kinematics. The presented approach extends that detailed in [1] on a quadruped platform by…

Robotics · Computer Science 2014-12-11 Nicholas Rotella , Michael Bloesch , Ludovic Righetti , Stefan Schaal

Navigating human-populated environments without causing discomfort is a critical capability for socially-aware agents. While rule-based approaches offer interpretability through predefined psychological principles, they often lack…

Artificial Intelligence · Computer Science 2025-11-17 Yitian Kou , Yihe Gu , Chen Zhou , DanDan Zhu , Shuguang Kuai

We cast real-world humanoid control as a next token prediction problem, akin to predicting the next word in language. Our model is a causal transformer trained via autoregressive prediction of sensorimotor trajectories. To account for the…

Achieving highly dynamic humanoid parkour on unseen, complex terrains remains a challenge in robotics. Although general locomotion policies demonstrate capabilities across broad terrain distributions, they often struggle with arbitrary and…

Robotics · Computer Science 2026-02-03 Shaoting Zhu , Baijun Ye , Jiaxuan Wang , Jiakang Chen , Ziwen Zhuang , Linzhan Mou , Runhan Huang , Hang Zhao

We propose a method of learning a policy for human-like locomotion via deep reinforcement learning based on a human anatomical model, muscle actuation, and biologically inspired rewards, without any inherent control rules or reference…

Graphics · Computer Science 2024-01-30 Minkwan Kim , Yoonsang Lee

The performance of legged locomotion is closely tied to the accuracy and comprehensiveness of state observations. Blind policies, which rely solely on proprioception, are considered highly robust due to the reliability of proprioceptive…

Robotics · Computer Science 2025-06-03 Junli Ren , Tao Huang , Huayi Wang , Zirui Wang , Qingwei Ben , Junfeng Long , Yanchao Yang , Jiangmiao Pang , Ping Luo

Wheeled bipedal robots have garnered increasing attention in exploration and inspection. However, most research simplifies calculations by ignoring leg dynamics, thereby restricting the robot's full motion potential. Additionally, robots…

Robotics · Computer Science 2025-11-11 Cong Wen , Yunfei Li , Kexin Liu , Yixin Qiu , Xuanhong Liao , Tianyu Wang , Dingchuan Liu , Tao Zhang , Ximin Lyu

Autonomous mobile robots need to perceive the environments with their onboard sensors (e.g., LiDARs and RGB cameras) and then make appropriate navigation decisions. In order to navigate human-inhabited public spaces, such a navigation task…

Robotics · Computer Science 2023-09-25 Bhabaranjan Panigrahi , Amir Hossain Raj , Mohammad Nazeri , Xuesu Xiao

Hybrid locomotion of wheeled-legged robots has recently attracted increasing attention due to their advantages of combining the agility of legged locomotion and the efficiency of wheeled motion. But along with expanded performance, the…

Robotics · Computer Science 2025-10-14 Jingyuan Sun , Hongyu Ji , Zihan Qu , Chaoran Wang , Mingyu Zhang