English
Related papers

Related papers: Real-World Humanoid Locomotion with Reinforcement …

200 papers

Whole-body humanoid locomotion is challenging due to high-dimensional control, morphological instability, and the need for real-time adaptation to various terrains using onboard perception. Directly applying reinforcement learning (RL) with…

Humanoid robots, with their human-like skeletal structure, are especially suited for tasks in human-centric environments. However, this structure is accompanied by additional challenges in locomotion controller design, especially in complex…

Robotics · Computer Science 2024-08-27 Xinyang Gu , Yen-Jen Wang , Xiang Zhu , Chengming Shi , Yanjiang Guo , Yichen Liu , Jianyu Chen

In this paper we address the problem of robot movement adaptation under various environmental constraints interactively. Motion primitives are generally adopted to generate target motion from demonstrations. However, their generalization…

Robotics · Computer Science 2016-09-14 Ren Mao , John S. Baras , Yezhou Yang , Cornelia Fermuller

Humanoid robots, capable of assuming human roles in various workplaces, have become essential to embodied intelligence. However, as robots with complex physical structures, learning a control model that can operate robustly across diverse…

Robotics · Computer Science 2025-05-20 Sixu Lin , Guanren Qiao , Yunxin Tai , Ang Li , Kui Jia , Guiliang Liu

Most locomotion methods for humanoid robots focus on leg-based gaits, yet natural bipeds frequently rely on hands, knees, and elbows to establish additional contacts for stability and support in complex environments. This paper introduces…

Moving in dynamic pedestrian environments is one of the important requirements for autonomous mobile robots. We present a model-based reinforcement learning approach for robots to navigate through crowded environments. The navigation policy…

Robotics · Computer Science 2020-11-10 Yuxiang Cui , Haodong Zhang , Yue Wang , Rong Xiong

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

Robotics · Computer Science 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov

In this paper, we describe an approach to achieve dynamic legged locomotion on physical robots which combines existing methods for control with reinforcement learning. Specifically, our goal is a control hierarchy in which highest-level…

Robotics · Computer Science 2021-03-15 Kevin Green , Yesh Godse , Jeremy Dao , Ross L. Hatton , Alan Fern , Jonathan Hurst

This work introduces a robot navigation controller that combines event cameras and other sensors with reinforcement learning to enable real-time human-centered navigation and obstacle avoidance. Unlike conventional image-based controllers,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Ignacio Bugueno-Cordova , Javier Ruiz-del-Solar , Rodrigo Verschae

Animals such as rabbits and birds can instantly generate locomotion behavior in reaction to a dynamic, approaching object, such as a person or a rock, despite having possibly never seen the object before and having limited perception of the…

Robotics · Computer Science 2022-03-22 Shangqun Yu , Sreehari Rammohan , Kaiyu Zheng , George Konidaris

Control policy learning for modular robot locomotion has previously been limited to proprioceptive feedback and flat terrain. This paper develops policies for modular systems with vision traversing more challenging environments. These…

Robotics · Computer Science 2023-05-02 Julian Whitman , Howie Choset

This paper addresses the challenge of terrain-adaptive dynamic locomotion in humanoid robots, a problem traditionally tackled by optimization-based methods or reinforcement learning (RL). Optimization-based methods, such as model-predictive…

Robotics · Computer Science 2024-07-30 Shangqun Yu , Nisal Perera , Daniel Marew , Donghyun Kim

Deep Reinforcement Learning (RL) has emerged as a promising method to develop humanoid robot locomotion controllers. Despite the robust and stable locomotion demonstrated by previous RL controllers, their behavior often lacks the natural…

Robotics · Computer Science 2025-02-06 Qiyuan Zhang , Chenfan Weng , Guanwu Li , Fulai He , Yusheng Cai

Control of wheeled humanoid locomotion is a challenging problem due to the nonlinear dynamics and under-actuated characteristics of these robots. Traditionally, feedback controllers have been utilized for stabilization and locomotion.…

Robotics · Computer Science 2022-04-08 Donghoon Baek , Amartya Purushottam , Joao Ramos

Humanoid robots have the promise of locomoting like humans, including fast and dynamic running. Recently, reinforcement learning (RL) controllers that can mimic human motions have become popular as they can generate very dynamic behaviors,…

Robotics · Computer Science 2026-03-30 Zachary Olkin , William D. Compton , Ryan M. Bena , Aaron D. Ames

Enabling robots to autonomously perform hybrid motions in diverse environments can be beneficial for long-horizon tasks such as material handling, household chores, and work assistance. This requires extensive exploitation of intrinsic…

Robotics · Computer Science 2024-08-19 Jin Wang , Rui Dai , Weijie Wang , Luca Rossini , Francesco Ruscelli , Nikos Tsagarakis

Recent advances in deep reinforcement learning (RL) based techniques combined with training in simulation have offered a new approach to developing robust controllers for legged robots. However, the application of such approaches to real…

Robotics · Computer Science 2023-08-08 Rohan Pratap Singh , Zhaoming Xie , Pierre Gergondet , Fumio Kanehiro

Whole-body control for humanoids is challenging due to the high-dimensional nature of the problem, coupled with the inherent instability of a bipedal morphology. Learning from visual observations further exacerbates this difficulty. In this…

Machine Learning · Computer Science 2025-05-16 Nicklas Hansen , Jyothir S , Vlad Sobal , Yann LeCun , Xiaolong Wang , Hao Su

We address the longstanding challenge of producing flexible, realistic humanoid character controllers that can perform diverse whole-body tasks involving object interactions. This challenge is central to a variety of fields, from graphics…

Artificial Intelligence · Computer Science 2020-06-17 Josh Merel , Saran Tunyasuvunakool , Arun Ahuja , Yuval Tassa , Leonard Hasenclever , Vu Pham , Tom Erez , Greg Wayne , Nicolas Heess

Modern Reinforcement Learning (RL) algorithms promise to solve difficult motor control problems directly from raw sensory inputs. Their attraction is due in part to the fact that they can represent a general class of methods that allow to…