English
Related papers

Related papers: Robust Feedback Motion Policy Design Using Reinfor…

200 papers

This work presents a hierarchical framework for bipedal locomotion that combines a Reinforcement Learning (RL)-based high-level (HL) planner policy for the online generation of task space commands with a model-based low-level (LL)…

Robotics · Computer Science 2023-09-28 Guillermo A. Castillo , Bowen Weng , Shunpeng Yang , Wei Zhang , Ayonga Hereid

We propose a control framework that integrates model-based bipedal locomotion with residual reinforcement learning (RL) to achieve robust and adaptive walking in the presence of real-world uncertainties. Our approach leverages a model-based…

Robotics · Computer Science 2026-01-23 Yashuai Yan , Tobias Egle , Christian Ott , Dongheui Lee

This paper presents a framework that leverages both control theory and machine learning to obtain stable and robust bipedal locomotion without the need for manual parameter tuning. Traditionally, gaits are generated through trajectory…

Robotics · Computer Science 2021-03-31 Maegan Tucker , Noel Csomay-Shanklin , Wen-Loong Ma , Aaron D. Ames

Reinforcement learning method is extremely competitive in gait generation techniques for quadrupedal robot, which is mainly due to the fact that stochastic exploration in reinforcement training is beneficial to achieve an autonomous gait.…

Robotics · Computer Science 2024-09-26 Yu Wang , Wenchuan Jia , Yi Sun , Dong He

Legged robots must adapt their gait to navigate unpredictable environments, a challenge that animals master with ease. However, most deep reinforcement learning (DRL) approaches to quadruped locomotion rely on a fixed gait, limiting…

Robotics · Computer Science 2025-06-24 Joseph Humphreys , Chengxu Zhou

This work aims to push the limits of agility for bipedal robots by enabling a torque-controlled bipedal robot to perform robust and versatile dynamic jumps in the real world. We present a reinforcement learning framework for training a…

Robotics · Computer Science 2023-06-02 Zhongyu Li , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

Reliable bipedal walking over complex terrain is a challenging problem, using a curriculum can help learning. Curriculum learning is the idea of starting with an achievable version of a task and increasing the difficulty as a success…

Robotics · Computer Science 2021-02-03 Brendan Tidd , Nicolas Hudson , Akansel Cosgun

Bipedal locomotion skills are challenging to develop. Control strategies often use local linearization of the dynamics in conjunction with reduced-order abstractions to yield tractable solutions. In these model-based control strategies, the…

Robotics · Computer Science 2018-07-30 Zhaoming Xie , Glen Berseth , Patrick Clary , Jonathan Hurst , Michiel van de Panne

In this paper, we describe an approach to achieve dynamic legged locomotion on physical robots which combines existing methods for control with reinforcement learning. Specifically, our goal is a control hierarchy in which highest-level…

Robotics · Computer Science 2021-03-15 Kevin Green , Yesh Godse , Jeremy Dao , Ross L. Hatton , Alan Fern , Jonathan Hurst

Classical control techniques such as PID and LQR have been used effectively in maintaining a system state, but these techniques become more difficult to implement when the model dynamics increase in complexity and sensitivity. For adaptive…

Machine Learning · Computer Science 2021-12-15 Jack Dibachi , Jacob Azoulay

Stable bipedal walking is a key prerequisite for humanoid robots to reach their potential of being versatile helpers in our everyday environments. Bipedal walking is, however, a complex motion that requires the coordination of many degrees…

Robotics · Computer Science 2020-11-06 Marcell Missura , Maren Bennewitz , Sven Behnke

In this work, we propose a learning approach for 3D dynamic bipedal walking when footsteps are constrained to stepping stones. While recent work has shown progress on this problem, real-world demonstrations have been limited to relatively…

Robotics · Computer Science 2022-05-05 Helei Duan , Ashish Malik , Mohitvishnu S. Gadde , Jeremy Dao , Alan Fern , Jonathan Hurst

We present a unified model-based and data-driven approach for quadrupedal planning and control to achieve dynamic locomotion over uneven terrain. We utilize on-board proprioceptive and exteroceptive feedback to map sensory information and…

Robotics · Computer Science 2022-05-13 Siddhant Gangapurwala , Mathieu Geisert , Romeo Orsolino , Maurice Fallon , Ioannis Havoutis

We present a reinforcement learning framework for quadrupedal wall-climbing locomotion that explicitly addresses uncertainty in magnetic foot adhesion. A physics-based adhesion model of a quadrupedal magnetic climbing robot is incorporated…

Robotics · Computer Science 2025-10-24 Yong Um , Young-Ha Shin , Joon-Ha Kim , Soonpyo Kwon , Hae-Won Park

Learning controllers that reproduce legged locomotion in nature has been a long-time goal in robotics and computer graphics. While yielding promising results, recent approaches are not yet flexible enough to be applicable to legged systems…

Robotics · Computer Science 2022-07-26 Daniel Ordonez-Apraez , Antonio Agudo , Francesc Moreno-Noguer , Mario Martin

Robust closed-loop locomotion remains challenging for soft quadruped robots due to high-dimensional dynamics, actuator hysteresis, and difficult-to-model contact interactions, while conventional proprioception provides limited information…

Robotics · Computer Science 2026-02-16 Storm de Kam , Ebrahim Shahabi , Cosimo Della Santina

Controlled execution of dynamic motions in quadrupedal robots, especially those with articulated soft bodies, presents a unique set of challenges that traditional methods struggle to address efficiently. In this study, we tackle these…

Robotics · Computer Science 2024-03-05 Francecso Vezzi , Jiatao Ding , Antonin Raffin , Jens Kober , Cosimo Della Santina

This paper presents a curriculum-based reinforcement learning framework for training precise and high-performance jumping policies for the robot `Olympus'. Separate policies are developed for vertical and horizontal jumps, leveraging a…

Robotics · Computer Science 2025-10-29 Jørgen Anker Olsen , Lars Rønhaug Pettersen , Kostas Alexis

Bipedal walking is one of the most difficult but exciting challenges in robotics. The difficulties arise from the complexity of high-dimensional dynamics, sensing and actuation limitations combined with real-time and computational…

Robotics · Computer Science 2021-06-02 Diego Rodriguez , Sven Behnke

Many methods exist for a bipedal robot to keep its balance while walking. In addition to step size and timing, other strategies are possible that influence the stability of the robot without interfering with the target direction and speed…

Robotics · Computer Science 2018-10-15 Philipp Allgeuer , Sven Behnke