English
Related papers

Related papers: Reinforcement Learning for Robust Parameterized Lo…

200 papers

This work presents a hierarchical framework for bipedal locomotion that combines a Reinforcement Learning (RL)-based high-level (HL) planner policy for the online generation of task space commands with a model-based low-level (LL)…

Robotics · Computer Science 2023-09-28 Guillermo A. Castillo , Bowen Weng , Shunpeng Yang , Wei Zhang , Ayonga Hereid

Not until recently, robust robot locomotion has been achieved by deep reinforcement learning (DRL). However, for efficient learning of parametrized bipedal walking, developed references are usually required, limiting the performance to that…

Robotics · Computer Science 2021-12-14 Chong Zhang , Qi Wu , Liqian Ma , Hongyuan Su

The ability to recover from a fall is an essential feature for a legged robot to navigate in challenging environments robustly. Until today, there has been very little progress on this topic. Current solutions mostly build upon…

Robotics · Computer Science 2024-12-20 Joonho Lee , Jemin Hwangbo , Marco Hutter

Quadrupedal robots are increasingly deployed for load-carrying tasks across diverse terrains. While Model Predictive Control (MPC)-based methods can account for payload variations, they often depend on predefined gait schedules or…

Robotics · Computer Science 2025-05-02 Vamshi Kumar Kurva , Shishir Kolathaya

Model-free reinforcement learning is a promising approach for autonomously solving challenging robotics control problems, but faces exploration difficulty without information of the robot's kinematics and dynamics morphology. The…

Pedipulation leverages the feet of legged robots for mobile manipulation, eliminating the need for dedicated robotic arms. While previous works have showcased blind and task-specific pedipulation skills, they fail to account for static and…

Robotics · Computer Science 2024-11-05 Jonas Stolle , Philip Arm , Mayank Mittal , Marco Hutter

Domain randomization has emerged as a fundamental technique in reinforcement learning (RL) to facilitate the transfer of policies from simulation to real-world robotic applications. Many existing domain randomization approaches have been…

Legged robots must adapt their gait to navigate unpredictable environments, a challenge that animals master with ease. However, most deep reinforcement learning (DRL) approaches to quadruped locomotion rely on a fixed gait, limiting…

Robotics · Computer Science 2025-06-24 Joseph Humphreys , Chengxu Zhou

Reinforcement learning (RL) has become a promising approach to developing controllers for quadrupedal robots. Conventionally, an RL design for locomotion follows a position-based paradigm, wherein an RL policy outputs target joint positions…

Robotics · Computer Science 2023-03-14 Shuxiao Chen , Bike Zhang , Mark W. Mueller , Akshara Rai , Koushil Sreenath

Quadrupedal robots hold promising potential for applications in navigating cluttered environments with resilience akin to their animal counterparts. However, their floating base configuration makes them vulnerable to real-world…

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real…

Robotics · Computer Science 2025-06-06 Haoyu Wang , Ruyi Zhou , Liang Ding , Tie Liu , Zhelin Zhang , Peng Xu , Haibo Gao , Zongquan Deng

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning…

Machine Learning · Computer Science 2019-06-20 Tuomas Haarnoja , Sehoon Ha , Aurick Zhou , Jie Tan , George Tucker , Sergey Levine

Designing a stabilizing controller for nonlinear systems is a challenging task, especially for high-dimensional problems with unknown dynamics. Traditional reinforcement learning algorithms applied to stabilization tasks tend to drive the…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Thanin Quartz , Ruikun Zhou , Hans De Sterck , Jun Liu

Several recently released humanoid robots, inspired by the mechanical design of Cassie, employ actuator configurations in which the motors are displaced from the joints to reduce leg inertia. While studies accounting for the full kinematic…

Robotics · Computer Science 2025-10-09 Victor Lutz , Ludovic de Matteis , Virgile Batto , Nicolas Mansard

Motivated towards achieving multi-modal locomotion, in this paper, we develop a framework for a bipedal robot to dynamically ride a pair of Hovershoes over various terrain. Our developed control strategy enables the Cassie bipedal robot to…

Robotics · Computer Science 2019-09-24 Shuxiao Chen , Jonathan Rogers , Bike Zhang , Koushil Sreenath

We present a model-based framework for robot locomotion that achieves walking based on only 4.5 minutes (45,000 control steps) of data collected on a quadruped robot. To accurately model the robot's dynamics over a long horizon, we…

Machine Learning · Computer Science 2019-10-08 Yuxiang Yang , Ken Caluwaerts , Atil Iscen , Tingnan Zhang , Jie Tan , Vikas Sindhwani

Knowledge from animals and humans inspires robotic innovations. Numerous efforts have been made to achieve agile locomotion in quadrupedal robots through classical controllers or reinforcement learning approaches. These methods usually rely…

Intelligent control of soft robots is challenging due to the nonlinear and difficult-to-model dynamics. One promising model-free approach for soft robot control is reinforcement learning (RL). However, model-free RL methods tend to be…

Robotics · Computer Science 2023-07-11 Xuan Liu , Cagdas Onal , Jie Fu

This paper introduces a new approach to enhance the robustness of humanoid walking under strong perturbations, such as substantial pushes. Effective recovery from external disturbances requires bipedal robots to dynamically adjust their…

Robotics · Computer Science 2024-11-05 Tobias Egle , Yashuai Yan , Dongheui Lee , Christian Ott

Learning human-like, robust bipedal walking remains difficult due to hybrid dynamics and terrain variability. We propose a lightweight framework that combines a gait generator network learned from human motion with Proximal Policy…

Robotics · Computer Science 2025-11-24 Yusuf Baran Ates , Omer Morgul