English
Related papers

Related papers: Reinforcement Learning for Versatile, Dynamic, and…

200 papers

Deep reinforcement learning has seen successful implementations on humanoid robots to achieve dynamic walking. However, these implementations have been so far successful in simple environments void of obstacles. In this paper, we aim to…

Robotics · Computer Science 2024-10-14 Marwan Hamze , Mitsuharu Morisawa , Eiichi Yoshida

Compact quadrupedal robots are proving increasingly suitable for deployment in real-world scenarios. Their smaller size fosters easy integration into human environments. Nevertheless, real-time locomotion on uneven terrains remains…

Robotics · Computer Science 2026-02-20 Davide Plozza , Patricia Apostol , Paul Joseph , Simon Schläpfer , Michele Magno

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning…

Machine Learning · Computer Science 2019-06-20 Tuomas Haarnoja , Sehoon Ha , Aurick Zhou , Jie Tan , George Tucker , Sergey Levine

Learning locomotion skills is a challenging problem. To generate realistic and smooth locomotion, existing methods use motion capture, finite state machines or morphology-specific knowledge to guide the motion generation algorithms. Deep…

Machine Learning · Computer Science 2018-05-15 Wenhao Yu , Greg Turk , C. Karen Liu

This study introduces a robust planning framework that utilizes a model predictive control (MPC) approach, enhanced by incorporating signal temporal logic (STL) specifications. This marks the first-ever study to apply STL-guided trajectory…

Robotics · Computer Science 2024-11-20 Zhaoyuan Gu , Yuntian Zhao , Yipu Chen , Rongming Guo , Jennifer K. Leestma , Gregory S. Sawicki , Ye Zhao

Reinforcement learning (RL) has emerged as a powerful method to learn robust control policies for bipedal locomotion. Yet, it can be difficult to tune desired robot behaviors due to unintuitive and complex reward design. In comparison,…

Robotics · Computer Science 2026-03-11 Neil Janwani , Varun Madabushi , Maegan Tucker

This paper presents a scalable and adaptive control framework for legged robots that integrates Iterative Learning Control (ILC) with a biologically inspired torque library (TL), analogous to muscle memory. The proposed method addresses key…

Robotics · Computer Science 2026-04-10 Jing Cheng , Yasser G. Alqaham , Zhenyu Gan , Amit K. Sanyal

Bipedal robots, due to their anthropomorphic design, offer substantial potential across various applications, yet their control is hindered by the complexity of their structure. Currently, most research focuses on proprioception-based…

Robotics · Computer Science 2025-07-21 Fu Chen , Rui Wan , Peidong Liu , Nanxing Zheng , Bo Zhou

Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games…

Robotics · Computer Science 2021-02-08 Julian Ibarz , Jie Tan , Chelsea Finn , Mrinal Kalakrishnan , Peter Pastor , Sergey Levine

Enabling bipedal walking robots to learn how to maneuver over highly uneven, dynamically changing terrains is challenging due to the complexity of robot dynamics and interacted environments. Recent advancements in learning from…

Robotics · Computer Science 2023-09-29 Feiyang Wu , Zhaoyuan Gu , Hanran Wu , Anqi Wu , Ye Zhao

The remarkable athletic intelligence displayed by humans in complex dynamic movements such as dancing and gymnastics suggests that the balance mechanism in biological beings is decoupled from specific movement patterns. This decoupling…

Robotics · Computer Science 2024-04-15 Jiayi Li , Linqi Ye , Yi Cheng , Houde Liu , Bin Liang

We study the problem of realizing the full spectrum of bipedal locomotion on a real robot with sim-to-real reinforcement learning (RL). A key challenge of learning legged locomotion is describing different gaits, via reward functions, in a…

Robotics · Computer Science 2021-03-12 Jonah Siekmann , Yesh Godse , Alan Fern , Jonathan Hurst

To diagnose, plan, and treat musculoskeletal pathologies, understanding and reproducing muscle recruitment for complex movements is essential. With muscle activations for movements often being highly redundant, nonlinear, and time…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Emanuel Joos , Fabien Péan , Orcun Goksel

Classical control techniques such as PID and LQR have been used effectively in maintaining a system state, but these techniques become more difficult to implement when the model dynamics increase in complexity and sensitivity. For adaptive…

Machine Learning · Computer Science 2021-12-15 Jack Dibachi , Jacob Azoulay

Learning controllers that reproduce legged locomotion in nature has been a long-time goal in robotics and computer graphics. While yielding promising results, recent approaches are not yet flexible enough to be applicable to legged systems…

Robotics · Computer Science 2022-07-26 Daniel Ordonez-Apraez , Antonio Agudo , Francesc Moreno-Noguer , Mario Martin

This paper presents a novel framework for learning robust bipedal walking by combining a data-driven state representation with a Reinforcement Learning (RL) based locomotion policy. The framework utilizes an autoencoder to learn a…

Robotics · Computer Science 2023-09-28 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

Developing bipedal football robots in dynamiccombat environments presents challenges related to motionstability and deep coupling of multiple tasks, as well ascontrol switching issues between different states such as up-right walking and…

Robotics · Computer Science 2026-04-22 Yulai Zhang , Yinrong Zhang , Ting Wu , Linqi Ye

The robustness of legged locomotion is crucial for quadrupedal robots in challenging terrains. Recently, Reinforcement Learning (RL) has shown promising results in legged locomotion and various methods try to integrate privileged…

Robotics · Computer Science 2023-09-04 Jiyuan Shi , Chenjia Bai , Haoran He , Lei Han , Dong Wang , Bin Zhao , Mingguo Zhao , Xiu Li , Xuelong Li

This paper proposes an online bipedal footstep planning strategy that combines model predictive control (MPC) and reinforcement learning (RL) to achieve agile and robust bipedal maneuvers. While MPC-based foot placement controllers have…

Robotics · Computer Science 2024-07-26 Seung Hyeon Bang , Carlos Arribalzaga Jové , Luis Sentis

Deep reinforcement learning (DRL) has emerged as a promising solution to mastering explosive and versatile quadrupedal jumping skills. However, current DRL-based frameworks usually rely on pre-existing reference trajectories obtained by…

Robotics · Computer Science 2024-10-28 Vassil Atanassov , Jiatao Ding , Jens Kober , Ioannis Havoutis , Cosimo Della Santina