English
Related papers

Related papers: Learning Quadruped Locomotion Policies using Logic…

200 papers

Dynamic quadruped locomotion over challenging terrains with precise foot placements is a hard problem for both optimal control methods and Reinforcement Learning (RL). Non-linear solvers can produce coordinated constraint satisfying…

Robotics · Computer Science 2021-11-02 Philemon Brakel , Steven Bohez , Leonard Hasenclever , Nicolas Heess , Konstantinos Bousmalis

Recent advancements in legged locomotion research have made legged robots a preferred choice for navigating challenging terrains when compared to their wheeled counterparts. This paper presents a novel locomotion policy, trained using Deep…

Robotics · Computer Science 2023-05-04 Lokesh Kumar , Sarvesh Sortee , Titas Bera , Ranjan Dasgupta

Replicating the remarkable athleticism seen in animals has long been a challenge in robotics control. Although Reinforcement Learning (RL) has demonstrated significant progress in dynamic legged locomotion control, the substantial…

Robotics · Computer Science 2024-05-01 Neil Guan , Shangqun Yu , Shifan Zhu , Donghyun Kim

In this work, we introduce a control framework that combines model-based footstep planning with Reinforcement Learning (RL), leveraging desired footstep patterns derived from the Linear Inverted Pendulum (LIP) dynamics. Utilizing the LIP…

Robotics · Computer Science 2024-08-06 Ho Jae Lee , Seungwoo Hong , Sangbae Kim

Shifting from traditional control strategies to Deep Reinforcement Learning (RL) for legged robots poses inherent challenges, especially when addressing real-world physical constraints during training. While high-fidelity simulations…

Robotics · Computer Science 2023-09-28 Joonho Lee , Lukas Schroth , Victor Klemm , Marko Bjelonic , Alexander Reske , Marco Hutter

Learning-based approaches to quadruped locomotion commonly adopt generic policy architectures like fully connected MLPs. As such architectures contain few inductive biases, it is common in practice to incorporate priors in the form of…

Neurons and Cognition · Quantitative Biology 2024-10-10 Nikhil X. Bhattasali , Venkatesh Pattabiraman , Lerrel Pinto , Grace W. Lindsay

This paper proposes a novel method to improve locomotion learning for a single quadruped robot using multi-agent deep reinforcement learning (MARL). Many existing methods use single-agent reinforcement learning for an individual robot or…

Robotics · Computer Science 2024-10-18 Qi Liu , Jingxiang Guo , Sixu Lin , Shuaikang Ma , Jinxuan Zhu , Yanjie Li

We propose an architecture for learning complex controllable behaviors by having simple Policies Modulate Trajectory Generators (PMTG), a powerful combination that can provide both memory and prior knowledge to the controller. The result is…

Robotics · Computer Science 2019-10-08 Atil Iscen , Ken Caluwaerts , Jie Tan , Tingnan Zhang , Erwin Coumans , Vikas Sindhwani , Vincent Vanhoucke

Traditional RL-based locomotion controllers often suffer from low data efficiency, requiring extensive interaction to achieve robust performance. We present a model-based reinforcement learning (MBRL) framework that improves sample…

Quadruped-based mobile manipulation presents significant challenges in robotics due to the diversity of required skills, the extended task horizon, and partial observability. After presenting a multi-stage pick-and-place task as a succinct…

Robotics · Computer Science 2025-09-09 Haichao Zhang , Haonan Yu , Le Zhao , Andrew Choi , Qinxun Bai , Yiqing Yang , Wei Xu

Quadrupedal robots are increasingly deployed for load-carrying tasks across diverse terrains. While Model Predictive Control (MPC)-based methods can account for payload variations, they often depend on predefined gait schedules or…

Robotics · Computer Science 2025-05-02 Vamshi Kumar Kurva , Shishir Kolathaya

Accurate state estimation plays a critical role in ensuring the robust control of humanoid robots, particularly in the context of learning-based control policies for legged robots. However, there is a notable gap in analytical research…

Robotics · Computer Science 2024-03-12 Zhicheng Wang , Wandi Wei , Ruiqi Yu , Jun Wu , Qiuguo Zhu

Learning-based methods have proven useful at generating complex motions for robots, including humanoids. Reinforcement learning (RL) has been used to learn locomotion policies, some of which leverage a periodic reward formulation. This work…

Robotics · Computer Science 2024-09-13 William Thibault , Vidyasagar Rajendran , William Melek , Katja Mombaur

We propose a robust dynamic walking controller consisting of a dynamic locomotion planner, a reinforcement learning process for robustness, and a novel whole-body locomotion controller (WBLC). Previous approaches specify either the position…

Robotics · Computer Science 2017-08-08 Donghyun Kim , Jaemin Lee , Luis Sentis

Reinforcement learning (RL) is a popular data-driven method that has demonstrated great success in robotics. Previous works usually focus on learning an end-to-end (direct) policy to directly output joint torques. While the direct policy…

Robotics · Computer Science 2020-09-01 Kuangen Zhang , Jongwoo Lee , Zhimin Hou , Clarence W. de Silva , Chenglong Fu , Neville Hogan

This paper introduces CognitiveDog, a pioneering development of quadruped robot with Large Multi-modal Model (LMM) that is capable of not only communicating with humans verbally but also physically interacting with the environment through…

Expressive robotic behavior is essential for the widespread acceptance of robots in social environments. Recent advancements in learned legged locomotion controllers have enabled more dynamic and versatile robot behaviors. However,…

Robotics · Computer Science 2025-04-02 Jaden Clark , Joey Hejna , Dorsa Sadigh

This paper presents a state-of-the-art optimal controller for quadruped locomotion. The robot dynamics is represented using a single rigid body (SRB) model. A linear time-varying model predictive controller (LTV MPC) is proposed by using…

Robotics · Computer Science 2023-10-17 Andrew Zheng , Sriram S. K. S Narayanan

Humanoid locomotion is a key skill to bring humanoids out of the lab and into the real-world. Many motion generation methods for locomotion have been proposed including reinforcement learning (RL). RL locomotion policies offer great…

Robotics · Computer Science 2024-07-09 William Thibault , William Melek , Katja Mombaur

Reinforcement learning (RL) has shown great potential in enabling quadruped robots to perform agile locomotion. However, directly training policies to simultaneously handle dual extreme challenges, i.e., extreme underactuation and extreme…

Robotics · Computer Science 2025-07-03 Ziang Zheng , Guojian Zhan , Shiqi Liu , Yao Lyu , Tao Zhang , Shengbo Eben Li