English
Related papers

Related papers: Robust Dynamic Locomotion via Reinforcement Learni…

200 papers

There is a growing demand for redirected walking (RDW) techniques and their application. To apply appropriate RDW methods and manipulation, the RDW controllers are predominantly used. There are three types of RDW controllers: direct…

Machine Learning · Computer Science 2021-10-14 Yuchen Chang , Keigo Matsumoto , Takuji Narumi , Tomohiro Tanikawa , Michitaka Hirose

This paper investigates a hybrid solution which combines deep reinforcement learning (RL) and classical trajectory planning for the following in front application. Here, an autonomous robot aims to stay ahead of a person as the person…

Robotics · Computer Science 2020-11-09 Payam Nikdel , Richard Vaughan , Mo Chen

Recent advances of locomotion controllers utilizing deep reinforcement learning (RL) have yielded impressive results in terms of achieving rapid and robust locomotion across challenging terrain, such as rugged rocks, non-rigid ground, and…

Robotics · Computer Science 2024-03-07 Zifan Xu , Amir Hossain Raj , Xuesu Xiao , Peter Stone

Humanoid activities involving sequential contacts are crucial for complex robotic interactions and operations in the real world and are traditionally solved by model-based motion planning, which is time-consuming and often relies on…

Robotics · Computer Science 2024-11-08 Chong Zhang , Wenli Xiao , Tairan He , Guanya Shi

Similar to their counterparts in nature, the flexible bodies of snake-like robots enhance their movement capability and adaptability in diverse environments. However, this flexibility corresponds to a complex control task involving highly…

Robotics · Computer Science 2019-04-17 Zhenshan Bing , Christian Lemke , Zhuangyi Jiang , Kai Huang , Alois Knoll

Recently, work on reinforcement learning (RL) for bipedal robots has successfully learned controllers for a variety of dynamic gaits with robust sim-to-real demonstrations. In order to maintain balance, the learned controllers have full…

Robotics · Computer Science 2022-05-05 Helei Duan , Ashish Malik , Jeremy Dao , Aseem Saxena , Kevin Green , Jonah Siekmann , Alan Fern , Jonathan Hurst

As humanoid robots enter real-world environments, ensuring robust locomotion across diverse environments is crucial. This paper presents a computationally efficient hierarchical control framework for humanoid robot locomotion based on…

Robotics · Computer Science 2025-09-08 Adrian B. Ghansah , Sergio A. Esteban , Aaron D. Ames

Optimal Control for legged robots has gone through a paradigm shift from position-based to torque-based control, owing to the latter's compliant and robust nature. In parallel to this shift, the community has also turned to Deep…

Robotics · Computer Science 2024-09-04 Shivam Sood , Ge Sun , Peizhuo Li , Guillaume Sartoretti

Locomotion of legged machines faces the problems of model complexity and computational costs. Algorithms based on complex models and/or reinforcement learning exist to solve the walking control task. In this project, we aim to develop a…

Robotics · Computer Science 2018-05-17 Kendeas Theofanous

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

This study introduces an analytically tractable and computationally efficient model of the legged robot dynamics associated with locomotion on a dynamic rigid surface (DRS), and develops a real-time motion planner based on the proposed…

Robotics · Computer Science 2023-01-10 Amir Iqbal , Sushant Veer , Yan Gu

Legged locomotion is a complex control problem that requires both accuracy and robustness to cope with real-world challenges. Legged systems have traditionally been controlled using trajectory optimization with inverse dynamics. Such…

Robotics · Computer Science 2024-01-23 Fabian Jenelten , Junzhe He , Farbod Farshidian , Marco Hutter

In this paper, we propose a whole-body planning framework that unifies dynamic locomotion and manipulation tasks by formulating a single multi-contact optimal control problem. We model the hybrid nature of a generic multi-limbed mobile…

Robotics · Computer Science 2021-03-02 Jean-Pierre Sleiman , Farbod Farshidian , Maria Vittoria Minniti , Marco Hutter

This paper proposes a novel control framework for agile and robust bipedal locomotion, addressing model discrepancies between full-body and reduced-order models. Specifically, assumptions such as constant centroidal inertia have introduced…

Robotics · Computer Science 2024-09-17 Seung Hyeon Bang , Jaemin Lee , Carlos Gonzalez , Luis Sentis

The ability to recover from an unexpected external perturbation is a fundamental motor skill in bipedal locomotion. An effective response includes the ability to not just recover balance and maintain stability but also to fall in a safe…

Robotics · Computer Science 2022-01-06 Visak Kumar

Although bipedal locomotion provides the ability to traverse unstructured environments, it requires careful planning and control to safely walk across without falling. This poses an integrated challenge for the robot to perceive, plan, and…

Model predictive control (MPC) has shown great success for controlling complex systems such as legged robots. However, when closing the loop, the performance and feasibility of the finite horizon optimal control problem (OCP) solved at each…

Recent advancements in reinforcement learning (RL) have led to significant progress in humanoid robot locomotion, simplifying the design and training of motion policies in simulation. However, the numerous implementation details make…

Robotics · Computer Science 2025-06-19 Yushi Wang , Penghui Chen , Xinyu Han , Feng Wu , Mingguo Zhao

Quadruped robots are designed to achieve agile and robust locomotion by drawing inspiration from legged animals. However, most existing control methods for quadruped robots lack a key capacity observed in animals: the ability to exhibit…

Robotics · Computer Science 2026-03-10 Aoqian Zhang , Zixuan Zhuang , Chunzheng Wang , Shuzhi Sam Ge , Fan Shi , Cheng Xiang

We provide a framework for incorporating robustness -- to perturbations in the transition dynamics which we refer to as model misspecification -- into continuous control Reinforcement Learning (RL) algorithms. We specifically focus on…