English
Related papers

Related papers: Model-Based Reinforcement Learning Exploits Passiv…

200 papers

Recently, humanoid robots have made significant advances in their ability to perform challenging tasks due to the deployment of Reinforcement Learning (RL), however, the inherent complexity of humanoid robots, including the difficulty of…

Achieving stable and robust perceptive locomotion for bipedal robots in unstructured outdoor environments remains a critical challenge due to complex terrain geometry and susceptibility to external disturbances. In this work, we propose a…

Robotics · Computer Science 2025-10-21 Haokai Su , Haoxiang Luo , Shunpeng Yang , Kaiwen Jiang , Wei Zhang , Hua Chen

Imitation learning has been actively studied in recent years. In particular, skill acquisition by a robot with a fixed body, whose root link position and posture and camera angle of view do not change, has been realized in many cases. On…

Robotics · Computer Science 2023-12-19 Yutaro Matsuura , Kento Kawaharazuka , Naoki Hiraoka , Kunio Kojima , Kei Okada , Masayuki Inaba

Balancing and push-recovery are essential capabilities enabling humanoid robots to solve complex locomotion tasks. In this context, classical control systems tend to be based on simplified physical models and hard-coded strategies. Although…

Modern quadrupeds are skillful in traversing or even sprinting on uneven terrains in a remote uncontrolled environment. However, survival in the wild requires not only maneuverability, but also the ability to handle potential critical…

Robotics · Computer Science 2024-10-28 Dikai Liu , Tianwei Zhang , Jianxiong Yin , Simon See

Legged robots have the potential to traverse complex terrain and access confined spaces beyond the reach of traditional platforms thanks to their ability to carefully select footholds and flexibly adapt their body posture while walking.…

Robotics · Computer Science 2024-03-04 Takahiro Miki , Joonho Lee , Lorenz Wellhausen , Marco Hutter

Model free reinforcement learning suffers from the high sampling complexity inherent to robotic manipulation or locomotion tasks. Most successful approaches typically use random sampling strategies which leads to slow policy convergence. In…

Robotics · Computer Science 2019-08-13 Miroslav Bogdanovic , Ludovic Righetti

Dynamic walking on bipedal robots has evolved from an idea in science fiction to a practical reality. This is due to continued progress in three key areas: a mathematical understanding of locomotion, the computational ability to encode this…

Robotics · Computer Science 2020-10-16 Jenna Reher , Aaron D. Ames

Legged robots are promising candidates for exploring challenging areas on low-gravity bodies such as the Moon, Mars, or asteroids, thanks to their advanced mobility on unstructured terrain. However, as planetary robots' power and thermal…

Robotics · Computer Science 2025-11-17 Philip Arm , Oliver Fischer , Joseph Church , Adrian Fuhrer , Hendrik Kolvenbach , Marco Hutter

This paper addresses the challenge of terrain-adaptive dynamic locomotion in humanoid robots, a problem traditionally tackled by optimization-based methods or reinforcement learning (RL). Optimization-based methods, such as model-predictive…

Robotics · Computer Science 2024-07-30 Shangqun Yu , Nisal Perera , Daniel Marew , Donghyun Kim

Shifting from traditional control strategies to Deep Reinforcement Learning (RL) for legged robots poses inherent challenges, especially when addressing real-world physical constraints during training. While high-fidelity simulations…

Robotics · Computer Science 2023-09-28 Joonho Lee , Lukas Schroth , Victor Klemm , Marko Bjelonic , Alexander Reske , Marco Hutter

Model-based Bayesian reinforcement learning has generated significant interest in the AI community as it provides an elegant solution to the optimal exploration-exploitation tradeoff in classical reinforcement learning. Unfortunately, the…

Artificial Intelligence · Computer Science 2012-06-18 Stephane Ross , Joelle Pineau

The design of feedback controllers for bipedal robots is challenging due to the hybrid nature of its dynamics and the complexity imposed by high-dimensional bipedal models. In this paper, we present a novel approach for the design of…

Robotics · Computer Science 2018-10-05 Guillermo A. Castillo , Bowen Weng , Ayonga Hereid , Wei Zhang

Inspired by the necessity of morphological adaptation in animals, a growing body of work has attempted to expand robot training to encompass physical aspects of a robot's design. However, reinforcement learning methods capable of optimizing…

Robotics · Computer Science 2024-03-05 Muhan Li , David Matthews , Sam Kriegman

Salamander-like quadruped robots are designed inspired by the skeletal structure of their biological counterparts. However, existing controllers cannot fully exploit these morphological features and largely rely on predefined gait patterns…

Robotics · Computer Science 2025-11-12 Zhiang Liu , Yang Liu , Yongchun Fang , Xian Guo

Autonomous robots require high degrees of cognitive and motoric intelligence to come into our everyday life. In non-structured environments and in the presence of uncertainties, such degrees of intelligence are not easy to obtain.…

Developing a framework for the locomotion of a six-legged robot or a hexapod is a complex task that has extensive hardware and computational requirements. In this paper, we present a bio-inspired framework for the locomotion of a hexapod.…

Robotics · Computer Science 2021-07-28 Advait Lonkar , Sarthak Khoche , Shrisha Rao

Quadruped robots have shown remarkable mobility on various terrains through reinforcement learning. Yet, in the presence of sparse footholds and risky terrains such as stepping stones and balance beams, which require precise foot placement…

Robotics · Computer Science 2024-08-12 Chong Zhang , Nikita Rudin , David Hoeller , Marco Hutter

Bounding is one of the important gaits in quadrupedal locomotion for negotiating obstacles. The authors proposed an effective approach that can learn robust bounding gaits more efficiently despite its large variation in dynamic body…

Robotics · Computer Science 2023-10-31 Zhicheng Wang , Anqiao Li , Yixiao Zheng , Anhuan Xie , Zhibin Li , Jun Wu , Qiuguo Zhu

Although commonly associated with limbless animals like snakes and fish, multi-legged organisms like centipedes also utilize undulatory locomotion. Whether these undulations are actively reinforced or resisted by the axial musculature…

Biological Physics · Physics 2026-03-11 Adam Dionne , Fabio Giardina , L. Mahadevan