English
Related papers

Related papers: Dynamic Bipedal Maneuvers through Sim-to-Real Rein…

200 papers

The common approach for local navigation on challenging environments with legged robots requires path planning, path following and locomotion, which usually requires a locomotion control policy that accurately tracks a commanded velocity.…

Robotics · Computer Science 2022-09-27 Nikita Rudin , David Hoeller , Marko Bjelonic , Marco Hutter

Not until recently, robust bipedal locomotion has been achieved through reinforcement learning. However, existing implementations rely heavily on insights and efforts from human experts, which is costly for the iterative design of robot…

Robotics · Computer Science 2022-05-17 Qi Wu , Chong Zhang , Yanchen Liu

Classical control techniques such as PID and LQR have been used effectively in maintaining a system state, but these techniques become more difficult to implement when the model dynamics increase in complexity and sensitivity. For adaptive…

Machine Learning · Computer Science 2021-12-15 Jack Dibachi , Jacob Azoulay

Knowledge from animals and humans inspires robotic innovations. Numerous efforts have been made to achieve agile locomotion in quadrupedal robots through classical controllers or reinforcement learning approaches. These methods usually rely…

Recent work has shown results on learning navigation policies for idealized cylinder agents in simulation and transferring them to real wheeled robots. Deploying such navigation policies on legged robots can be challenging due to their…

Robotics · Computer Science 2021-09-14 Joanne Truong , Denis Yarats , Tianyu Li , Franziska Meier , Sonia Chernova , Dhruv Batra , Akshara Rai

Training and deploying reinforcement learning (RL) policies for robots, especially in accomplishing specific tasks, presents substantial challenges. Recent advancements have explored diverse reward function designs, training techniques,…

Robotics · Computer Science 2025-02-25 Yifei Yao , Wentao He , Chenyu Gu , Jiaheng Du , Fuwei Tan , Zhen Zhu , Junguo Lu

Controlling a non-statically bipedal robot is challenging due to the complex dynamics and multi-criterion optimization involved. Recent works have demonstrated the effectiveness of deep reinforcement learning (DRL) for simulation and…

Robotics · Computer Science 2021-12-23 Changxin Huang , Guangrun Wang , Zhibo Zhou , Ronghui Zhang , Liang Lin

Quadruped robots have shown remarkable mobility on various terrains through reinforcement learning. Yet, in the presence of sparse footholds and risky terrains such as stepping stones and balance beams, which require precise foot placement…

Robotics · Computer Science 2024-08-12 Chong Zhang , Nikita Rudin , David Hoeller , Marco Hutter

Legged robots have achieved impressive feats in dynamic locomotion in challenging unstructured terrain. However, in entertainment applications, the design and control of these robots face additional challenges in appealing to human…

Learning various motor skills for quadrupedal robots is a challenging problem that requires careful design of task-specific mathematical models or reward descriptions. In this work, we propose to learn a single capable policy using deep…

Robotics · Computer Science 2023-03-28 Arnaud Klipfel , Nitish Sontakke , Ren Liu , Sehoon Ha

We present a unified model-based and data-driven approach for quadrupedal planning and control to achieve dynamic locomotion over uneven terrain. We utilize on-board proprioceptive and exteroceptive feedback to map sensory information and…

Robotics · Computer Science 2022-05-13 Siddhant Gangapurwala , Mathieu Geisert , Romeo Orsolino , Maurice Fallon , Ioannis Havoutis

Legged robots have enormous potential in their range of capabilities, from navigating unstructured terrains to high-speed running. However, designing robust controllers for highly agile dynamic motions remains a substantial challenge for…

Robotics · Computer Science 2023-04-20 Laura Smith , J. Chase Kew , Tianyu Li , Linda Luu , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

Locomotion has seen dramatic progress for walking or running across challenging terrains. However, robotic quadrupeds are still far behind their biological counterparts, such as dogs, which display a variety of agile skills and can use the…

Robotics · Computer Science 2023-03-23 Xuxin Cheng , Ashish Kumar , Deepak Pathak

In this paper, we describe an approach to achieve dynamic legged locomotion on physical robots which combines existing methods for control with reinforcement learning. Specifically, our goal is a control hierarchy in which highest-level…

Robotics · Computer Science 2021-03-15 Kevin Green , Yesh Godse , Jeremy Dao , Ross L. Hatton , Alan Fern , Jonathan Hurst

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as…

Robotics · Computer Science 2022-04-29 Sunwoo Kim , Maks Sorokin , Jehee Lee , Sehoon Ha

In this work, we propose a method to generate reduced-order model reference trajectories for general classes of highly dynamic maneuvers for bipedal robots for use in sim-to-real reinforcement learning. Our approach is to utilize a single…

Robotics · Computer Science 2022-07-12 Ryan Batke , Fangzhou Yu , Jeremy Dao , Jonathan Hurst , Ross L. Hatton , Alan Fern , Kevin Green

Can a quadrupedal robot perform bipedal motions like humans? Although developing human-like behaviors is more often studied on costly bipedal robot platforms, we present a solution over a lightweight quadrupedal robot that unlocks the…

Robotics · Computer Science 2024-03-05 Yunfei Li , Jinhan Li , Wei Fu , Yi Wu

State-of-the-art reinforcement learning is now able to learn versatile locomotion, balancing and push-recovery capabilities for bipedal robots in simulation. Yet, the reality gap has mostly been overlooked and the simulated results hardly…

Robotics · Computer Science 2023-01-02 Alexis Duburcq , Fabian Schramm , Guilhem Boéris , Nicolas Bredeche , Yann Chevaleyre

This paper presents an online framework for synthesizing agile locomotion for bipedal robots that adapts to unknown environments, modeling errors, and external disturbances. To this end, we leverage step-to-step (S2S) dynamics which has…

Robotics · Computer Science 2023-08-08 Min Dai , Xiaobin Xiong , Jaemin Lee , Aaron D. Ames

Pedipulation leverages the feet of legged robots for mobile manipulation, eliminating the need for dedicated robotic arms. While previous works have showcased blind and task-specific pedipulation skills, they fail to account for static and…

Robotics · Computer Science 2024-11-05 Jonas Stolle , Philip Arm , Mayank Mittal , Marco Hutter