English
Related papers

Related papers: Dynamics Randomization Revisited:A Case Study for …

200 papers

Reproducing the diverse and agile locomotion skills of animals has been a longstanding challenge in robotics. While manually-designed controllers have been able to emulate many complex behaviors, building such controllers involves a…

Robotics · Computer Science 2020-07-22 Xue Bin Peng , Erwin Coumans , Tingnan Zhang , Tsang-Wei Lee , Jie Tan , Sergey Levine

Quadruped robots are progressively being integrated into human environments. Despite the growing locomotion capabilities of quadrupedal robots, their interaction with objects in realistic scenes is still limited. While additional robotic…

Robotics · Computer Science 2024-08-05 Zhengmao He , Kun Lei , Yanjie Ze , Koushil Sreenath , Zhongyu Li , Huazhe Xu

Legged locomotion holds the premise of universal mobility, a critical capability for many real-world robotic applications. Both model-based and learning-based approaches have advanced the field of legged locomotion in the past three…

Robotics · Computer Science 2024-11-26 Sehoon Ha , Joonho Lee , Michiel van de Panne , Zhaoming Xie , Wenhao Yu , Majid Khadiv

Training deep reinforcement learning (DRL) locomotion policies often require massive amounts of data to converge to the desired behaviour. In this regard, simulators provide a cheap and abundant source. For successful sim-to-real transfer,…

Robotics · Computer Science 2023-03-08 Luigi Campanaro , Siddhant Gangapurwala , Wolfgang Merkt , Ioannis Havoutis

Deep reinforcement learning has recently seen huge success across multiple areas in the robotics domain. Owing to the limitations of gathering real-world data, i.e., sample inefficiency and the cost of collecting it, simulation environments…

Machine Learning · Computer Science 2021-07-09 Wenshuai Zhao , Jorge Peña Queralta , Tomi Westerlund

Despite the progress in legged robotic locomotion, autonomous navigation in unknown environments remains an open problem. Ideally, the navigation system utilizes the full potential of the robots' locomotion capabilities while operating…

Robotics · Computer Science 2023-02-15 Jonas Frey , David Hoeller , Shehryar Khattak , Marco Hutter

The process of robot design is a complex task and the majority of design decisions are still based on human intuition or tedious manual tuning. A more informed way of facing this task is computational design methods where design parameters…

Robotics · Computer Science 2022-10-07 Álvaro Belmonte-Baeza , Joonho Lee , Giorgio Valsecchi , Marco Hutter

We propose a method to predict the sim-to-real transfer performance of RL policies. Our transfer metric simplifies the selection of training setups (such as algorithm, hyperparameters, randomizations) and policies in simulation, without the…

Machine Learning · Computer Science 2020-09-29 Lei M. Zhang , Matthias Plappert , Wojciech Zaremba

Deep reinforcement learning has emerged as a popular and powerful way to develop locomotion controllers for quadruped robots. Common approaches have largely focused on learning actions directly in joint space, or learning to modify and…

Robotics · Computer Science 2023-03-16 Guillaume Bellegarda , Yiyu Chen , Zhuochen Liu , Quan Nguyen

Developing agile behaviors for legged robots remains a challenging problem. While deep reinforcement learning is a promising approach, learning truly agile behaviors typically requires tedious reward shaping and careful curriculum design.…

Robotics · Computer Science 2020-11-12 Atil Iscen , George Yu , Alejandro Escontrela , Deepali Jain , Jie Tan , Ken Caluwaerts

Legged robots have enormous potential in their range of capabilities, from navigating unstructured terrains to high-speed running. However, designing robust controllers for highly agile dynamic motions remains a substantial challenge for…

Robotics · Computer Science 2023-04-20 Laura Smith , J. Chase Kew , Tianyu Li , Linda Luu , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

While Reinforcement Learning (RL) has achieved remarkable progress in legged locomotion control, it often suffers from performance degradation in out-of-distribution (OOD) conditions and discrepancies between the simulation and the real…

Robotics · Computer Science 2025-09-18 Renjie Wang , Shangke Lyu , Donglin Wang

Legged robots have the potential to traverse complex terrain and access confined spaces beyond the reach of traditional platforms thanks to their ability to carefully select footholds and flexibly adapt their body posture while walking.…

Robotics · Computer Science 2024-03-04 Takahiro Miki , Joonho Lee , Lorenz Wellhausen , Marco Hutter

Teaching an anthropomorphic robot from human example offers the opportunity to impart humanlike qualities on its movement. In this work we present a reinforcement learning based method for teaching a real world bipedal robot to perform…

Controlling a non-statically bipedal robot is challenging due to the complex dynamics and multi-criterion optimization involved. Recent works have demonstrated the effectiveness of deep reinforcement learning (DRL) for simulation and…

Robotics · Computer Science 2021-12-23 Changxin Huang , Guangrun Wang , Zhibo Zhou , Ronghui Zhang , Liang Lin

Operations in hazardous environments put humans, animals, and machines at high risk for physically damaging consequences. In contrast to humans and animals, quadruped robots cannot naturally identify and adjust their locomotion to a…

Robotics · Computer Science 2026-04-07 Abriana Stewart-Height , Seema Jahagirdar , Nikolai Matni

Taking inspiration from the natural gait transition mechanism of quadrupeds, devising a good gait transition strategy is important for quadruped robots to achieve energy-efficient locomotion on various terrains and velocities. While…

Robotics · Computer Science 2024-10-15 Daoxun Zhang , Xieyuanli Chen , Zhengyu Zhong , Ming Xu , Zhiqiang Zheng , Huimin Lu

Legged robots must exhibit robust and agile locomotion across diverse, unstructured terrains, a challenge exacerbated under blind locomotion settings where terrain information is unavailable. This work introduces a hierarchical…

Robotics · Computer Science 2025-11-05 Matheus P. Angarola , Francisco Affonso , Marcelo Becker

Simulation-to-reality transfer has emerged as a popular and highly successful method to train robotic control policies for a wide variety of tasks. However, it is often challenging to determine when policies trained in simulation are ready…

Quadruped robots have shown remarkable mobility on various terrains through reinforcement learning. Yet, in the presence of sparse footholds and risky terrains such as stepping stones and balance beams, which require precise foot placement…

Robotics · Computer Science 2024-08-12 Chong Zhang , Nikita Rudin , David Hoeller , Marco Hutter