English
Related papers

Related papers: Sim-to-Real Transfer for Biped Locomotion

200 papers

Scaling data volume and diversity is critical for generalizing embodied intelligence. While synthetic data generation offers a scalable alternative to expensive physical data acquisition, transferring robotic manipulation policies from…

Learning policies for bipedal locomotion can be difficult, as experiments are expensive and simulation does not usually transfer well to hardware. To counter this, we need al- gorithms that are sample efficient and inherently safe. Bayesian…

Robotics · Computer Science 2018-10-11 Rika Antonova , Akshara Rai , Christopher G. Atkeson

Accurate system identification is crucial for reducing trajectory drift in bipedal locomotion, particularly in reinforcement learning and model-based control. In this paper, we present a novel control framework that integrates system…

Robotics · Computer Science 2025-08-07 Vyacheslav Kovalev , Ekaterina Chaikovskaia , Egor Davydenko , Roman Gorbachev

Simulations are attractive environments for training agents as they provide an abundant source of data and alleviate certain safety concerns during the training process. But the behaviours developed by agents in simulation are often…

Robotics · Computer Science 2018-09-21 Xue Bin Peng , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

We present a new method of learning control policies that successfully operate under unknown dynamic models. We create such policies by leveraging a large number of training examples that are generated using a physical simulator. Our system…

Machine Learning · Computer Science 2017-05-16 Wenhao Yu , Jie Tan , C. Karen Liu , Greg Turk

Generating dynamic motions for legged robots remains a challenging problem. While reinforcement learning has achieved notable success in various legged locomotion tasks, producing highly dynamic behaviors often requires extensive reward…

Robotics · Computer Science 2026-01-01 Dongyun Kang , Min-Gyu Kim , Tae-Gyu Song , Hajun Kim , Sehoon Ha , Hae-Won Park

The light and soft characteristics of Buoyancy Assisted Lightweight Legged Unit (BALLU) robots have a great potential to provide intrinsically safe interactions in environments involving humans, unlike many heavy and rigid robots. However,…

Robotics · Computer Science 2023-03-20 Nitish Sontakke , Hosik Chae , Sangjoon Lee , Tianle Huang , Dennis W. Hong , Sehoon Ha

Human videos offer a scalable way to train robot manipulation policies, but lack the action labels needed by standard imitation learning algorithms. Existing cross-embodiment approaches try to map human motion to robot actions, but often…

Simulation-to-real transfer is an important strategy for making reinforcement learning practical with real robots. Successful sim-to-real transfer systems have difficulty producing policies which generalize across tasks, despite training…

Automatic fall recovery is a crucial prerequisite before humanoid robots can be reliably deployed. Hand-designing controllers for getting up is difficult because of the varied configurations a humanoid can end up in after a fall and the…

Robotics · Computer Science 2025-04-29 Xialin He , Runpei Dong , Zixuan Chen , Saurabh Gupta

Quadrupedal locomotion plays a critical role in enabling agile, versatile movement across complex terrains. Understanding and estimating the underlying physical dynamics are essential for achieving efficient and stable quadrupedal…

Robotics · Computer Science 2026-05-05 Aman Arora , Nalini Ratha

Learning visuomotor policies in simulation is much safer and cheaper than in the real world. However, due to discrepancies between the simulated and real data, simulator-trained policies often fail when transferred to real robots. One…

Robotics · Computer Science 2023-07-31 Ricardo Garcia , Robin Strudel , Shizhe Chen , Etienne Arlaud , Ivan Laptev , Cordelia Schmid

Current vision-based robotics simulation benchmarks have significantly advanced robotic manipulation research. However, robotics is fundamentally a real-world problem, and evaluation for real-world applications has lagged behind in…

Robotics · Computer Science 2025-08-18 Xuning Yang , Clemens Eppner , Jonathan Tremblay , Dieter Fox , Stan Birchfield , Fabio Ramos

This paper proposes a modular framework to generate robust biped locomotion using a tight coupling between an analytical walking approach and deep reinforcement learning. This framework is composed of six main modules which are…

Robotics · Computer Science 2021-12-23 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis

Recent progress in GPU-accelerated, photorealistic simulation has opened a scalable data-generation path for robot learning, where massive physics and visual randomization allow policies to generalize beyond curated environments. Building…

This paper presents a system for enabling real-time synthesis of whole-body locomotion and manipulation policies for real-world legged robots. Motivated by recent advancements in robot simulation, we leverage the efficient parallelization…

Robotics · Computer Science 2024-09-17 Juan Alvarez-Padilla , John Z. Zhang , Sofia Kwok , John M. Dolan , Zachary Manchester

In this paper, we propose a multi-domain control parameter learning framework that combines Bayesian Optimization (BO) and Hybrid Zero Dynamics (HZD) for locomotion control of bipedal robots. We leverage BO to learn the control parameters…

Robotics · Computer Science 2022-03-08 Lizhi Yang , Zhongyu Li , Jun Zeng , Koushil Sreenath

Dynamic walking on bipedal robots has evolved from an idea in science fiction to a practical reality. This is due to continued progress in three key areas: a mathematical understanding of locomotion, the computational ability to encode this…

Robotics · Computer Science 2020-10-16 Jenna Reher , Aaron D. Ames

Deep reinforcement learning (RL) based controllers for legged robots have demonstrated impressive robustness for walking in different environments for several robot platforms. To enable the application of RL policies for humanoid robots in…

Robotics · Computer Science 2022-11-01 Rohan Pratap Singh , Mehdi Benallegue , Mitsuharu Morisawa , Rafael Cisneros , Fumio Kanehiro

We investigate the use of prior knowledge of human and animal movement to learn reusable locomotion skills for real legged robots. Our approach builds upon previous work on imitating human or dog Motion Capture (MoCap) data to learn a…