English
Related papers

Related papers: Learning Multimodal Bipedal Locomotion and Implici…

200 papers

Contact-based decision and planning methods are becoming increasingly important to endow higher levels of autonomy for legged robots. Formal synthesis methods derived from symbolic systems have great potential for reasoning about high-level…

Robotics · Computer Science 2022-01-04 Ye Zhao , Yinan Li , Luis Sentis , Ufuk Topcu , Jun Liu

Hierarchical learning has been successful at learning generalizable locomotion skills on walking robots in a sample-efficient manner. However, the low-dimensional "latent" action used to communicate between two layers of the hierarchy is…

Robotics · Computer Science 2021-03-19 Tianyu Li , Roberto Calandra , Deepak Pathak , Yuandong Tian , Franziska Meier , Akshara Rai

The efficacy of reinforcement learning for robot control relies on the tailored integration of task-specific priors and heuristics for effective exploration, which challenges their straightforward application to complex tasks and…

Robotics · Computer Science 2024-09-20 Lokesh Krishna , Nikhil Sobanbabu , Quan Nguyen

Quadrupedal locomotion plays a critical role in enabling agile, versatile movement across complex terrains. Understanding and estimating the underlying physical dynamics are essential for achieving efficient and stable quadrupedal…

Robotics · Computer Science 2026-05-05 Aman Arora , Nalini Ratha

Recent advancements in large-scale offline training have demonstrated the potential of generalist policy learning for complex robotic tasks. However, applying these principles to legged locomotion remains a challenge due to continuous…

Enabling robots to autonomously perform hybrid motions in diverse environments can be beneficial for long-horizon tasks such as material handling, household chores, and work assistance. This requires extensive exploitation of intrinsic…

Robotics · Computer Science 2024-08-19 Jin Wang , Rui Dai , Weijie Wang , Luca Rossini , Francesco Ruscelli , Nikos Tsagarakis

Robust reinforcement learning agents using high-dimensional observations must be able to identify relevant state features amidst many exogeneous distractors. A representation that captures controllability identifies these state elements by…

Machine Learning · Computer Science 2024-06-25 Max Rudolph , Caleb Chuck , Kevin Black , Misha Lvovsky , Scott Niekum , Amy Zhang

Recent work has shown results on learning navigation policies for idealized cylinder agents in simulation and transferring them to real wheeled robots. Deploying such navigation policies on legged robots can be challenging due to their…

Robotics · Computer Science 2021-09-14 Joanne Truong , Denis Yarats , Tianyu Li , Franziska Meier , Sonia Chernova , Dhruv Batra , Akshara Rai

An important function of autonomous microrobots is the ability to perform robust movement over terrain. This paper explores an edge ML approach to microrobot locomotion, allowing for on-device, lower latency control under compute, memory,…

Robotics · Computer Science 2026-01-01 Yichen Liu , Kesava Viswanadha , Zhongyu Li , Nelson Lojo , Kristofer S. J. Pister

This paper proposes a novel control framework for agile and robust bipedal locomotion, addressing model discrepancies between full-body and reduced-order models. Specifically, assumptions such as constant centroidal inertia have introduced…

Robotics · Computer Science 2024-09-17 Seung Hyeon Bang , Jaemin Lee , Carlos Gonzalez , Luis Sentis

This paper presents a comprehensive study on using deep reinforcement learning (RL) to create dynamic locomotion controllers for bipedal robots. Going beyond focusing on a single locomotion skill, we develop a general control solution that…

Robotics · Computer Science 2024-08-27 Zhongyu Li , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

We propose to address quadrupedal locomotion tasks using Reinforcement Learning (RL) with a Transformer-based model that learns to combine proprioceptive information and high-dimensional depth sensor inputs. While learning-based locomotion…

Machine Learning · Computer Science 2022-05-27 Ruihan Yang , Minghao Zhang , Nicklas Hansen , Huazhe Xu , Xiaolong Wang

Quadrupedal robots have demonstrated impressive locomotion capabilities in complex environments, but equipping them with autonomous versatile manipulation skills in a scalable way remains a significant challenge. In this work, we introduce…

Developing robust vision-guided controllers for quadrupedal robots in complex environments, with various obstacles, dynamical surroundings and uneven terrains, is very challenging. While Reinforcement Learning (RL) provides a promising…

In this work, we study risk-aware reinforcement learning for quadrupedal locomotion. Our approach trains a family of risk-conditioned policies using a Conditional Value-at-Risk (CVaR) constrained policy optimization technique that provides…

Robotics · Computer Science 2025-10-17 Yuanhong Zeng , Anushri Dixit

Most locomotion methods for humanoid robots focus on leg-based gaits, yet natural bipeds frequently rely on hands, knees, and elbows to establish additional contacts for stability and support in complex environments. This paper introduces…

This paper combines episodic learning and control barrier functions in the setting of bipedal locomotion. The safety guarantees that control barrier functions provide are only valid with perfect model knowledge; however, this assumption…

Robotics · Computer Science 2021-05-06 Noel Csomay-Shanklin , Ryan K. Cosner , Min Dai , Andrew J. Taylor , Aaron D. Ames

This paper presents a novel Adaptive-frequency MPC framework for bipedal locomotion over terrain with uneven stepping stones. In detail, we intend to achieve adaptive foot placement and gait period for bipedal periodic walking gait with…

Robotics · Computer Science 2022-09-20 Junheng Li , Quan Nguyen

Planning over unstructured terrain presents a significant challenge in the field of legged robotics. Although recent works in reinforcement learning have yielded various locomotion strategies, planning over multiple experts remains a…

This paper presents a novel approach that combines the advantages of both model-based and learning-based frameworks to achieve robust locomotion. The residual modules are integrated with each corresponding part of the model-based framework,…

Robotics · Computer Science 2025-07-25 Min-Gyu Kim , Dongyun Kang , Hajun Kim , Hae-Won Park