English
Related papers

Related papers: Learning Risk-Aware Quadrupedal Locomotion using D…

200 papers

Ensuring human safety in collaborative robotics can compromise efficiency because traditional safety measures increase robot cycle time when human interaction is frequent. This paper proposes a safety-aware approach to mitigate efficiency…

Robotics · Computer Science 2025-12-22 M. Faroni , A. Spano , A. M. Zanchettin , P. Rocco

We consider the problem of learning models for risk-sensitive reinforcement learning. We theoretically demonstrate that proper value equivalence, a method of learning models which can be used to plan optimally in the risk-neutral setting,…

Machine Learning · Computer Science 2023-12-05 Tyler Kastner , Murat A. Erdogdu , Amir-massoud Farahmand

We investigate the problem of risk averse robot path planning using the deep reinforcement learning and distributionally robust optimization perspectives. Our problem formulation involves modelling the robot as a stochastic linear dynamical…

Robotics · Computer Science 2022-11-07 Cem Alpturk , Venkatraman Renganathan

Legged robots that can operate autonomously in remote and hazardous environments will greatly increase opportunities for exploration into under-explored areas. Exteroceptive perception is crucial for fast and energy-efficient locomotion:…

Robotics · Computer Science 2022-01-21 Takahiro Miki , Joonho Lee , Jemin Hwangbo , Lorenz Wellhausen , Vladlen Koltun , Marco Hutter

Mastering robotic manipulation skills through reinforcement learning (RL) typically requires the design of shaped reward functions. Recent developments in this area have demonstrated that using sparse rewards, i.e. rewarding the agent only…

Machine Learning · Computer Science 2021-11-12 Ozsel Kilinc , Giovanni Montana

The physical design of a robot and the policy that controls its motion are inherently coupled, and should be determined according to the task and environment. In an increasing number of applications, data-driven and learning-based…

Robotics · Computer Science 2018-09-18 Charles Schaff , David Yunis , Ayan Chakrabarti , Matthew R. Walter

This paper combines episodic learning and control barrier functions in the setting of bipedal locomotion. The safety guarantees that control barrier functions provide are only valid with perfect model knowledge; however, this assumption…

Robotics · Computer Science 2021-05-06 Noel Csomay-Shanklin , Ryan K. Cosner , Min Dai , Andrew J. Taylor , Aaron D. Ames

Quadrupedal robots have demonstrated remarkable agility and robustness in traversing complex terrains. However, they struggle with dynamic object interactions, where contact must be precisely sensed and controlled. To bridge this gap, we…

We propose a novel hierarchical reinforcement learning framework for quadruped locomotion over challenging terrain. Our approach incorporates a two-layer hierarchy in which a high-level policy (HLP) selects optimal goals for a low-level…

Robotics · Computer Science 2025-06-26 Jeremiah Coholich , Muhammad Ali Murtaza , Seth Hutchinson , Zsolt Kira

In this paper, we describe an approach to achieve dynamic legged locomotion on physical robots which combines existing methods for control with reinforcement learning. Specifically, our goal is a control hierarchy in which highest-level…

Robotics · Computer Science 2021-03-15 Kevin Green , Yesh Godse , Jeremy Dao , Ross L. Hatton , Alan Fern , Jonathan Hurst

Safety is a critical issue in learning-based robotic and autonomous systems as learned information about their environments is often unreliable and inaccurate. In this paper, we propose a risk-aware motion control tool that is robust…

Robotics · Computer Science 2020-03-06 Astghik Hakobyan , Insoon Yang

Teaching an anthropomorphic robot from human example offers the opportunity to impart humanlike qualities on its movement. In this work we present a reinforcement learning based method for teaching a real world bipedal robot to perform…

The aim of this work is to enable quadrupedal robots to mount skateboards using Reverse Curriculum Reinforcement Learning. Although prior work has demonstrated skateboarding for quadrupeds that are already positioned on the board, the…

Robotics · Computer Science 2025-05-13 Danil Belov , Artem Erkhov , Elizaveta Pestova , Ilya Osokin , Dzmitry Tsetserukou , Pavel Osinenko

We provide an algorithm for adaptive legged locomotion via online learning and model predictive control. The algorithm is composed of two interacting modules: model predictive control (MPC) and online learning of residual dynamics. The…

Robotics · Computer Science 2025-12-02 Hongyu Zhou , Xiaoyu Zhang , Vasileios Tzoumas

Some of the most challenging environments on our planet are accessible to quadrupedal animals but remain out of reach for autonomous machines. Legged locomotion can dramatically expand the operational domains of robotics. However,…

Robotics · Computer Science 2020-10-23 Joonho Lee , Jemin Hwangbo , Lorenz Wellhausen , Vladlen Koltun , Marco Hutter

Space exploration missions have seen use of increasingly sophisticated robotic systems with ever more autonomy. Deep learning promises to take this even a step further, and has applications for high-level tasks, like path planning, as well…

Machine Learning · Computer Science 2019-09-16 Tamir Blum , William Jones , Kazuya Yoshida

Safety is an essential component for deploying reinforcement learning (RL) algorithms in real-world scenarios, and is critical during the learning process itself. A natural first approach toward safe RL is to manually specify constraints on…

Machine Learning · Computer Science 2020-10-29 Krishnan Srinivasan , Benjamin Eysenbach , Sehoon Ha , Jie Tan , Chelsea Finn

An integration of distributionally robust risk allocation into sampling-based motion planning algorithms for robots operating in uncertain environments is proposed. We perform non-uniform risk allocation by decomposing the distributionally…

Robotics · Computer Science 2023-05-16 Kajsa Ekenberg , Venkatraman Renganathan , Björn Olofsson

Differentiable simulators provide analytic gradients, enabling more sample-efficient learning algorithms and paving the way for data intensive learning tasks such as learning from images. In this work, we demonstrate that locomotion…

Achieving stable and robust perceptive locomotion for bipedal robots in unstructured outdoor environments remains a critical challenge due to complex terrain geometry and susceptibility to external disturbances. In this work, we propose a…

Robotics · Computer Science 2025-10-21 Haokai Su , Haoxiang Luo , Shunpeng Yang , Kaiwen Jiang , Wei Zhang , Hua Chen