English
Related papers

Related papers: Embedding Classical Balance Control Principles in …

200 papers

Learning from human demonstrations can facilitate automation but is risky because the execution of the learned policy might lead to collisions and other failures. Adding explicit constraints to avoid unsafe states is generally not possible…

Robotics · Computer Science 2018-10-17 Jonathan Lee , Michael Laskey , Roy Fox , Ken Goldberg

Intelligent agents must be able to think fast and slow to perform elaborate manipulation tasks. Reinforcement Learning (RL) has led to many promising results on a range of challenging decision-making tasks. However, in real-world robotics,…

Robotics · Computer Science 2021-10-22 Maximilian Ulmer , Elie Aljalbout , Sascha Schwarz , Sami Haddadin

The application of Reinforcement Learning (RL) to economic modeling reveals a fundamental conflict between the assumptions of equilibrium theory and the emergent behavior of learning agents. While canonical economic models assume atomistic…

General Economics · Economics 2025-10-21 Ruxin Chen , Zeqiang Zhang

In this article, we show that learned policies can be applied to solve legged locomotion control tasks with extensive flight phases, such as those encountered in space exploration. Using an off-the-shelf deep reinforcement learning…

Robotics · Computer Science 2021-06-18 Nikita Rudin , Hendrik Kolvenbach , Vassilios Tsounis , Marco Hutter

Reinforcement learning algorithms have shown great success in solving different problems ranging from playing video games to robotics. However, they struggle to solve delicate robotic problems, especially those involving contact…

Robotics · Computer Science 2020-07-15 Miroslav Bogdanovic , Majid Khadiv , Ludovic Righetti

We present a hierarchical policy-learning framework that enables a legged humanoid to cooperatively carry extended loads with a human partner using only haptic cues for intent inference. At the upper tier, a lightweight behavior-cloning…

In this letter, we present an approach for learning in-hand manipulation skills with a low-cost, underactuated prosthetic hand in the presence of irreversible events. Our approach combines reinforcement learning based on visual perception…

Robotics · Computer Science 2019-11-21 Pietro Falco , Abdallah Attawia , Matteo Saveriano , Dongheui Lee

We introduce SoftMimic, a framework for learning compliant whole-body control policies for humanoid robots from example motions. Imitating human motions with reinforcement learning allows humanoids to quickly learn new skills, but existing…

Robotics · Computer Science 2025-10-21 Gabriel B. Margolis , Michelle Wang , Nolan Fey , Pulkit Agrawal

Reinforcement learning shows great potential to solve complex contact-rich robot manipulation tasks. However, the safety of using RL in the real world is a crucial problem, since unexpected dangerous collisions might happen when the RL…

Robotics · Computer Science 2025-05-27 Xiang Zhu , Shucheng Kang , Jianyu Chen

Most modern approaches to quadruped locomotion focus on using Deep Reinforcement Learning (DRL) to learn policies from scratch, in an end-to-end manner. Such methods often fail to scale, as every new problem or application requires…

Robotics · Computer Science 2025-09-29 Vassil Atanassov , Wanming Yu , Siddhant Gangapurwala , James Wilson , Ioannis Havoutis

In this paper, a hierarchical and robust framework for learning bipedal locomotion is presented and successfully implemented on the 3D biped robot Digit built by Agility Robotics. We propose a cascade-structure controller that combines the…

Robotics · Computer Science 2021-03-30 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

Reinforcement learning (RL) has demonstrated substantial potential for humanoid bipedal locomotion and the control of complex motions. To cope with oscillations and impacts induced by environmental interactions, compliant control is widely…

Robotics · Computer Science 2026-03-23 Zewen He , Yoshihiko Nakamura

Reinforcement learning (RL) has shown great potential in enabling quadruped robots to perform agile locomotion. However, directly training policies to simultaneously handle dual extreme challenges, i.e., extreme underactuation and extreme…

Robotics · Computer Science 2025-07-03 Ziang Zheng , Guojian Zhan , Shiqi Liu , Yao Lyu , Tao Zhang , Shengbo Eben Li

Whole-body geometric calibration of humanoid robots using classical robot calibration methods is a timeconsuming and experimentally burdensome task. However, despite its significance for accurate control and simulation, it is often…

Robotics · Computer Science 2025-07-23 Thanh D V Nguyen , Vincent Bonnet , Pierre Fernbach , David Daney , Florent Lamiraux

We present a universal motion representation that encompasses a comprehensive range of motor skills for physics-based humanoid control. Due to the high dimensionality of humanoids and the inherent difficulties in reinforcement learning,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Zhengyi Luo , Jinkun Cao , Josh Merel , Alexander Winkler , Jing Huang , Kris Kitani , Weipeng Xu

Learning-based methods have proven useful at generating complex motions for robots, including humanoids. Reinforcement learning (RL) has been used to learn locomotion policies, some of which leverage a periodic reward formulation. This work…

Robotics · Computer Science 2024-09-13 William Thibault , Vidyasagar Rajendran , William Melek , Katja Mombaur

Object insertion under tight tolerances ($< \hspace{-.02in} 1mm$) is an important but challenging assembly task as even small errors can result in undesirable contacts. Recent efforts focused on Reinforcement Learning (RL), which often…

Posture control and balance are basic requirements for a humanoid robot performing motor tasks like walking and interacting with the environment. For this reason, posture control is one of the elements taken into account when evaluating the…

Robotics · Computer Science 2021-10-28 Vittorio Lippi , Christoph Maurer , Thomas Mergner

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

Robotics · Computer Science 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

Key challenges for the deployment of reinforcement learning (RL) agents in the real world are the discovery, representation and reuse of skills in the absence of a reward function. To this end, we propose a novel approach to learn a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Oier Mees , Markus Merklinger , Gabriel Kalweit , Wolfram Burgard