English
Related papers

Related papers: Creating a Dynamic Quadrupedal Robotic Goalkeeper …

200 papers

In this paper, we present an efficient Dynamic Programing framework for optimal planning and control of legged robots. First we formulate this problem as an optimal control problem for switched systems. Then we propose a multi--level…

Systems and Control · Computer Science 2018-01-31 Farbod Farshidian , Michael Neunert , Alexander W. Winkler , Gonzalo Rey , Jonas Buchli

Soccer kicking is a complex whole-body motion that requires intricate coordination of various motor actions. To accomplish such dynamic motion in a humanoid robot, the robot needs to simultaneously: 1) transfer high kinetic energy to the…

Robotics · Computer Science 2024-07-23 Daniel Marew , Nisal Perera , Shangqun Yu , Sarah Roelker , Donghyun Kim

Safe Reinforcement Learning (RL) plays an important role in applying RL algorithms to safety-critical real-world applications, addressing the trade-off between maximizing rewards and adhering to safety constraints. This work introduces a…

Robotics · Computer Science 2024-07-16 Fan Yang , Wenxuan Zhou , Zuxin Liu , Ding Zhao , David Held

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

Systems and Control · Electrical Eng. & Systems 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt

Controlled execution of dynamic motions in quadrupedal robots, especially those with articulated soft bodies, presents a unique set of challenges that traditional methods struggle to address efficiently. In this study, we tackle these…

Robotics · Computer Science 2024-03-05 Francecso Vezzi , Jiatao Ding , Antonin Raffin , Jens Kober , Cosimo Della Santina

We present an end-to-end Reinforcement Learning(RL) framework for robotic manipulation tasks, using a robust and efficient keypoints representation. The proposed method learns keypoints from camera images as the state representation,…

Robotics · Computer Science 2022-02-15 Tianying Wang , En Yen Puang , Marcus Lee , Yan Wu , Wei Jing

Sim-to-real transfer of locomotion policies often leads to performance degradation due to the inevitable sim-to-real gap. Naively fine-tuning these policies directly on hardware is problematic, as it poses risks of mechanical failure and…

Robotics · Computer Science 2026-03-19 Elham Daneshmand , Shafeef Omar , Glen Berseth , Majid Khadiv , Hsiu-Chin Lin

In this article, we show that learned policies can be applied to solve legged locomotion control tasks with extensive flight phases, such as those encountered in space exploration. Using an off-the-shelf deep reinforcement learning…

Robotics · Computer Science 2021-06-18 Nikita Rudin , Hendrik Kolvenbach , Vassilios Tsounis , Marco Hutter

This paper proposes a safe reinforcement learning (RL) framework based on forward-invariance-induced action-space design. The control problem is cast as a Markov decision process, but instead of relying on runtime shielding or penalty-based…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Chieh Tsai , Muhammad Junayed Hasan Zahed , Salim Hariri , Hossein Rastgoftar

This paper addresses the problem of legged locomotion in non-flat terrain. As legged robots such as quadrupeds are to be deployed in terrains with geometries which are difficult to model and predict, the need arises to equip them with the…

Robotics · Computer Science 2020-02-03 Vassilios Tsounis , Mitja Alge , Joonho Lee , Farbod Farshidian , Marco Hutter

Recent advances in deep reinforcement learning (RL) based techniques combined with training in simulation have offered a new approach to developing robust controllers for legged robots. However, the application of such approaches to real…

Robotics · Computer Science 2023-08-08 Rohan Pratap Singh , Zhaoming Xie , Pierre Gergondet , Fumio Kanehiro

This paper addresses the challenge of terrain-adaptive dynamic locomotion in humanoid robots, a problem traditionally tackled by optimization-based methods or reinforcement learning (RL). Optimization-based methods, such as model-predictive…

Robotics · Computer Science 2024-07-30 Shangqun Yu , Nisal Perera , Daniel Marew , Donghyun Kim

Reinforcement learning (RL) holds great promise for enabling autonomous acquisition of complex robotic manipulation skills, but realizing this potential in real-world settings has been challenging. We present a human-in-the-loop…

Robotics · Computer Science 2025-03-21 Jianlan Luo , Charles Xu , Jeffrey Wu , Sergey Levine

This paper presents a novel model-free reinforcement learning (RL) framework to design feedback control policies for 3D bipedal walking. Existing RL algorithms are often trained in an end-to-end manner or rely on prior knowledge of some…

Robotics · Computer Science 2019-10-07 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

Traversing risky terrains with sparse footholds poses a significant challenge for humanoid robots, requiring precise foot placements and stable locomotion. Existing learning-based approaches often struggle on such complex terrains due to…

Robotics · Computer Science 2025-04-29 Huayi Wang , Zirui Wang , Junli Ren , Qingwei Ben , Tao Huang , Weinan Zhang , Jiangmiao Pang

This paper presents a runtime learning framework for quadruped robots, enabling them to learn and adapt safely in dynamic wild environments. The framework integrates sensing, navigation, and control, forming a closed-loop system for the…

Robotics · Computer Science 2025-09-22 Yihao Cai , Yanbing Mao , Lui Sha , Hongpeng Cao , Marco Caccamo

Traversing risky terrains with sparse footholds presents significant challenges for legged robots, requiring precise foot placement in safe areas. To acquire comprehensive exteroceptive information, prior studies have employed motion…

Robotics · Computer Science 2025-03-04 Ruiqi Yu , Qianshi Wang , Yizhen Wang , Zhicheng Wang , Jun Wu , Qiuguo Zhu

We present a deep reinforcement learning (deep RL) algorithm that consists of learning-based motion planning and imitation to tackle challenging control problems. Deep RL has been an effective tool for solving many high-dimensional…

Robotics · Computer Science 2023-03-02 Nitish Sontakke , Sehoon Ha

In the field of legged robot motion control, reinforcement learning (RL) holds great promise but faces two major challenges: high computational cost for training individual robots and poor generalization of trained models. To address these…

Robotics · Computer Science 2025-04-09 Haodong Huang , Shilong Sun , Zida Zhao , Hailin Huang , Changqing Shen , Wenfu Xu

This paper proposes a new control framework for manipulating soft objects. A Deep Reinforcement Learning (DRL) approach is used to make the shape of a deformable object reach a set of desired points by controlling a robotic arm which…