English
Related papers

Related papers: Bipedal Walking Robot using Deep Deterministic Pol…

200 papers

Deep learning and reinforcement learning methods have recently been used to solve a variety of problems in continuous control domains. An obvious application of these techniques is dexterous manipulation tasks in robotics which are…

In this work, we present and study a training set-up that achieves fast policy generation for real-world robotic tasks by using massive parallelism on a single workstation GPU. We analyze and discuss the impact of different training…

Robotics · Computer Science 2022-08-22 Nikita Rudin , David Hoeller , Philipp Reist , Marco Hutter

We present a novel Deep Reinforcement Learning (DRL) based policy to compute dynamically feasible and spatially aware velocities for a robot navigating among mobile obstacles. Our approach combines the benefits of the Dynamic Window…

Robotics · Computer Science 2020-11-30 Utsav Patel , Nithish Kumar , Adarsh Jagan Sathyamoorthy , Dinesh Manocha

Safe navigation in real-time is an essential task for humanoid robots in real-world deployment. Since humanoid robots are inherently underactuated thanks to unilateral ground contacts, a path is considered safe if it is obstacle-free and…

Robotics · Computer Science 2024-11-07 Chengyang Peng , Victor Paredes , Guillermo A. Castillo , Ayonga Hereid

Traditional one-step preview planning algorithms for bipedal locomotion struggle to generate viable gaits when walking across terrains with restricted footholds, such as stepping stones. To overcome such limitations, this paper introduces a…

Robotics · Computer Science 2026-02-20 Zhaoyang Xiang , Victor Paredes , Guillermo A. Castillo , Ayonga Hereid

Controlling a biped robot to walk stably is a challenging task considering its nonlinearity and hybrid dynamics. Reinforcement learning can address these issues by directly mapping the observed states to optimal actions that maximize the…

Robotics · Computer Science 2019-10-24 Kuangen Zhang , Zhimin Hou , Clarence W. de Silva , Haoyong Yu , Chenglong Fu

Not until recently, robust robot locomotion has been achieved by deep reinforcement learning (DRL). However, for efficient learning of parametrized bipedal walking, developed references are usually required, limiting the performance to that…

Robotics · Computer Science 2021-12-14 Chong Zhang , Qi Wu , Liqian Ma , Hongyuan Su

Bipedal robots promise the ability to traverse rough terrain quickly and efficiently, and indeed, humanoid robots can now use strong ankles and careful foot placement to traverse discontinuous terrain. However, more agile underactuated…

Robotics · Computer Science 2023-09-18 Brian Acosta , Michael Posa

This paper investigates a hybrid solution which combines deep reinforcement learning (RL) and classical trajectory planning for the following in front application. Here, an autonomous robot aims to stay ahead of a person as the person…

Robotics · Computer Science 2020-11-09 Payam Nikdel , Richard Vaughan , Mo Chen

This paper explores the method of achieving autonomous navigation of unmanned vehicles through Deep Reinforcement Learning (DRL). The focus is on using the Deep Deterministic Policy Gradient (DDPG) algorithm to address issues in…

Robotics · Computer Science 2024-07-30 Letian Xu , Jiabei Liu , Haopeng Zhao , Tianyao Zheng , Tongzhou Jiang , Lipeng Liu

Bipedal walking is one of the most important hallmarks of human that robots have been trying to mimic for many decades. Although previous control methodologies have achieved robot walking on some terrains, there is a need for a framework…

Robotics · Computer Science 2025-12-01 Chrysostomos Karakasis , Ioannis Poulakakis , Panagiotis Artemiadis

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as…

Robotics · Computer Science 2022-04-29 Sunwoo Kim , Maks Sorokin , Jehee Lee , Sehoon Ha

Existing navigation policies for autonomous robots tend to focus on collision avoidance while ignoring human-robot interactions in social life. For instance, robots can pass along the corridor safer and easier if pedestrians notice them.…

Robotics · Computer Science 2022-03-31 Quecheng Qiu , Shunyi Yao , Jing Wang , Jun Ma , Guangda Chen , Jianmin Ji

This work presents a hierarchical framework for bipedal locomotion that combines a Reinforcement Learning (RL)-based high-level (HL) planner policy for the online generation of task space commands with a model-based low-level (LL)…

Robotics · Computer Science 2023-09-28 Guillermo A. Castillo , Bowen Weng , Shunpeng Yang , Wei Zhang , Ayonga Hereid

Deep reinforcement learning has emerged as a popular and powerful way to develop locomotion controllers for quadruped robots. Common approaches have largely focused on learning actions directly in joint space, or learning to modify and…

Robotics · Computer Science 2023-03-16 Guillaume Bellegarda , Yiyu Chen , Zhuochen Liu , Quan Nguyen

We present a novel reinforcement learning method to train the quadruped robot in a simulated environment. The idea of controlling quadruped robots in a dynamic environment is quite challenging and my method presents the optimum policy and…

Robotics · Computer Science 2025-02-25 Nabeel Ahmad Khan Jadoon , Mongkol Ekpanyapong

Walking is a common bipedal and quadrupedal gait and is often associated with terrestrial and aquatic organisms. Inspired by recent evidence of the neural underpinnings of primitive aquatic walking in the little skate Leucoraja erinacea, we…

Quantitative Methods · Quantitative Biology 2020-09-03 F. Giardina , L. Mahadevan

In this paper, previous works on the Model Predictive Control (MPC) and the Divergent Component of Motion (DCM) for bipedal walking control are extended. To this end, we employ a single MPC which uses a combination of Center of Pressure…

Robotics · Computer Science 2017-03-01 Milad Shafiee-Ashtiani , Aghil Yousefi-Koma , Masoud Shariat-Panahi

This study presents an emotion-aware navigation framework -- EmoBipedNav -- using deep reinforcement learning (DRL) for bipedal robots walking in socially interactive environments. The inherent locomotion constraints of bipedal robots…

Robotics · Computer Science 2026-01-21 Wei Zhu , Abirath Raju , Abdulaziz Shamsah , Anqi Wu , Seth Hutchinson , Ye Zhao

This paper proposes a novel learning-based control policy with strong generalizability to new environments that enables a mobile robot to navigate autonomously through spaces filled with both static obstacles and dense crowds of…

Robotics · Computer Science 2023-09-06 Zhanteng Xie , Philip Dames