English
Related papers

Related papers: DeepCPG Policies for Robot Locomotion

200 papers

In this paper, a hierarchical and robust framework for learning bipedal locomotion is presented and successfully implemented on the 3D biped robot Digit built by Agility Robotics. We propose a cascade-structure controller that combines the…

Robotics · Computer Science 2021-03-30 Guillermo A. Castillo , Bowen Weng , Wei Zhang , Ayonga Hereid

Learning from complex demonstrations is challenging, especially when the demonstration consists of different strategies. A popular approach is to use a deep neural network to perform imitation learning. However, the structure of that deep…

Neural and Evolutionary Computing · Computer Science 2019-03-05 Tianyu Li , Bolun Dai

Generalist robot policies must operate safely and reliably in everyday human environments such as homes, offices, and warehouses, where people and objects move unpredictably. We present Dynamic Neural Potential Field (NPField-GPT), a…

Legged robots have enormous potential in their range of capabilities, from navigating unstructured terrains to high-speed running. However, designing robust controllers for highly agile dynamic motions remains a substantial challenge for…

Robotics · Computer Science 2023-04-20 Laura Smith , J. Chase Kew , Tianyu Li , Linda Luu , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

We present an imitation learning framework that extracts distinctive legged locomotion behaviors and transitions between them from unlabeled real-world motion data. By automatically discovering behavioral modes and mapping user steering…

Robotics · Computer Science 2026-03-06 Dongho Kang , Jin Cheng , Fatemeh Zargarbashi , Taerim Yoon , Sungjoon Choi , Stelian Coros

Legged robots are becoming increasingly powerful and popular in recent years for their potential to bring the mobility of autonomous agents to the next level. This work presents a deep reinforcement learning approach that learns a robust…

Robotics · Computer Science 2021-09-10 Zhaocheng Liu , Fernando Acero , Zhibin Li

Quadrupedal robots resemble the physical ability of legged animals to walk through unstructured terrains. However, designing a controller for quadrupedal robots poses a significant challenge due to their functional complexity and requires…

Robotics · Computer Science 2023-03-06 I Made Aswin Nahrendra , Byeongho Yu , Hyun Myung

Legged robots possess a unique ability to traverse rough terrains and navigate cluttered environments, making them well-suited for complex, real-world unstructured scenarios. However, such robots have not yet achieved the same level as seen…

Robotics · Computer Science 2025-08-19 Hossein Keshavarz , Alejandro Ramirez-Serrano , Majid Khadiv

Embodiment is a significant keyword in recent machine learning fields. This study focused on the passive nature of the body of a biped robot to generate walking and running locomotion using model-based deep reinforcement learning. We…

Robotics · Computer Science 2026-04-17 Tomoya Kamimura , Haruka Washiyama , Akihito Sano

In the field of legged robot motion control, reinforcement learning (RL) holds great promise but faces two major challenges: high computational cost for training individual robots and poor generalization of trained models. To address these…

Robotics · Computer Science 2025-04-09 Haodong Huang , Shilong Sun , Zida Zhao , Hailin Huang , Changqing Shen , Wenfu Xu

Reinforcement learning combined with sim-to-real transfer offers a general framework for developing locomotion controllers for legged robots. To facilitate successful deployment in the real world, smoothing techniques, such as low-pass…

In this paper, we propose a novel reinforcement learning (RL) based path generation (RL-PG) approach for mobile robot navigation without a prior exploration of an unknown environment. Multiple predictive path points are dynamically…

Robotics · Computer Science 2022-10-20 Longyuan Zhang , Ziyue Hou , Ji Wang , Ziang Liu , Wei Li

Recent work has shown results on learning navigation policies for idealized cylinder agents in simulation and transferring them to real wheeled robots. Deploying such navigation policies on legged robots can be challenging due to their…

Robotics · Computer Science 2021-09-14 Joanne Truong , Denis Yarats , Tianyu Li , Franziska Meier , Sonia Chernova , Dhruv Batra , Akshara Rai

Developing robotic intelligent systems that can adapt quickly to unseen wild situations is one of the critical challenges in pursuing autonomous robotics. Although some impressive progress has been made in walking stability and skill…

Robotics · Computer Science 2025-02-27 Hongyin Zhang , Diyuan Shi , Zifeng Zhuang , Han Zhao , Zhenyu Wei , Feng Zhao , Sibo Gai , Shangke Lyu , Donglin Wang

Reinforcement learning (RL) has demonstrated remarkable capability in acquiring robot skills, but learning each new skill still requires substantial data collection for training. The pretrain-and-finetune paradigm offers a promising…

Robotics · Computer Science 2025-03-25 Ziang Zheng , Guojian Zhan , Bin Shuai , Shengtao Qin , Jiangtao Li , Tao Zhang , Shengbo Eben Li

Quadruped robots excel in traversing complex, unstructured environments where wheeled robots often fail. However, enabling efficient and adaptable locomotion remains challenging due to the quadrupeds' nonlinear dynamics, high degrees of…

Robotics · Computer Science 2025-05-14 Anudeep Sajja , Shahram Khorshidi , Sebastian Houben , Maren Bennewitz

Legged robots navigating crowded scenes and complex terrains in the real world are required to execute dynamic leg movements while processing visual input for obstacle avoidance and path planning. We show that a quadruped robot can acquire…

Robotics · Computer Science 2020-12-01 Deepali Jain , Atil Iscen , Ken Caluwaerts

The use of robotics in controlled environments has flourished over the last several decades and training robots to perform tasks using control strategies developed from dynamical models of their hardware have proven very effective. However,…

Robotics · Computer Science 2019-07-16 Zach Dwiel , Madhavun Candadai , Mariano Phielipp

Robot learning in high-dimensional control settings, such as humanoid locomotion, presents persistent challenges for reinforcement learning (RL) algorithms due to unstable dynamics, complex contact interactions, and sensitivity to…

Robotics · Computer Science 2025-05-21 Khang Nguyen , Khai Nguyen , An T. Le , Jan Peters , Manfred Huber , Ngo Anh Vien , Minh Nhat Vu

Bridging the gap between motion models and reality is crucial by using limited data to deploy robots in the real world. Deep learning is expected to be generalized to diverse situations while reducing feature design costs through end-to-end…

Robotics · Computer Science 2024-03-15 Kanata Suzuki , Hiroshi Ito , Tatsuro Yamada , Kei Kase , Tetsuya Ogata