中文
相关论文

相关论文: Reinforcement Learning of CPG-regulated Locomotion…

200 篇论文

This study presents an innovative approach to optimal gait control for a soft quadruped robot enabled by four Compressible Tendon-driven Soft Actuators (CTSAs). Improving our previous studies of using model-free reinforcement learning for…

机器人学 · 计算机科学 2026-05-08 Xuezhi Niu , Kaige Tan , Lei Feng

We present a framework for learning visually-guided quadruped locomotion by integrating exteroceptive sensing and central pattern generators (CPGs), i.e. systems of coupled oscillators, into the deep reinforcement learning (DRL) framework.…

机器人学 · 计算机科学 2024-03-12 Guillaume Bellegarda , Milad Shafiee , Auke Ijspeert

The Central Pattern Generator (CPG) is adept at generating rhythmic gait patterns characterized by consistent timing and adequate foot clearance. Yet, its open-loop configuration often compromises the system's control performance in…

机器人学 · 计算机科学 2023-10-11 Xinyu Zhang , Zhiyuan Xiao , Qingrui Zhang , Wei Pan

This paper studies the control synthesis of motion planning subject to uncertainties. The uncertainties are considered in robot motions and environment properties, giving rise to the probabilistic labeled Markov decision process (PL-MDP). A…

机器人学 · 计算机科学 2023-01-31 Mingyu Cai , Shaoping Xiao , Zhijun Li , Zhen Kan

This paper presents a comprehensive study on using deep reinforcement learning (RL) to create dynamic locomotion controllers for bipedal robots. Going beyond focusing on a single locomotion skill, we develop a general control solution that…

机器人学 · 计算机科学 2024-08-27 Zhongyu Li , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

Robust closed-loop locomotion remains challenging for soft quadruped robots due to high-dimensional dynamics, actuator hysteresis, and difficult-to-model contact interactions, while conventional proprioception provides limited information…

机器人学 · 计算机科学 2026-02-16 Storm de Kam , Ebrahim Shahabi , Cosimo Della Santina

In this paper, we propose a novel technique, Back-stepping Experience Replay (BER), that is compatible with arbitrary off-policy reinforcement learning (RL) algorithms. BER aims to enhance learning efficiency in systems with approximate…

机器人学 · 计算机科学 2024-09-25 Xinda Qi , Dong Chen , Zhaojian Li , Xiaobo Tan

In this letter, we formulate a novel Markov Decision Process (MDP) for safe and data-efficient learning for humanoid locomotion aided by a dynamic balancing model. In our previous studies of biped locomotion, we relied on a low-dimensional…

机器人学 · 计算机科学 2020-04-29 Junhyeok Ahn , Jaemin Lee , Luis Sentis

Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges,…

Soft robotic crawlers are mobile robots that utilize soft body deformability and compliance to achieve locomotion through surface contact. Designing control strategies for such systems is challenging due to model inaccuracies, sensor noise,…

机器人学 · 计算机科学 2025-10-08 Vaughn Gzenda , Robin Chhabra

Amphibious legged robots inspired by salamanders are promising in applications in complex amphibious environments. However, despite the significant success of training controllers that achieve diverse locomotion behaviors in conventional…

机器人学 · 计算机科学 2026-03-18 Mengze Tian , Qiyuan Fu , Chuanfang Ning , Javier Jia Jie Pey , Auke Ijspeert

Learning controllers that reproduce legged locomotion in nature has been a long-time goal in robotics and computer graphics. While yielding promising results, recent approaches are not yet flexible enough to be applicable to legged systems…

机器人学 · 计算机科学 2022-07-26 Daniel Ordonez-Apraez , Antonio Agudo , Francesc Moreno-Noguer , Mario Martin

Humanoid robots have the promise of locomoting like humans, including fast and dynamic running. Recently, reinforcement learning (RL) controllers that can mimic human motions have become popular as they can generate very dynamic behaviors,…

机器人学 · 计算机科学 2026-03-30 Zachary Olkin , William D. Compton , Ryan M. Bena , Aaron D. Ames

In recent years, reinforcement learning (RL) based quadrupedal locomotion control has emerged as an extensively researched field, driven by the potential advantages of autonomous learning and adaptation compared to traditional control…

机器人学 · 计算机科学 2024-10-15 Maurya Gurram , Prakash Kumar Uttam , Shantipal S. Ohol

Bird-sized flapping-wing robots offer significant potential for agile flight in complex environments, but achieving agile and robust trajectory tracking remains a challenge due to the complex aerodynamics and highly nonlinear dynamics…

机器人学 · 计算机科学 2024-11-25 Jiaze Cai , Vishnu Sangli , Mintae Kim , Koushil Sreenath

A terrestrial robot that can maneuver rough terrain and scout places is very useful in mapping out unknown areas. It can also be used explore dangerous areas in place of humans. A terrestrial robot modeled after a scorpion will be able to…

机器人学 · 计算机科学 2020-09-01 Aakriti Agrawal , V S Rajashekhar , Rohitkumar Arasanipalai , Debasish Ghose

In this paper, we propose a novel reinforcement learning (RL) based path generation (RL-PG) approach for mobile robot navigation without a prior exploration of an unknown environment. Multiple predictive path points are dynamically…

机器人学 · 计算机科学 2022-10-20 Longyuan Zhang , Ziyue Hou , Ji Wang , Ziang Liu , Wei Li

This work employs a reinforcement learning-based model identification method aimed at enhancing the accuracy of the dynamics for our snake robot, called COBRA. Leveraging gradient information and iterative optimization, the proposed…

机器人学 · 计算机科学 2024-07-16 Harin Kumar Nallaguntla

Recently reinforcement learning (RL) has emerged as a promising approach for quadrupedal locomotion, which can save the manual effort in conventional approaches such as designing skill-specific controllers. However, due to the complex…

机器人学 · 计算机科学 2021-09-17 Haojie Shi , Bo Zhou , Hongsheng Zeng , Fan Wang , Yueqiang Dong , Jiangyong Li , Kang Wang , Hao Tian , Max Q. -H. Meng

Reinforcement learning (RL) has become a promising approach to developing controllers for quadrupedal robots. Conventionally, an RL design for locomotion follows a position-based paradigm, wherein an RL policy outputs target joint positions…

机器人学 · 计算机科学 2023-03-14 Shuxiao Chen , Bike Zhang , Mark W. Mueller , Akshara Rai , Koushil Sreenath