中文
相关论文

相关论文: CPG-RL: Learning Central Pattern Generators for Qu…

200 篇论文

Text embedding and generative tasks are usually trained separately based on large language models (LLMs) nowadays. This causes a large amount of training cost and deployment effort. Context compression is also a challenging and pressing…

计算与语言 · 计算机科学 2026-05-13 Zhongtao Miao , Qiyu Wu , Yoshimasa Tsuruoka

First-order Policy Gradient (FoPG) algorithms such as Backpropagation through Time and Analytical Policy Gradients leverage local simulation physics to accelerate policy search, significantly improving sample efficiency in robot control…

机器人学 · 计算机科学 2024-10-07 Jing Yuan Luo , Yunlong Song , Victor Klemm , Fan Shi , Davide Scaramuzza , Marco Hutter

Upside Down Reinforcement Learning (UDRL) is a promising framework for solving reinforcement learning problems which focuses on learning command-conditioned policies. In this work, we extend UDRL to the task of learning a…

机器学习 · 计算机科学 2025-01-29 Jacopo Di Ventura , Dylan R. Ashley , Vincent Herrmann , Francesco Faccio , Jürgen Schmidhuber

Deep reinforcement learning (RL) uses model-free techniques to optimize task-specific control policies. Despite having emerged as a promising approach for complex problems, RL is still hard to use reliably for real-world applications. Apart…

机器人学 · 计算机科学 2020-02-25 Siddhant Gangapurwala , Alexander Mitchell , Ioannis Havoutis

Complex mechanical systems such as vehicle powertrains are inherently subject to multiple nonlinearities and uncertainties arising from parametric variations. Modeling errors are therefore unavoidable, making the transfer of control systems…

系统与控制 · 电气工程与系统科学 2026-02-13 Heisei Yonezawa , Ansei Yonezawa , Itsuro Kajiwara

Neural circuits in the brain perform a variety of essential functions, including input classification, pattern completion, and the generation of rhythms and oscillations that support processes such as breathing and locomotion. There is also…

神经元与认知 · 定量生物学 2024-10-16 Juliana Londono Alvarez

We propose a novel discrete model of central pattern generators (CPG), neuronal ensembles generating rhythmic activity. The model emphasizes the role of nonsynaptic interactions and the diversity of electrical properties in nervous systems.…

神经与进化计算 · 计算机科学 2017-05-10 Nikolay Bazenkov , Varvara Dyakonova , Oleg Kuznetsov , Dmitri Sakharov , Dmitry Vorontsov , Liudmila Zhilyakova

This study introduces TRANS: Terrain-aware Reinforcement learning for Agile Navigation under Social interactions, a deep reinforcement learning (DRL) framework for quadrupedal social navigation over unstructured terrains. Conventional…

机器人学 · 计算机科学 2026-04-01 Wei Zhu , Irfan Tito Kurniawan , Ye Zhao , Mitsuhiro Hayashibe

Learning locomotion skills is a challenging problem. To generate realistic and smooth locomotion, existing methods use motion capture, finite state machines or morphology-specific knowledge to guide the motion generation algorithms. Deep…

机器学习 · 计算机科学 2018-05-15 Wenhao Yu , Greg Turk , C. Karen Liu

This paper introduces MotionGlot, a model that can generate motion across multiple embodiments with different action dimensions, such as quadruped robots and human bodies. By leveraging the well-established training procedures commonly used…

机器人学 · 计算机科学 2025-05-02 Sudarshan Harithas , Srinath Sridhar

This work developed a learning framework for perceptive legged locomotion that combines visual feedback, proprioceptive information, and active gait regulation of foot-ground contacts. The perception requires only one forward-facing camera…

机器人学 · 计算机科学 2023-02-01 Daniel Chee Hian Tan , Jenny Zhang , Michael , Chuah , Zhibin Li

Compliant robots can be more versatile than traditional robots, but their control is more complex. The dynamics of compliant bodies can however be turned into an advantage using the physical reservoir computing frame-work. By feeding sensor…

神经与进化计算 · 计算机科学 2020-04-15 Alexander Vandesompele , Gabriel Urbain , Francis wyffels , Joni Dambre

Reinforcement learning (RL) has shown great effectiveness in quadrotor control, enabling specialized policies to develop even human-champion-level performance in single-task scenarios. However, these specialized policies often struggle with…

机器人学 · 计算机科学 2024-12-18 Jiaxu Xing , Ismail Geles , Yunlong Song , Elie Aljalbout , Davide Scaramuzza

We propose to address quadrupedal locomotion tasks using Reinforcement Learning (RL) with a Transformer-based model that learns to combine proprioceptive information and high-dimensional depth sensor inputs. While learning-based locomotion…

机器学习 · 计算机科学 2022-05-27 Ruihan Yang , Minghao Zhang , Nicklas Hansen , Huazhe Xu , Xiaolong Wang

This paper presents a deep reinforcement learning (DRL) framework for active flow control (AFC) to reduce drag in aerodynamic bodies. Tested on a 3D cylinder at Re = 100, the DRL approach achieved a 9.32% drag reduction and a 78.4% decrease…

机器学习 · 计算机科学 2024-11-11 Ricard Montalà , Bernat Font , Pol Suárez , Jean Rabault , Oriol Lehmkuhl , Ivette Rodriguez

Whole-body humanoid locomotion is challenging due to high-dimensional control, morphological instability, and the need for real-time adaptation to various terrains using onboard perception. Directly applying reinforcement learning (RL) with…

Deep reinforcement learning (DRL) frameworks are increasingly used to solve high-dimensional continuous control tasks in robotics. However, due to the lack of sample efficiency, applying DRL for online learning is still practically…

机器人学 · 计算机科学 2024-04-30 Yu Tang Liu , Aamir Ahmad

In the field of legged robot motion control, reinforcement learning (RL) holds great promise but faces two major challenges: high computational cost for training individual robots and poor generalization of trained models. To address these…

机器人学 · 计算机科学 2025-04-09 Haodong Huang , Shilong Sun , Zida Zhao , Hailin Huang , Changqing Shen , Wenfu Xu

Deep reinforcement learning (DRL) has emerged as a promising solution to mastering explosive and versatile quadrupedal jumping skills. However, current DRL-based frameworks usually rely on pre-existing reference trajectories obtained by…

机器人学 · 计算机科学 2024-10-28 Vassil Atanassov , Jiatao Ding , Jens Kober , Ioannis Havoutis , Cosimo Della Santina

Reinforcement learning (RL) has enabled robust quadruped locomotion over complex terrain, but most learned controllers are trained offline with backpropagation in massively parallel simulation and deployed as fixed policies, limiting…

神经与进化计算 · 计算机科学 2026-05-12 Zhuangyu Han , Abhronil Sengupta