English
Related papers

Related papers: Learning-based Hierarchical Control: Emulating the…

200 papers

We address the challenge of effectively controlling the locomotion of legged robots by incorporating precise frequency and phase characteristics, which is often ignored in locomotion policies that do not account for the periodic nature of…

Robotics · Computer Science 2025-03-07 Taixian Hou , Yueqi Zhang , Xiaoyi Wei , Zhiyan Dong , Jiafu Yi , Peng Zhai , Lihua Zhang

For the deployment of legged robots in real-world environments, it is essential to develop robust locomotion control methods for challenging terrains that may exhibit unexpected deformability and irregularity. In this paper, we explore the…

Robotics · Computer Science 2025-04-21 Rohan P. Singh , Mitsuharu Morisawa , Mehdi Benallegue , Zhaoming Xie , Fumio Kanehiro

In this paper, we describe an approach to achieve dynamic legged locomotion on physical robots which combines existing methods for control with reinforcement learning. Specifically, our goal is a control hierarchy in which highest-level…

Robotics · Computer Science 2021-03-15 Kevin Green , Yesh Godse , Jeremy Dao , Ross L. Hatton , Alan Fern , Jonathan Hurst

Animals such as rabbits and birds can instantly generate locomotion behavior in reaction to a dynamic, approaching object, such as a person or a rock, despite having possibly never seen the object before and having limited perception of the…

Robotics · Computer Science 2022-03-22 Shangqun Yu , Sreehari Rammohan , Kaiyu Zheng , George Konidaris

Legged robots have shown remarkable advantages in navigating uneven terrain. However, realizing effective locomotion and manipulation tasks on quadruped robots is still challenging. In addition, object and terrain parameters are generally…

Robotics · Computer Science 2023-03-14 Mohsen Sombolestan , Quan Nguyen

Recurrent neural network-based reinforcement learning systems are capable of complex motor control tasks such as locomotion and manipulation, however, much of their underlying mechanisms still remain difficult to interpret. Our aim is to…

Robotics · Computer Science 2023-06-29 Eugene R. Rush , Christoffer Heckman , Kaushik Jayaram , J. Sean Humbert

This work presents a hierarchical framework for bipedal locomotion that combines a Reinforcement Learning (RL)-based high-level (HL) planner policy for the online generation of task space commands with a model-based low-level (LL)…

Robotics · Computer Science 2023-09-28 Guillermo A. Castillo , Bowen Weng , Shunpeng Yang , Wei Zhang , Ayonga Hereid

Humanoid robots are made to resemble humans but their locomotion abilities are far from ours in terms of agility and versatility. When humans walk on complex terrains, or face external disturbances, they combine a set of strategies,…

Robotics · Computer Science 2021-10-28 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real…

Robotics · Computer Science 2025-06-06 Haoyu Wang , Ruyi Zhou , Liang Ding , Tie Liu , Zhelin Zhang , Peng Xu , Haibo Gao , Zongquan Deng

This paper presents a hierarchical control strategy based on hybrid systems theory, nonlinear control, and safety-critical systems to enable cooperative locomotion of robotic guide dogs and visually impaired people. We address…

Optimization and Control · Mathematics 2019-04-08 Kaveh Akbari Hamed , Vinay R. Kamidi , Wen-Loong Ma , Alexander Leonessa , Aaron D. Ames

The simulation-to-real gap problem and the high computational burden of whole-body Model Predictive Control (whole-body MPC) continue to present challenges in generating a wide variety of movements using whole-body MPC for real humanoid…

Robotics · Computer Science 2024-09-16 Koji Ishihara , Hiroaki Gomi , Jun Morimoto

We present a framework for learning visually-guided quadruped locomotion by integrating exteroceptive sensing and central pattern generators (CPGs), i.e. systems of coupled oscillators, into the deep reinforcement learning (DRL) framework.…

Robotics · Computer Science 2024-03-12 Guillaume Bellegarda , Milad Shafiee , Auke Ijspeert

Entrainment of movement to a periodic stimulus is a characteristic intelligent behaviour in humans and an important goal for adaptive robotics. We demonstrate a quadruped central pattern generator (CPG), consisting of modified Matsuoka…

Adaptation and Self-Organizing Systems · Physics 2022-10-05 Alex Szorkovszky , Frank Veenstra , Kyrre Glette

In this paper, we present a model-free learning-based control scheme for the soft snake robot to improve its contact-aware locomotion performance in a cluttered environment. The control scheme includes two cooperative controllers: A…

Robotics · Computer Science 2021-05-12 Xuan Liu , Cagdas Onal , Jie Fu

Rhythmic gait patterns in animal locomotion are widely believed to be produced by a central pattern generator (CPG), a network of neurons that drives the muscle groups. In previous papers we have discussed how phase-synchronous signals can…

Dynamical Systems · Mathematics 2025-06-16 Ian Stewart , David Wood

Bio-hybrid systems---close couplings of natural organisms with technology---are high potential and still underexplored. In existing work, robots have mostly influenced group behaviors of animals. We explore the possibilities of mixing…

Neural and Evolutionary Computing · Computer Science 2018-04-20 Mostafa Wahby , Mary Katherine Heinrich , Daniel Nicolas Hofstadler , Payam Zahadat , Sebastian Risi , Phil Ayres , Thomas Schmickl , Heiko Hamann

Intelligent control of soft robots is challenging due to the nonlinear and difficult-to-model dynamics. One promising model-free approach for soft robot control is reinforcement learning (RL). However, model-free RL methods tend to be…

Robotics · Computer Science 2023-07-11 Xuan Liu , Cagdas Onal , Jie Fu

Everyday locomotion is a complex sensorimotor process that can unfold over multiple timescales, from long-term path planning to rapid, reactive adjustments. However, we lack an understanding of how factors such as environmental demands, or…

Machine Learning · Computer Science 2025-08-28 Wei-Chen Wang , Antoine De Comite , Alexandra Voloshina , Monica Daley , Nidhi Seethapathi

This paper aims to solve the contact-aware locomotion problem of a soft snake robot by developing bio-inspired contact-aware locomotion controllers. To provide effective contact information for the controllers, we develop a scale-covered…

Robotics · Computer Science 2023-11-16 Xuan Liu , Cagdas D. Onal , Jie Fu

Some of the most challenging environments on our planet are accessible to quadrupedal animals but remain out of reach for autonomous machines. Legged locomotion can dramatically expand the operational domains of robotics. However,…

Robotics · Computer Science 2020-10-23 Joonho Lee , Jemin Hwangbo , Lorenz Wellhausen , Vladlen Koltun , Marco Hutter