English
Related papers

Related papers: Template Model Inspired Task Space Learning for Ro…

200 papers

This paper presents a scalable and adaptive control framework for legged robots that integrates Iterative Learning Control (ILC) with a biologically inspired torque library (TL), analogous to muscle memory. The proposed method addresses key…

Robotics · Computer Science 2026-04-10 Jing Cheng , Yasser G. Alqaham , Zhenyu Gan , Amit K. Sanyal

Controller design for bipedal walking on dynamic rigid surfaces (DRSes), which are rigid surfaces moving in the inertial frame (e.g., ships and airplanes), remains largely uninvestigated. This paper introduces a hierarchical control…

Robotics · Computer Science 2022-12-01 Yuan Gao , Yukai Gong , Victor Paredes , Ayonga Hereid , Yan Gu

This work introduces a hierarchical strategy for terrain-aware bipedal locomotion that integrates reduced-dimensional perceptual representations to enhance reinforcement learning (RL)-based high-level (HL) policies for real-time gait…

Robotics · Computer Science 2025-12-16 Guillermo A. Castillo , Himanshu Lodha , Ayonga Hereid

This paper proposes a modular framework to generate robust biped locomotion using a tight coupling between an analytical walking approach and deep reinforcement learning. This framework is composed of six main modules which are…

Robotics · Computer Science 2021-12-23 Mohammadreza Kasaei , Miguel Abreu , Nuno Lau , Artur Pereira , Luis Paulo Reis

Bipedal humanoid robots must precisely coordinate balance, timing, and contact decisions when locomoting on constrained footholds such as stepping stones, beams, and planks -- even minor errors can lead to catastrophic failure. Classical…

Robotics · Computer Science 2026-01-13 Min Dai , William D. Compton , Junheng Li , Lizhi Yang , Aaron D. Ames

Reinforcement learning (RL) has become a promising approach to developing controllers for quadrupedal robots. Conventionally, an RL design for locomotion follows a position-based paradigm, wherein an RL policy outputs target joint positions…

Robotics · Computer Science 2023-03-14 Shuxiao Chen , Bike Zhang , Mark W. Mueller , Akshara Rai , Koushil Sreenath

This study examines the problem of hopping robot navigation planning to achieve simultaneous goal-directed and environment exploration tasks. We consider a scenario in which the robot has mandatory goal-directed tasks defined using Linear…

Robotics · Computer Science 2024-07-10 Jesse Jiang , Samuel Coogan , Ye Zhao

The design of feedback controllers for bipedal robots is challenging due to the hybrid nature of its dynamics and the complexity imposed by high-dimensional bipedal models. In this paper, we present a novel approach for the design of…

Robotics · Computer Science 2018-10-05 Guillermo A. Castillo , Bowen Weng , Ayonga Hereid , Wei Zhang

This paper presents a comprehensive study on using deep reinforcement learning (RL) to create dynamic locomotion controllers for bipedal robots. Going beyond focusing on a single locomotion skill, we develop a general control solution that…

Robotics · Computer Science 2024-08-27 Zhongyu Li , Xue Bin Peng , Pieter Abbeel , Sergey Levine , Glen Berseth , Koushil Sreenath

Learning controllers that reproduce legged locomotion in nature has been a long-time goal in robotics and computer graphics. While yielding promising results, recent approaches are not yet flexible enough to be applicable to legged systems…

Robotics · Computer Science 2022-07-26 Daniel Ordonez-Apraez , Antonio Agudo , Francesc Moreno-Noguer , Mario Martin

Recent advances in deep reinforcement learning (RL) based techniques combined with training in simulation have offered a new approach to developing robust controllers for legged robots. However, the application of such approaches to real…

Robotics · Computer Science 2023-08-08 Rohan Pratap Singh , Zhaoming Xie , Pierre Gergondet , Fumio Kanehiro

This paper presents a gait controller for bipedal robots to achieve highly agile walking over various terrains given local slope and friction cone information. Without these considerations, untimely impacts can cause a robot to trip and…

Robotics · Computer Science 2023-02-22 Grant Gibson , Oluwami Dosunmu-Ogunbi , Yukai Gong , Jessy Grizzle

Reinforcement Learning (RL)-based methods have significantly improved the locomotion performance of legged robots. However, these motion policies face significant challenges when deployed in the real world. Robots operating in uncertain…

Robotics · Computer Science 2025-06-03 Yang Zhang , Buqing Nie , Zhanxiang Cao , Yangqing Fu , Yue Gao

We propose a control framework that integrates model-based bipedal locomotion with residual reinforcement learning (RL) to achieve robust and adaptive walking in the presence of real-world uncertainties. Our approach leverages a model-based…

Robotics · Computer Science 2026-01-23 Yashuai Yan , Tobias Egle , Christian Ott , Dongheui Lee

Multi-robot cooperative transport is crucial in logistics, housekeeping, and disaster response. However, it poses significant challenges in environments where objects of various weights are mixed and the number of robots and objects varies.…

Robotics · Computer Science 2024-04-04 Yusei Naito , Tomohiko Jimbo , Tadashi Odashima , Takamitsu Matsubara

Recent advances of locomotion controllers utilizing deep reinforcement learning (RL) have yielded impressive results in terms of achieving rapid and robust locomotion across challenging terrain, such as rugged rocks, non-rigid ground, and…

Robotics · Computer Science 2024-03-07 Zifan Xu , Amir Hossain Raj , Xuesu Xiao , Peter Stone

Reinforcement learning (RL) has demonstrated impressive performance in legged locomotion over various challenging environments. However, due to the sim-to-real gap and lack of explainability, unconstrained RL policies deployed in the real…

Robotics · Computer Science 2025-06-06 Haoyu Wang , Ruyi Zhou , Liang Ding , Tie Liu , Zhelin Zhang , Peng Xu , Haibo Gao , Zongquan Deng

Wheeled-legged robots combine the efficiency of wheeled robots when driving on suitably flat surfaces and versatility of legged robots when stepping over or around obstacles. This paper introduces a planning and control framework to realise…

Robotics · Computer Science 2020-03-10 Songyan Xin , Sethu Vijayakumar

While quadruped robots usually have good stability and load capacity, bipedal robots offer a higher level of flexibility / adaptability to different tasks and environments. A multi-modal legged robot can take the best of both worlds. In…

Robotics · Computer Science 2022-02-25 Chen Yu , Andre Rosendo

We propose a robust dynamic walking controller consisting of a dynamic locomotion planner, a reinforcement learning process for robustness, and a novel whole-body locomotion controller (WBLC). Previous approaches specify either the position…

Robotics · Computer Science 2017-08-08 Donghyun Kim , Jaemin Lee , Luis Sentis