English
Related papers

Related papers: No More Marching: Learning Humanoid Locomotion for…

200 papers

A motion-based control interface promises flexible robot operations in dangerous environments by combining user intuitions with the robot's motor capabilities. However, designing a motion interface for non-humanoid robots, such as…

Robotics · Computer Science 2022-04-29 Sunwoo Kim , Maks Sorokin , Jehee Lee , Sehoon Ha

Deep reinforcement learning (RL) based controllers for legged robots have demonstrated impressive robustness for walking in different environments for several robot platforms. To enable the application of RL policies for humanoid robots in…

Robotics · Computer Science 2022-11-01 Rohan Pratap Singh , Mehdi Benallegue , Mitsuharu Morisawa , Rafael Cisneros , Fumio Kanehiro

Building intelligent autonomous systems at any scale is challenging. The sensing and computation constraints of a microrobot platform make the problems harder. We present improvements to learning-based methods for on-board learning of…

Robotics · Computer Science 2020-04-29 Nathan O. Lambert , Farhan Toddywala , Brian Liao , Eric Zhu , Lydia Lee , Kristofer S. J. Pister

We introduce Reduced-Order Model-Guided Reinforcement Learning (ROM-GRL), a two-stage reinforcement learning framework for humanoid walking that requires no motion capture data or elaborate reward shaping. In the first stage, a compact…

Robotics · Computer Science 2025-09-24 Shuai Liu , Meng Cheng Lau

Current approaches to humanoid control generally fall into two paradigms: perceptive locomotion, which handles terrain well but is limited to pedal gaits, and general motion tracking, which reproduces complex skills but ignores…

Robotics · Computer Science 2026-01-13 Ziwen Zhuang , Shaoting Zhu , Mengjie Zhao , Hang Zhao

Robots are good at performing repetitive tasks in modern manufacturing industries. However, robot motions are mostly planned and preprogrammed with a notable lack of adaptivity to task changes. Even for slightly changed tasks, the whole…

Systems and Control · Electrical Eng. & Systems 2022-07-04 Tian Yu , Qing Chang

This paper introduces a new approach to enhance the robustness of humanoid walking under strong perturbations, such as substantial pushes. Effective recovery from external disturbances requires bipedal robots to dynamically adjust their…

Robotics · Computer Science 2024-11-05 Tobias Egle , Yashuai Yan , Dongheui Lee , Christian Ott

Learning diverse locomotion skills for humanoid robots in a unified reinforcement learning framework remains challenging due to the conflicting requirements of stability and dynamic expressiveness across different gaits. We present a…

Robotics · Computer Science 2026-04-22 Yuanye Wu , Keyi Wang , Linqi Ye , Boyang Xing

This research focuses on developing reinforcement learning approaches for the locomotion generation of small-size quadruped robots. The rat robot NeRmo is employed as the experimental platform. Due to the constrained volume, small-size…

Robotics · Computer Science 2024-04-16 Xinhui Shan , Yuhong Huang , Zhenshan Bing , Zitao Zhang , Xiangtong Yao , Kai Huang , Alois Knoll

In this paper, we present a learning-based approach that allows a robot to quickly follow a reference path defined in joint space without exceeding limits on the position, velocity, acceleration and jerk of each robot joint. Contrary to…

Robotics · Computer Science 2022-10-21 Jonas C. Kiemel , Torsten Kröger

In swarm robotics, confrontation scenarios, including strategic confrontations, require efficient decision-making that integrates discrete commands and continuous actions. Traditional task and motion planning methods separate…

Robotics · Computer Science 2025-08-28 Qizhen Wu , Lei Chen , Kexin Liu , Jinhu Lu

Model-based next state prediction and state value prediction are slow to converge. To address these challenges, we do the following: i) Instead of a neural network, we do model-based planning using a parallel memory retrieval system (which…

Artificial Intelligence · Computer Science 2023-02-02 John Chong Min Tan , Mehul Motani

This work presents a meta-reinforcement learning approach to develop a universal locomotion control policy capable of zero-shot generalization across diverse quadrupedal platforms. The proposed method trains an RL agent equipped with a…

Robotics · Computer Science 2024-11-05 Fatemeh Zargarbashi , Fabrizio Di Giuro , Jin Cheng , Dongho Kang , Bhavya Sukhija , Stelian Coros

Humanoid robots hold great promise in assisting humans in diverse environments and tasks, due to their flexibility and adaptability leveraging human-like morphology. However, research in humanoid robots is often bottlenecked by the costly…

Robotics · Computer Science 2024-06-21 Carmelo Sferrazza , Dun-Ming Huang , Xingyu Lin , Youngwoon Lee , Pieter Abbeel

The research addresses sensor task management for radar systems, focusing on efficiently searching and tracking multiple targets using reinforcement learning. The approach develops a 3D simulation environment with an active electronically…

Machine Learning · Computer Science 2025-02-20 Jan-Hendrik Ewers , David Cormack , Joe Gibbs , David Anderson

Agents that can learn to imitate given video observation -- \emph{without direct access to state or action information} are more applicable to learning in the natural world. However, formulating a reinforcement learning (RL) agent that…

Machine Learning · Computer Science 2023-07-14 Glen Berseth , Florian Golemo , Christopher Pal

Model free reinforcement learning suffers from the high sampling complexity inherent to robotic manipulation or locomotion tasks. Most successful approaches typically use random sampling strategies which leads to slow policy convergence. In…

Robotics · Computer Science 2019-08-13 Miroslav Bogdanovic , Ludovic Righetti

Automatic fall recovery is a crucial prerequisite before humanoid robots can be reliably deployed. Hand-designing controllers for getting up is difficult because of the varied configurations a humanoid can end up in after a fall and the…

Robotics · Computer Science 2025-04-29 Xialin He , Runpei Dong , Zixuan Chen , Saurabh Gupta

To dynamically traverse challenging terrain, legged robots need to continually perceive and reason about upcoming features, adjust the locations and timings of future footfalls and leverage momentum strategically. We present a pipeline that…

Robotics · Computer Science 2021-04-20 Oliwier Melon , Romeo Orsolino , David Surovik , Mathieu Geisert , Ioannis Havoutis , Maurice Fallon

Hiking on complex trails demands balance, agility, and adaptive decision-making over unpredictable terrain. Current humanoid research remains fragmented and inadequate for hiking: locomotion focuses on motor skills without long-term goals…

Robotics · Computer Science 2025-05-12 Kwan-Yee Lin , Stella X. Yu