English
Related papers

Related papers: Learning natural locomotion behaviors for humanoid…

200 papers

Reinforcement learning agents can learn to solve sequential decision tasks by interacting with the environment. Human knowledge of how to solve these tasks can be incorporated using imitation learning, where the agent learns to imitate…

Artificial Intelligence · Computer Science 2019-09-24 Ruohan Zhang , Faraz Torabi , Lin Guan , Dana H. Ballard , Peter Stone

Several earlier studies have shown impressive control performance in complex robotic systems by designing the controller using a neural network and training it with model-free reinforcement learning. However, these outstanding controllers…

Enabling bipedal walking robots to learn how to maneuver over highly uneven, dynamically changing terrains is challenging due to the complexity of robot dynamics and interacted environments. Recent advancements in learning from…

Robotics · Computer Science 2023-09-29 Feiyang Wu , Zhaoyuan Gu , Hanran Wu , Anqi Wu , Ye Zhao

Humanoid robots are designed to navigate environments accessible to humans using their legs. However, classical research has primarily focused on controlled laboratory settings, resulting in a gap in developing controllers for navigating…

Robotics · Computer Science 2025-02-25 Wandong Sun , Long Chen , Yongbo Su , Baoshi Cao , Yang Liu , Zongwu Xie

This paper presents a hierarchical framework based on deep reinforcement learning that learns a diversity of policies for humanoid balance control. Conventional zero moment point based controllers perform limited actions during…

Robotics · Computer Science 2020-05-21 Chuanyu Yang , Taku Komura , Zhibin Li

Automatic fall recovery is a crucial prerequisite before humanoid robots can be reliably deployed. Hand-designing controllers for getting up is difficult because of the varied configurations a humanoid can end up in after a fall and the…

Robotics · Computer Science 2025-04-29 Xialin He , Runpei Dong , Zixuan Chen , Saurabh Gupta

The reinforcement learning paradigm allows, in principle, for complex behaviours to be learned directly from simple reward signals. In practice, however, it is common to carefully hand-design the reward function to encourage a particular…

Deep Reinforcement Learning (RL) has emerged as a promising method to develop humanoid robot locomotion controllers. Despite the robust and stable locomotion demonstrated by previous RL controllers, their behavior often lacks the natural…

Robotics · Computer Science 2025-02-06 Qiyuan Zhang , Chenfan Weng , Guanwu Li , Fulai He , Yusheng Cai

For the deployment of legged robots in real-world environments, it is essential to develop robust locomotion control methods for challenging terrains that may exhibit unexpected deformability and irregularity. In this paper, we explore the…

Robotics · Computer Science 2025-04-21 Rohan P. Singh , Mitsuharu Morisawa , Mehdi Benallegue , Zhaoming Xie , Fumio Kanehiro

An important current challenge in Human-Robot Interaction (HRI) is to enable robots to learn on-the-fly from human feedback. However, humans show a great variability in the way they reward robots. We propose to address this issue by…

Robotics · Computer Science 2020-05-11 Rémi Dromnelle , Benoît Girard , Erwan Renaudo , Raja Chatila , Mehdi Khamassi

Traditional imitation learning provides a set of methods and algorithms to learn a reward function or policy from expert demonstrations. Learning from demonstration has been shown to be advantageous for navigation tasks as it allows for…

Robotics · Computer Science 2021-08-03 Christian Ellis , Maggie Wigness , John G. Rogers , Craig Lennon , Lance Fiondella

Animals such as rabbits and birds can instantly generate locomotion behavior in reaction to a dynamic, approaching object, such as a person or a rock, despite having possibly never seen the object before and having limited perception of the…

Robotics · Computer Science 2022-03-22 Shangqun Yu , Sreehari Rammohan , Kaiyu Zheng , George Konidaris

Whole-body humanoid locomotion is challenging due to high-dimensional control, morphological instability, and the need for real-time adaptation to various terrains using onboard perception. Directly applying reinforcement learning (RL) with…

Humanoid locomotion is a key skill to bring humanoids out of the lab and into the real-world. Many motion generation methods for locomotion have been proposed including reinforcement learning (RL). RL locomotion policies offer great…

Robotics · Computer Science 2024-07-09 William Thibault , William Melek , Katja Mombaur

Legged robots must exhibit robust and agile locomotion across diverse, unstructured terrains, a challenge exacerbated under blind locomotion settings where terrain information is unavailable. This work introduces a hierarchical…

Robotics · Computer Science 2025-11-05 Matheus P. Angarola , Francisco Affonso , Marcelo Becker

Humanoid robots hold great potential to perform various human-level skills, involving unified locomotion and manipulation in real-world settings. Driven by advances in machine learning and the strength of existing model-based approaches,…

Motion mimicking, i.e., encouraging the control policy to mimic human motion, facilitates the learning of complex tasks via reinforcement learning (RL) for humanoid robots. Although standard RL frameworks demonstrate impressive locomotion…

Robotics · Computer Science 2026-03-10 Ludwig Chee-Ying Tay , I-Chia Chang , Yan Gu

While quadruped robots usually have good stability and load capacity, bipedal robots offer a higher level of flexibility / adaptability to different tasks and environments. A multi-modal legged robot can take the best of both worlds. In…

Robotics · Computer Science 2022-02-25 Chen Yu , Andre Rosendo

We present a unified gait-conditioned reinforcement learning framework that enables humanoid robots to perform standing, walking, running, and smooth transitions within a single recurrent policy. A compact reward routing mechanism…

Robotics · Computer Science 2025-09-16 Tianhu Peng , Lingfan Bao , Chengxu Zhou

Humanoid robots are envisioned as embodied intelligent agents capable of performing a wide range of human-level loco-manipulation tasks, particularly in scenarios requiring strenuous and repetitive labor. However, learning these skills is…

Robotics · Computer Science 2024-12-20 Junjia Liu , Zhuo Li , Minghao Yu , Zhipeng Dong , Sylvain Calinon , Darwin Caldwell , Fei Chen