English
Related papers

Related papers: Learning Smooth Humanoid Locomotion through Lipsch…

200 papers

Robotic loco-manipulation tasks often involve contact-rich interactions with the environment, requiring the joint modeling of contact force and robot position. However, recent visuomotor policies often focus solely on learning position or…

Robotics · Computer Science 2025-10-07 Peiyuan Zhi , Peiyang Li , Jianqin Yin , Baoxiong Jia , Siyuan Huang

Humanoid locomotion is a challenging task due to its inherent complexity and high-dimensional dynamics, as well as the need to adapt to diverse and unpredictable environments. In this work, we introduce a novel learning framework for…

Robotics · Computer Science 2025-10-16 Hyunyoung Jung , Zhaoyuan Gu , Ye Zhao , Hae-Won Park , Sehoon Ha

Parkour poses a significant challenge for legged robots, requiring navigation through complex environments with agility and precision based on limited sensory inputs. In this work, we introduce a novel method for training end-to-end visual…

Robotics · Computer Science 2024-09-23 Elliot Chane-Sane , Joseph Amigo , Thomas Flayols , Ludovic Righetti , Nicolas Mansard

Training reinforcement learning (RL) policies for legged robots remains challenging due to high-dimensional continuous actions, hardware constraints, and limited exploration. Existing methods for locomotion and whole-body control work well…

Deep reinforcement learning has seen successful implementations on humanoid robots to achieve dynamic walking. However, these implementations have been so far successful in simple environments void of obstacles. In this paper, we aim to…

Robotics · Computer Science 2024-10-14 Marwan Hamze , Mitsuharu Morisawa , Eiichi Yoshida

Reinforcement Learning (RL) has been widely applied to many control tasks and substantially improved the performances compared to conventional control methods in many domains where the reward function is well defined. However, for many…

Machine Learning · Computer Science 2024-03-22 Baohe Zhang , Yuan Zhang , Lilli Frison , Thomas Brox , Joschka Bödecker

Reinforcement Learning (RL) has achieved remarkable success in safety-critical areas, but it can be weakened by adversarial attacks. Recent studies have introduced "smoothed policies" in order to enhance its robustness. Yet, it is still…

Machine Learning · Computer Science 2023-12-13 Ronghui Mu , Leandro Soriano Marcolino , Tianle Zhang , Yanghao Zhang , Xiaowei Huang , Wenjie Ruan

Bipedal humanoid robots must precisely coordinate balance, timing, and contact decisions when locomoting on constrained footholds such as stepping stones, beams, and planks -- even minor errors can lead to catastrophic failure. Classical…

Robotics · Computer Science 2026-01-13 Min Dai , William D. Compton , Junheng Li , Lizhi Yang , Aaron D. Ames

Humanoid robots are well suited for human habitats due to their morphological similarity, but developing controllers for them is a challenging task that involves multiple sub-problems, such as control, planning and perception. In this…

Robotics · Computer Science 2023-10-11 K. Niranjan Kumar , Irfan Essa , Sehoon Ha

Robust closed-loop locomotion remains challenging for soft quadruped robots due to high-dimensional dynamics, actuator hysteresis, and difficult-to-model contact interactions, while conventional proprioception provides limited information…

Robotics · Computer Science 2026-02-16 Storm de Kam , Ebrahim Shahabi , Cosimo Della Santina

Balancing and push-recovery are essential capabilities enabling humanoid robots to solve complex locomotion tasks. In this context, classical control systems tend to be based on simplified physical models and hard-coded strategies. Although…

Reinforcement learning (RL) has demonstrated remarkable capability in acquiring robot skills, but learning each new skill still requires substantial data collection for training. The pretrain-and-finetune paradigm offers a promising…

Robotics · Computer Science 2025-03-25 Ziang Zheng , Guojian Zhan , Bin Shuai , Shengtao Qin , Jiangtao Li , Tao Zhang , Shengbo Eben Li

As reinforcement learning (RL) has achieved great success and been even adopted in safety-critical domains such as autonomous vehicles, a range of empirical studies have been conducted to improve its robustness against adversarial attacks.…

Machine Learning · Computer Science 2022-03-17 Fan Wu , Linyi Li , Zijian Huang , Yevgeniy Vorobeychik , Ding Zhao , Bo Li

Motion mimicking, i.e., encouraging the control policy to mimic human motion, facilitates the learning of complex tasks via reinforcement learning (RL) for humanoid robots. Although standard RL frameworks demonstrate impressive locomotion…

Robotics · Computer Science 2026-03-10 Ludwig Chee-Ying Tay , I-Chia Chang , Yan Gu

Visuomotor policies trained via behavior cloning are vulnerable to covariate shift, where small deviations from expert trajectories can compound into failure. Common strategies to mitigate this issue involve expanding the training…

Robotics · Computer Science 2025-08-11 Zhanyi Sun , Shuran Song

Deep reinforcement learning produces robust locomotion policies for legged robots over challenging terrains. To date, few studies have leveraged model-based methods to combine these locomotion skills with the precise control of…

Robotics · Computer Science 2022-01-12 Yuntao Ma , Farbod Farshidian , Takahiro Miki , Joonho Lee , Marco Hutter

Achieving highly dynamic behaviors on humanoid robots, such as running, requires controllers that are both robust and precise, and hence difficult to design. Classical control methods offer valuable insight into how such systems can…

Robotics · Computer Science 2025-09-25 Zachary Olkin , Kejun Li , William D. Compton , Aaron D. Ames

Recent work in imitation learning has shown that having an expert controller that is both suitably smooth and stable enables stronger guarantees on the performance of the learned controller. However, constructing such smoothed expert…

Systems and Control · Electrical Eng. & Systems 2024-10-02 Daniel Pfrommer , Swati Padmanabhan , Kwangjun Ahn , Jack Umenberger , Tobia Marcucci , Zakaria Mhammedi , Ali Jadbabaie

Learning-based approaches, particularly reinforcement learning (RL), have become widely used for developing control policies for autonomous agents, such as locomotion policies for legged robots. RL training typically maximizes a predefined…

Robotics · Computer Science 2025-04-23 Dylan Khor , Bowen Weng

Recent advances of locomotion controllers utilizing deep reinforcement learning (RL) have yielded impressive results in terms of achieving rapid and robust locomotion across challenging terrain, such as rugged rocks, non-rigid ground, and…

Robotics · Computer Science 2024-03-07 Zifan Xu , Amir Hossain Raj , Xuesu Xiao , Peter Stone