English
Related papers

Related papers: Learn to Teach: Sample-Efficient Privileged Learni…

200 papers

Reinforcement learning (RL) is widely used for humanoid control, with on-policy methods such as Proximal Policy Optimization (PPO) enabling robust training via large-scale parallel simulation and, in some cases, zero-shot deployment to real…

Robotics · Computer Science 2026-02-24 Weidong Huang , Zhehan Li , Hangxin Liu , Biao Hou , Yao Su , Jingwen Zhang

We propose a control framework that integrates model-based bipedal locomotion with residual reinforcement learning (RL) to achieve robust and adaptive walking in the presence of real-world uncertainties. Our approach leverages a model-based…

Robotics · Computer Science 2026-01-23 Yashuai Yan , Tobias Egle , Christian Ott , Dongheui Lee

This work presents a case study of a learning-based approach for target driven map-less navigation. The underlying navigation model is an end-to-end neural network which is trained using a combination of expert demonstrations, imitation…

Recent advancements in legged robot perceptive locomotion have shown promising progress. However, terrain-aware humanoid locomotion remains largely constrained to two paradigms: depth image-based end-to-end learning and elevation map-based…

Robotics · Computer Science 2025-10-13 Jingkai Sun , Gang Han , Pihai Sun , Wen Zhao , Jiahang Cao , Jiaxu Wang , Yijie Guo , Qiang Zhang

Long-horizon tasks in robotic manipulation present significant challenges in reinforcement learning (RL) due to the difficulty of designing dense reward functions and effectively exploring the expansive state-action space. However, despite…

Machine Learning · Computer Science 2025-10-06 Adrià López Escoriza , Nicklas Hansen , Stone Tao , Tongzhou Mu , Hao Su

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning…

Machine Learning · Computer Science 2019-06-20 Tuomas Haarnoja , Sehoon Ha , Aurick Zhou , Jie Tan , George Tucker , Sergey Levine

Control of wheeled humanoid locomotion is a challenging problem due to the nonlinear dynamics and under-actuated characteristics of these robots. Traditionally, feedback controllers have been utilized for stabilization and locomotion.…

Robotics · Computer Science 2022-04-08 Donghoon Baek , Amartya Purushottam , Joao Ramos

Achieving robust locomotion on complex terrains remains a challenge due to high dimensional control and environmental uncertainties. This paper introduces a teacher prior framework based on the teacher student paradigm, integrating…

Robotics · Computer Science 2025-06-26 Fangcheng Jin , Yuqi Wang , Peixin Ma , Guodong Yang , Pan Zhao , En Li , Zhengtao Zhang

Humanoid robots are engineered to navigate terrains akin to those encountered by humans, which necessitates human-like locomotion and perceptual abilities. Currently, the most reliable controllers for humanoid motion rely exclusively on…

Robotics · Computer Science 2025-04-03 Wandong Sun , Baoshi Cao , Long Chen , Yongbo Su , Yang Liu , Zongwu Xie , Hong Liu

Optimal Control for legged robots has gone through a paradigm shift from position-based to torque-based control, owing to the latter's compliant and robust nature. In parallel to this shift, the community has also turned to Deep…

Robotics · Computer Science 2024-09-04 Shivam Sood , Ge Sun , Peizhuo Li , Guillaume Sartoretti

Humanoid robots are envisioned as embodied intelligent agents capable of performing a wide range of human-level loco-manipulation tasks, particularly in scenarios requiring strenuous and repetitive labor. However, learning these skills is…

Robotics · Computer Science 2024-12-20 Junjia Liu , Zhuo Li , Minghao Yu , Zhipeng Dong , Sylvain Calinon , Darwin Caldwell , Fei Chen

Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control.…

Robotics · Computer Science 2025-07-08 Dianyong Hou , Chengrui Zhu , Zhen Zhang , Zhibin Li , Chuang Guo , Yong Liu

In this paper, we propose a novel Deep Reinforcement Learning approach to address the mapless navigation problem, in which the locomotion actions of a humanoid robot are taken online based on the knowledge encoded in learned models.…

Robotics · Computer Science 2021-08-10 Andre Brandenburger , Diego Rodriguez , Sven Behnke

Deep reinforcement learning (RL) based controllers for legged robots have demonstrated impressive robustness for walking in different environments for several robot platforms. To enable the application of RL policies for humanoid robots in…

Robotics · Computer Science 2022-11-01 Rohan Pratap Singh , Mehdi Benallegue , Mitsuharu Morisawa , Rafael Cisneros , Fumio Kanehiro

In recent years, reinforcement learning (RL) has shown outstanding performance for locomotion control of highly articulated robotic systems. Such approaches typically involve tedious reward function tuning to achieve the desired motion…

Robotics · Computer Science 2022-03-29 Eric Vollenweider , Marko Bjelonic , Victor Klemm , Nikita Rudin , Joonho Lee , Marco Hutter

Reinforcement learning (RL) is a sub-domain of machine learning, mainly concerned with solving sequential decision-making problems by a learning agent that interacts with the decision environment to improve its behavior through the reward…

Machine Learning · Computer Science 2025-09-23 Hossein Hassani , Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif , Liang Lin

We introduce Reduced-Order Model-Guided Reinforcement Learning (ROM-GRL), a two-stage reinforcement learning framework for humanoid walking that requires no motion capture data or elaborate reward shaping. In the first stage, a compact…

Robotics · Computer Science 2025-09-24 Shuai Liu , Meng Cheng Lau

Agents that can learn to imitate given video observation -- \emph{without direct access to state or action information} are more applicable to learning in the natural world. However, formulating a reinforcement learning (RL) agent that…

Machine Learning · Computer Science 2023-07-14 Glen Berseth , Florian Golemo , Christopher Pal

We introduce Berkeley Humanoid, a reliable and low-cost mid-scale humanoid research platform for learning-based control. Our lightweight, in-house-built robot is designed specifically for learning algorithms with low simulation complexity,…

Robotics · Computer Science 2024-08-01 Qiayuan Liao , Bike Zhang , Xuanyu Huang , Xiaoyu Huang , Zhongyu Li , Koushil Sreenath

A random recurrent neural network, called a reservoir, can be used to learn robot movements conditioned on context inputs that encode task goals. The Learning is achieved by mapping the random dynamics of the reservoir modulated by context…

Robotics · Computer Science 2024-11-19 Zahra Koulaeizadeh , Erhan Oztop