English
Related papers

Related papers: Coordinated Humanoid Robot Locomotion with Symmetr…

200 papers

The ability to autonomously explore and resolve tasks with minimal human guidance is crucial for the self-development of embodied intelligence. Although reinforcement learning methods can largely ease human effort, it's challenging to…

Robotics · Computer Science 2024-12-19 Changxin Huang , Yanbin Chang , Junfan Lin , Junyang Liang , Runhao Zeng , Jianqiang Li

Achieving highly dynamic behaviors on humanoid robots, such as running, requires controllers that are both robust and precise, and hence difficult to design. Classical control methods offer valuable insight into how such systems can…

Robotics · Computer Science 2025-09-25 Zachary Olkin , Kejun Li , William D. Compton , Aaron D. Ames

This paper presents a hierarchical framework based on deep reinforcement learning that learns a diversity of policies for humanoid balance control. Conventional zero moment point based controllers perform limited actions during…

Robotics · Computer Science 2020-05-21 Chuanyu Yang , Taku Komura , Zhibin Li

Training manipulation policies for humanoid robots with diverse data enhances their robustness and generalization across tasks and platforms. However, learning solely from robot demonstrations is labor-intensive, requiring expensive…

Autonomous mobile robots operating in complex, dynamic environments face the dual challenge of navigating large-scale, structurally diverse spaces with static obstacles while safely interacting with various moving agents. Traditional…

Robotics · Computer Science 2026-01-01 Yury Kolomeytsev , Dmitry Golembiovsky

Learning generalizable robot manipulation policies, especially for complex multi-fingered humanoids, remains a significant challenge. Existing approaches primarily rely on extensive data collection and imitation learning, which are…

Robotics · Computer Science 2025-09-03 Toru Lin , Kartik Sachdev , Linxi Fan , Jitendra Malik , Yuke Zhu

The main novelty of the proposed approach is that it allows a robot to learn an end-to-end policy which can adapt to changes in the environment during execution. While goal conditioning of policies has been studied in the RL literature,…

Learning a locomotion policy for quadruped robots has traditionally been constrained to a specific robot morphology, mass, and size. The learning process must usually be repeated for every new robot, where hyperparameters and reward…

Robotics · Computer Science 2024-03-11 Milad Shafiee , Guillaume Bellegarda , Auke Ijspeert

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

Deep reinforcement learning (deep RL) holds the promise of automating the acquisition of complex controllers that can map sensory inputs directly to low-level actions. In the domain of robotic locomotion, deep RL could enable learning…

Machine Learning · Computer Science 2019-06-20 Tuomas Haarnoja , Sehoon Ha , Aurick Zhou , Jie Tan , George Tucker , Sergey Levine

Most modern approaches to quadruped locomotion focus on using Deep Reinforcement Learning (DRL) to learn policies from scratch, in an end-to-end manner. Such methods often fail to scale, as every new problem or application requires…

Robotics · Computer Science 2025-09-29 Vassil Atanassov , Wanming Yu , Siddhant Gangapurwala , James Wilson , Ioannis Havoutis

Training reinforcement learning (RL) policies for legged robots remains challenging due to high-dimensional continuous actions, hardware constraints, and limited exploration. Existing methods for locomotion and whole-body control work well…

Stabilizing unsecured payloads against the inherent oscillations of dynamic bipedal locomotion remains a critical engineering bottleneck for humanoids in unstructured environments. To solve this, we introduce ReST-RL, a hierarchical…

Robotics · Computer Science 2026-03-12 Anlun Huang , Zhenyu Wu , Soofiyan Atar , Yuheng Zhi , Michael Yip

Meta reinforcement learning (Meta-RL) is an approach wherein the experience gained from solving a variety of tasks is distilled into a meta-policy. The meta-policy, when adapted over only a small (or just a single) number of steps, is able…

Machine Learning · Computer Science 2022-09-28 Desik Rengarajan , Sapana Chaudhary , Jaewon Kim , Dileep Kalathil , Srinivas Shakkottai

Humanoid robots have demonstrated robust locomotion capabilities using Reinforcement Learning (RL)-based approaches. Further, to obtain human-like behaviors, existing methods integrate human motion-tracking or motion prior in the RL…

Robotics · Computer Science 2025-06-13 Dewei Wang , Xinmiao Wang , Xinzhe Liu , Jiyuan Shi , Yingnan Zhao , Chenjia Bai , Xuelong Li

Equivariant neural networks enforce symmetry within the structure of their convolutional layers, resulting in a substantial improvement in sample efficiency when learning an equivariant or invariant function. Such models are applicable to…

Robotics · Computer Science 2022-03-10 Dian Wang , Robin Walters , Robert Platt

Generating dynamic motions for legged robots remains a challenging problem. While reinforcement learning has achieved notable success in various legged locomotion tasks, producing highly dynamic behaviors often requires extensive reward…

Robotics · Computer Science 2026-01-01 Dongyun Kang , Min-Gyu Kim , Tae-Gyu Song , Hajun Kim , Sehoon Ha , Hae-Won Park

Designing control policies for legged locomotion is complex due to the under-actuated and non-continuous robot dynamics. Model-free reinforcement learning provides promising tools to tackle this challenge. However, a major bottleneck of…

Robotics · Computer Science 2022-03-08 Tsung-Yen Yang , Tingnan Zhang , Linda Luu , Sehoon Ha , Jie Tan , Wenhao Yu

Deep reinforcement learning (DRL) is a promising approach for developing legged locomotion skills. However, the iterative design process that is inevitable in practice is poorly supported by the default methodology. It is difficult to…

Robotics · Computer Science 2019-03-25 Zhaoming Xie , Patrick Clary , Jeremy Dao , Pedro Morais , Jonathan Hurst , Michiel van de Panne

Deep reinforcement learning (DRL) has emerged as an innovative solution for controlling legged robots in challenging environments using minimalist architectures. Traditional control methods for legged robots, such as inverse dynamics,…

Robotics · Computer Science 2024-12-13 Mincheol Kim , Nahyun Kwon , Jung-Yup Kim