English
Related papers

Related papers: RANDPOL: Parameter-Efficient End-to-End Quadruped …

200 papers

Enabling humanoid robots to achieve natural and dynamic locomotion across a wide range of speeds, including smooth transitions from walking to running, presents a significant challenge. Existing deep reinforcement learning methods typically…

Robotics · Computer Science 2025-09-26 Qingpeng Li , Chengrui Zhu , Yanming Wu , Xin Yuan , Zhen Zhang , Jian Yang , Yong Liu

We address the decision-making capability within an end-to-end planning framework that focuses on motion prediction, decision-making, and trajectory planning. Specifically, we formulate decision-making and trajectory planning as a…

Robotics · Computer Science 2024-12-03 Wenru Liu , Yongkang Song , Chengzhen Meng , Zhiyu Huang , Haochen Liu , Chen Lv , Jun Ma

We present a single, general locomotion policy trained on a diverse collection of 50 legged robots. By combining an improved embodiment-aware architecture (URMAv2) with a performance-based curriculum for extreme Embodiment Randomization,…

Robotics · Computer Science 2025-09-04 Nico Bohlinger , Jan Peters

This paper proposes a safe reinforcement learning (RL) framework based on forward-invariance-induced action-space design. The control problem is cast as a Markov decision process, but instead of relying on runtime shielding or penalty-based…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Chieh Tsai , Muhammad Junayed Hasan Zahed , Salim Hariri , Hossein Rastgoftar

The robustness of legged locomotion is crucial for quadrupedal robots in challenging terrains. Recently, Reinforcement Learning (RL) has shown promising results in legged locomotion and various methods try to integrate privileged…

Robotics · Computer Science 2023-09-04 Jiyuan Shi , Chenjia Bai , Haoran He , Lei Han , Dong Wang , Bin Zhao , Mingguo Zhao , Xiu Li , Xuelong Li

Learning is the basis of both biological and artificial systems when it comes to mimicking intelligent behaviors. From the classical PPO (Proximal Policy Optimization), there is a series of deep reinforcement learning algorithms which are…

Robotics · Computer Science 2025-12-16 Wanru Gong , Xinyi Zheng , Yuan Hui , Zhongjun Li , Weiqiang Wang , Xiaoqing Zhu

This work studies reinforcement learning (RL) in the context of multi-period supply chains subject to constraints, e.g., on production and inventory. We introduce Distributional Constrained Policy Optimization (DCPO), a novel approach for…

Machine Learning · Computer Science 2023-02-06 Jaime Sabal Bermúdez , Antonio del Rio Chanona , Calvin Tsay

Sophisticated multilayer neural networks have achieved state of the art results on multiple supervised tasks. However, successful applications of such multilayer networks to control have so far been limited largely to the perception portion…

Machine Learning · Computer Science 2013-11-08 Sergey Levine

Humanoid robots hold great potential for diverse interactions and daily service tasks within human-centered environments, necessitating controllers that seamlessly integrate precise locomotion with dexterous manipulation. However, most…

Robotics · Computer Science 2026-01-27 Xinru Cui , Linxi Feng , Yixuan Zhou , Haoqi Han , Zhe Liu , Hesheng Wang

This work explores techniques to scale up image-based end-to-end learning for dexterous grasping with an arm + hand system. Unlike state-based RL, vision-based RL is much more memory inefficient, resulting in relatively low batch sizes,…

Robotics · Computer Science 2025-09-23 Ritvik Singh , Karl Van Wyk , Pieter Abbeel , Jitendra Malik , Nathan Ratliff , Ankur Handa

The challenges presented in an autonomous racing situation are distinct from those faced in regular autonomous driving and require faster end-to-end algorithms and consideration of a longer horizon in determining optimal current actions…

Robotics · Computer Science 2021-12-01 Praveen Venkatesh , Rwik Rana , Harish PM

Reinforcement learning has recently enabled impressive locomotion capabilities on legged robots; however, most policy architectures remain morphology- and symmetry-agnostic, leading to inefficient training and limited generalization. This…

Robotics · Computer Science 2025-12-02 Sizhe Wei , Xulin Chen , Fengze Xie , Garrett Ethan Katz , Zhenyu Gan , Lu Gan

Recent advances in GPU-based parallel simulation have enabled practitioners to collect large amounts of data and train complex control policies using deep reinforcement learning (RL), on commodity GPUs. However, such successes for RL in…

Machine Learning · Computer Science 2025-03-03 Eliot Xing , Vernon Luk , Jean Oh

In this paper, we seek to learn a robot policy guaranteed to satisfy state constraints. To encourage constraint satisfaction, existing RL algorithms typically rely on Constrained Markov Decision Processes and discourage constraint…

Robotics · Computer Science 2024-11-06 Jean-Baptiste Bouvier , Kartik Nagpal , Negar Mehr

Constrained reinforcement learning has achieved promising progress in safety-critical fields where both rewards and constraints are considered. However, constrained reinforcement learning methods face challenges in striking the right…

Machine Learning · Computer Science 2024-10-29 Jianmina Ma , Jingtian Ji , Yue Gao

In this paper, a novel deep reinforcement learning (DRL)-based method is proposed to navigate the robot team through unknown complex environments, where the geometric centroid of the robot team aims to reach the goal position while avoiding…

Robotics · Computer Science 2019-07-04 Juntong Lin , Xuyun Yang , Peiwei Zheng , Hui Cheng

Trajectory sampling in the Frenet(road-aligned) frame, is one of the most popular methods for motion planning of autonomous vehicles. It operates by sampling a set of behavioural inputs, such as lane offset and forward speed, before solving…

Robotics · Computer Science 2023-10-24 Jatan Shrestha , Simon Idoko , Basant Sharma , Arun Kumar Singh

Quadrupedal robots resemble the physical ability of legged animals to walk through unstructured terrains. However, designing a controller for quadrupedal robots poses a significant challenge due to their functional complexity and requires…

Robotics · Computer Science 2023-03-06 I Made Aswin Nahrendra , Byeongho Yu , Hyun Myung

Simplicity is a critical inductive bias for designing data-driven controllers, especially when robustness is important. Despite the impressive results of deep reinforcement learning in complex control tasks, it is prone to capturing…

Machine Learning · Computer Science 2025-05-09 Bang You , Chenxu Wang , Huaping Liu

Robust reinforcement learning (Robust RL) seeks to handle epistemic uncertainty in environment dynamics, but existing approaches often rely on nested min--max optimization, which is computationally expensive and yields overly conservative…

Machine Learning · Computer Science 2025-10-15 Chenliang Li , Junyu Leng , Jiaxiang Li , Youbang Sun , Shixiang Chen , Shahin Shahrampour , Alfredo Garcia