English
Related papers

Related papers: Benchmarking Model Predictive Control and Reinforc…

200 papers

Legged robots possess a unique ability to traverse rough terrains and navigate cluttered environments, making them well-suited for complex, real-world unstructured scenarios. However, such robots have not yet achieved the same level as seen…

Robotics · Computer Science 2025-08-19 Hossein Keshavarz , Alejandro Ramirez-Serrano , Majid Khadiv

We present Residual Policy Learning (RPL): a simple method for improving nondifferentiable policies using model-free deep reinforcement learning. RPL thrives in complex robotic manipulation tasks where good but imperfect controllers are…

Robotics · Computer Science 2019-01-04 Tom Silver , Kelsey Allen , Josh Tenenbaum , Leslie Kaelbling

A great advantage of legged robots is their ability to operate on particularly difficult and obstructed terrain, which demands dynamic, robust, and precise movements. The study of obstacle courses provides invaluable insights into the…

Robotics · Computer Science 2024-08-27 Maximilian Albracht , Shivesh Kumar , Shubham Vyas , Frank Kirchner

Adaptation to unpredictable damages is crucial for autonomous legged robots, yet existing methods based on multi-policy or meta-learning frameworks face challenges like limited generalization and complex maintenance. To address this issue,…

Robotics · Computer Science 2025-02-06 Yu Qiu , Xin Lin , Jingbo Wang , Xiangtai Li , Lu Qi , Ming-Hsuan Yang

Reinforcement Learning (RL) robot controllers usually aggregate many task objectives into one scalar reward. While large-scale proximal policy optimisation (PPO) has enabled impressive results such as robust robot locomotion in the real…

Robotics · Computer Science 2025-09-19 Humphrey Munn , Brendan Tidd , Peter Böhm , Marcus Gallagher , David Howard

Reinforcement learning (RL) excels in various applications but struggles in dynamic environments where the underlying Markov decision process evolves. Continual reinforcement learning (CRL) enables RL agents to continually learn and adapt…

Machine Learning · Computer Science 2025-12-23 Xue Yang , Michael Schukat , Junlin Lu , Patrick Mannion , Karl Mason , Enda Howley

Model predictive control (MPC) is a powerful trajectory optimization control technique capable of controlling complex nonlinear systems while respecting system constraints and ensuring safe operation. The MPC's capabilities come at the cost…

Systems and Control · Electrical Eng. & Systems 2021-02-23 Eivind Bøhn , Sebastien Gros , Signe Moe , Tor Arne Johansen

Robotic collaborative carrying could greatly benefit human activities like warehouse and construction site management. However, coordinating the simultaneous motion of multiple robots represents a significant challenge. Existing works…

Robotics · Computer Science 2026-03-25 Francesca Bray , Simone Tolomei , Andrei Cramariuc , Cesar Cadena , Marco Hutter

Amphibious legged robots inspired by salamanders are promising in applications in complex amphibious environments. However, despite the significant success of training controllers that achieve diverse locomotion behaviors in conventional…

Robotics · Computer Science 2026-03-18 Mengze Tian , Qiyuan Fu , Chuanfang Ning , Javier Jia Jie Pey , Auke Ijspeert

Deep reinforcement learning (RL) has been endowed with high expectations in tackling challenging manipulation tasks in an autonomous and self-directed fashion. Despite the significant strides made in the development of reinforcement…

Robotics · Computer Science 2023-04-27 Zhenshan Bing , Aleksandr Mavrichev , Sicong Shen , Xiangtong Yao , Kejia Chen , Kai Huang , Alois Knoll

Recent progress in legged locomotion has rendered quadruped manipulators a promising solution for performing tasks that require both mobility and manipulation (loco-manipulation). In the real world, task specifications and/or environment…

Robotics · Computer Science 2024-01-09 Ioannis Dadiotis , Arturo Laurenzi , Nikos Tsagarakis

Wheeled-legged robots hold promise for traversing complex terrains and offer superior mobility compared to legged robots. However, wheeled-legged robots must effectively balance both wheeled driving and legged control. Furthermore, due to…

Robotics · Computer Science 2026-05-14 Yuqi Li , Peng Zhai , Yueqi Zhang , Xiaoyi Wei , Quancheng Qian , Zhengxu He , Qianxiang Yu , Lihua Zhang

The configuration of most robotic systems lies in continuous transformation groups. However, in mobile robot trajectory tracking, many recent works still naively utilize optimization methods for elements in vector space without considering…

Systems and Control · Electrical Eng. & Systems 2024-03-13 Jiawei Tang , Shuang Wu , Bo Lan , Yahui Dong , Yuqiang Jin , Guangjian Tian , Wen-An Zhang , Ling Shi

Humanoid robots hold great potential for diverse interactions and daily service tasks within human-centered environments, necessitating controllers that seamlessly integrate precise locomotion with dexterous manipulation. However, most…

Robotics · Computer Science 2026-01-27 Xinru Cui , Linxi Feng , Yixuan Zhou , Haoqi Han , Zhe Liu , Hesheng Wang

Dynamic legged locomotion is a challenging topic because of the lack of established control schemes which can handle aerial phases, short stance times, and high-speed leg swings. In this paper, we propose a controller combining whole-body…

Robotics · Computer Science 2019-09-17 Donghyun Kim , Jared Di Carlo , Benjamin Katz , Gerardo Bledt , Sangbae Kim

In recent years, reinforcement learning (RL) based quadrupedal locomotion control has emerged as an extensively researched field, driven by the potential advantages of autonomous learning and adaptation compared to traditional control…

Robotics · Computer Science 2024-10-15 Maurya Gurram , Prakash Kumar Uttam , Shantipal S. Ohol

Many of the challenges facing today's reinforcement learning (RL) algorithms, such as robustness, generalization, transfer, and computational efficiency are closely related to compression. Prior work has convincingly argued why minimizing…

Machine Learning · Computer Science 2021-09-08 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

Machine Learning · Computer Science 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

Linear Model Predictive Control (MPC) has been successfully used for generating feasible walking motions for humanoid robots. However, the effect of uncertainties on constraints satisfaction has only been studied using Robust MPC (RMPC)…

Systems and Control · Electrical Eng. & Systems 2020-11-16 Ahmad Gazar , Majid Khadiv , Andrea Del Prete , Ludovic Righetti

Learning controllers that reproduce legged locomotion in nature has been a long-time goal in robotics and computer graphics. While yielding promising results, recent approaches are not yet flexible enough to be applicable to legged systems…

Robotics · Computer Science 2022-07-26 Daniel Ordonez-Apraez , Antonio Agudo , Francesc Moreno-Noguer , Mario Martin