English
Related papers

Related papers: RL-augmented MPC Framework for Agile and Robust Bi…

200 papers

In this work, we demonstrate robust walking in the bipedal robot Digit on uneven terrains by just learning a single linear policy. In particular, we propose a new control pipeline, wherein the high-level trajectory modulator shapes the…

Designing a humanoid locomotion controller is challenging and classically split up in sub-problems. Footstep planning is one of those, where the sequence of footsteps is defined. Even in simpler environments, finding a minimal sequence, or…

Robotics · Computer Science 2024-12-18 Clément Gaspard , Grégoire Passault , Mélodie Daniel , Olivier Ly

This paper presents a safe learning-based eco-driving framework tailored for mixed traffic flows, which aims to optimize energy efficiency while guaranteeing safety during real-system operations. Even though reinforcement learning (RL) is…

Systems and Control · Electrical Eng. & Systems 2024-02-01 Ke Lu , Dongjun Li , Qun Wang , Kaidi Yang , Lin Zhao , Ziyou Song

Robotic manipulators are essential for precise industrial pick-and-place operations, yet planning collision-free trajectories in dynamic environments remains challenging due to uncertainties such as sensor noise and time-varying delays.…

Convex model predictive controls (MPCs) with a single rigid body model have demonstrated strong performance on real legged robots. However, convex MPCs are limited by their assumptions such as small rotation angle and pre-defined gait,…

Robotics · Computer Science 2022-09-28 Xuan Lin , Feng Xu , Alexander Schperberg , Dennis Hong

Online reinforcement learning (RL) methods are often data-inefficient or unreliable, making them difficult to train on real robotic hardware, especially quadruped robots. Learning robotic tasks from pre-collected data is a promising…

Robotics · Computer Science 2024-10-28 Hongyin Zhang , Shuyu Yang , Donglin Wang

Quadruped robots excel in traversing complex, unstructured environments where wheeled robots often fail. However, enabling efficient and adaptable locomotion remains challenging due to the quadrupeds' nonlinear dynamics, high degrees of…

Robotics · Computer Science 2025-05-14 Anudeep Sajja , Shahram Khorshidi , Sebastian Houben , Maren Bennewitz

This paper proposes a novel control method for an autonomous wheel loader, enabling time-efficient navigation to an arbitrary goal pose. Unlike prior works which combine high-level trajectory planners with Model Predictive Control (MPC), we…

Robotics · Computer Science 2025-04-08 Aleksi Mäki-Penttilä , Naeim Ebrahimi Toulkani , Reza Ghabcheloo

Reinforcement learning (RL) for motion planning of multi-degree-of-freedom robots still suffers from low efficiency in terms of slow training speed and poor generalizability. In this paper, we propose a novel RL-based robot motion planning…

Robotics · Computer Science 2024-08-20 Zengjie Zhang , Jayden Hong , Amir Soufi Enayati , Homayoun Najjaran

This paper presents a hybrid approach that integrates trajectory optimization (TO) and reinforcement learning (RL) for motion planning and control of free-flying multi-arm robots in on-orbit servicing scenarios. The proposed system…

This paper introduces a new approach to enhance the robustness of humanoid walking under strong perturbations, such as substantial pushes. Effective recovery from external disturbances requires bipedal robots to dynamically adjust their…

Robotics · Computer Science 2024-11-05 Tobias Egle , Yashuai Yan , Dongheui Lee , Christian Ott

Loco-manipulation demands coordinated whole-body motion to manipulate objects effectively while maintaining locomotion stability, presenting significant challenges for both planning and control. In this work, we propose a whole-body model…

Robotics · Computer Science 2025-11-26 Lukas Molnar , Jin Cheng , Gabriele Fadini , Dongho Kang , Fatemeh Zargarbashi , Stelian Coros

This paper aims to develop a hierarchical nonlinear control algorithm, based on model predictive control (MPC), quadratic programming (QP), and virtual constraints, to generate and stabilize locomotion patterns in a real-time manner for…

Robotics · Computer Science 2020-04-16 Kaveh Akbari Hamed , Jeeseop Kim , Abhishek Pandala

How can a robot safely navigate around people with complex motion patterns? Deep Reinforcement Learning (DRL) in simulation holds some promise, but much prior work relies on simulators that fail to capture the nuances of real human motion.…

Robotics · Computer Science 2025-02-17 James R. Han , Hugues Thomas , Jian Zhang , Nicholas Rhinehart , Timothy D. Barfoot

Reinforcement Learning (RL) has recently impressed the world with stunning results in various applications. While the potential of RL is now well-established, many critical aspects still need to be tackled, including safety and stability…

Systems and Control · Electrical Eng. & Systems 2024-09-23 Mario Zanon , Sébastien Gros

Achieving stability and robustness is the primary goal of biped locomotion control. Recently, deep reinforce learning (DRL) has attracted great attention as a general methodology for constructing biped control policies and demonstrated…

Graphics · Computer Science 2020-07-31 Hwangpil Park , Ri Yu , Yoonsang Lee , Kyungho Lee , Jehee Lee

This study introduces a novel approach to autonomous motion planning, informing an analytical algorithm with a reinforcement learning (RL) agent within a Frenet coordinate system. The combination directly addresses the challenges of…

Robotics · Computer Science 2024-07-31 Rainer Trauth , Alexander Hobmeier , Johannes Betz

State-of-the-art approaches to footstep planning assume reduced-order dynamics when solving the combinatorial problem of selecting contact surfaces in real time. However, in exchange for computational efficiency, these approaches ignore…

The robustness of legged locomotion is crucial for quadrupedal robots in challenging terrains. Recently, Reinforcement Learning (RL) has shown promising results in legged locomotion and various methods try to integrate privileged…

Robotics · Computer Science 2023-09-04 Jiyuan Shi , Chenjia Bai , Haoran He , Lei Han , Dong Wang , Bin Zhao , Mingguo Zhao , Xiu Li , Xuelong Li

This study presents an enhanced theoretical formulation for bipedal hierarchical control frameworks under uneven terrain conditions. Specifically, owing to the inherent limitations of the Linear Inverted Pendulum Model (LIPM) in handling…

Robotics · Computer Science 2025-04-04 Yapeng Shi , Sishu Li , Yongqiang Wu , Junjie Liu , Xiaokun Leng , Xizhe Zang , Songhao Piao