English
Related papers

Related papers: Constrained Reinforcement Learning using Distribut…

200 papers

Robust adaptive model predictive control (RAMPC) is a novel control method that combines robustness guarantees with respect to unknown parameters and bounded disturbances into a model predictive control scheme. However, RAMPC has so far…

Systems and Control · Electrical Eng. & Systems 2021-08-27 Alexandre Didier , Anilkumar Parsi , Jeremy Coulson , Roy S. Smith

Quadrotors are increasingly used in the evolving field of aerial robotics for their agility and mechanical simplicity. However, inherent uncertainties, such as aerodynamic effects coupled with quadrotors' operation in dynamically changing…

Robotics · Computer Science 2024-05-24 Yuliang Gu , Sheng Cheng , Naira Hovakimyan

Precise control in modern robotic applications is always an open issue due to unknown time-varying disturbances. Existing meta-learning-based approaches require a shared representation of environmental structures, which lack flexibility for…

Robotics · Computer Science 2026-04-16 Zihan Yang , Jindou Jia , Meng Wang , Yuhang Liu , Kexin Guo , Xiang Yu

This paper proposes a model predictive trajectory tracking approach for quadrotors subject to input constraints. Our proposed approach relies on a hierarchical control strategy with an outer-loop feedback generating the required thrust and…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Qian Yang , Miaomiao Wang , Abdelhamid Tayebi

First-order reinforcement learning with differentiable simulation is promising for quadrotor control, but practical progress remains fragmented across task-specific settings. To support more systematic development and evaluation, we present…

Robotics · Computer Science 2026-03-24 Fanxing Li , Fangyu Sun , Tianbao Zhang , Shuyu Wu , Dexin Zuo , yufei Yan , Wenxian Yu , Danping Zou

In comparison to common quadrotors, the shape change of morphing quadrotors endows it with a more better flight performance but also results in more complex flight dynamics. Generally, it is extremely difficult or even impossible for…

Robotics · Computer Science 2024-08-26 Tao Yang , Huai-Ning Wu , Jun-Wei Wang

We study aleatoric and epistemic uncertainty estimation in a learned regressive system dynamics model. Disentangling aleatoric uncertainty (the inherent randomness of the system) from epistemic uncertainty (the lack of data) is crucial for…

Machine Learning · Computer Science 2025-03-21 Zhiyu An , Zhibo Hou , Wan Du

Trajectory prediction facilitates effective planning and decision-making, while constrained trajectory prediction integrates regulation into prediction. Recent advances in constrained trajectory prediction focus on structured constraints by…

Robotics · Computer Science 2025-03-19 Hao Ma , Zhiqiang Pu , Shijie Wang , Boyin Liu , Huimu Wang , Yanyan Liang , Jianqiang Yi

Aerial manipulation (AM) expands UAV capabilities beyond passive observation to contact-based operations at high altitudes and in otherwise inaccessible environments. Although recent advances show promise, most AM systems are developed in…

Robotics · Computer Science 2026-03-10 Yiming Zhang , Junyi Geng

Many multirotor Unmanned Aerial Systems applications have a critical need for precise position control in environments with strong dynamic external disturbances such as wind gusts or ground and wall effects. Moreover, to maximize flight…

Robotics · Computer Science 2019-08-09 Daniel Hentzen , Thomas Stastny , Roland Siegwart , Roland Brockers

Model Predictive Control (MPC) is widely recognized for its ability to explicitly handle system constraints. In practice, system states are often affected by disturbances with unknown distributions. While robust MPC guarantees constraint…

Systems and Control · Electrical Eng. & Systems 2026-03-11 Weijiang Zheng , Jiayi Huang , Bing Zhu

Learning representations that capture both intrinsic data geometry and target-relevant structure remains a fundamental challenge, particularly in settings where data reduction must balance compression with predictive fidelity. While…

Machine Learning · Computer Science 2026-05-28 Sai-Aakash Ramesh , Archit Sood , Andrew Corbett , Tim Dodwell

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard…

Optimization and Control · Mathematics 2024-03-26 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

This work presents a study on parallel and distributional deep reinforcement learning applied to the mapless navigation of UAVs. For this, we developed an approach based on the Soft Actor-Critic method, producing a distributed and…

Improving sampling efficiency and generalization capability is critical for the successful data-driven control of quadrotor unmanned aerial vehicles (UAVs) that are inherently unstable. While various reinforcement learning (RL) approaches…

Robotics · Computer Science 2025-03-03 Beomyeol Yu , Taeyoung Lee

The intrinsic high dimension of fluid dynamics is an inherent challenge to control of aerodynamic flows, and this is further complicated by a flow's nonlinear response to strong disturbances. Deep reinforcement learning, which takes…

Fluid Dynamics · Physics 2025-07-28 Zhecheng Liu , Diederik Beckers , Jeff D. Eldredge

A new disturbance observer based control scheme is developed for a quadrotor under the concurrent disturbances from a lightweight elastic tether cable and a lumped vertical disturbance. This elastic tether is unusual as it creates a…

Robotics · Computer Science 2025-07-15 Benjamin J. Marshall , Yunda Yan , James Knowles , Chenguang Yang , Cunjia Liu

Safely deploying robots in uncertain and dynamic environments requires a systematic accounting of various risks, both within and across layers in an autonomy stack from perception to motion planning and control. Many widely used motion…

Systems and Control · Electrical Eng. & Systems 2020-02-10 Venkatraman Renganathan , Iman Shames , Tyler H. Summers

In reinforcement learning (RL), it is often advantageous to consider additional constraints on the action space to ensure safety or action relevance. Existing work on such action-constrained RL faces challenges regarding effective policy…

Machine Learning · Computer Science 2025-12-01 Roland Stolz , Michael Eichelbeck , Matthias Althoff

Most reinforcement learning(RL)-based methods for drone racing target fixed, obstacle-free tracks, leaving the generalization to unknown, cluttered environments largely unaddressed. This challenge stems from the need to balance racing speed…

Robotics · Computer Science 2025-12-12 Feng Yu , Yu Hu , Yang Su , Yang Deng , Linzuo Zhang , Danping Zou