English
Related papers

Related papers: Adaptive Outer-Loop Control of Quadrotors via Rein…

200 papers

Landing a quadrotor on an inclined surface is a challenging maneuver. The final state of any inclined landing trajectory is not an equilibrium, which precludes the use of most conventional control methods. We propose a deep reinforcement…

Robotics · Computer Science 2022-07-29 Jacob E. Kooi , Robert Babuška

Learning-based methods, particularly Reinforcement Learning (RL), hold great promise for streamlining deployment, enhancing performance, and achieving generalization in the control of autonomous multirotor aerial vehicles. Deep RL has been…

Robotics · Computer Science 2024-04-10 Jonas Eschmann , Dario Albani , Giuseppe Loianno

Learning-based controllers have achieved impressive performance in agile quadrotor flight but typically rely on massive training in simulation, necessitating accurate system identification for effective Sim2Real transfer. However, even with…

Robotics · Computer Science 2026-02-11 Yunfan Ren , Zhiyuan Zhu , Jiaxu Xing , Davide Scaramuzza

In this chapter, the regulation of Unmanned Aerial Vehicle (UAV) communication network is investigated in the presence of dynamic changes in the UAV lineup and user distribution. We target an optimal UAV control policy which is capable of…

Systems and Control · Electrical Eng. & Systems 2021-08-26 Ran Zhang , Duc Minh , Nguyen , Miao Wang , Lin X. Cai , Xuemin , Shen

Quadrotors have demonstrated remarkable versatility, yet their full aerobatic potential remains largely untapped due to inherent underactuation and the complexity of aggressive maneuvers. Traditional approaches, separating trajectory…

Robotics · Computer Science 2025-06-02 Zhichao Han , Xijie Huang , Zhuxiu Xu , Jiarui Zhang , Yuze Wu , Mingyang Wang , Tianyue Wu , Fei Gao

The real power of artificial intelligence appears in reinforcement learning, which is computationally and physically more sophisticated due to its dynamic nature. Rotation and injection are some of the proven ways in active flow control for…

Fluid Dynamics · Physics 2024-01-02 Kamyar Dobakhti , Jafar Ghazanfarian

The suspension system is a crucial part of the automotive chassis, improving vehicle ride comfort and isolating passengers from rough road excitation. Unlike passive suspension, which has constant spring and damping coefficients, active…

Robotics · Computer Science 2024-08-19 Anh N. Nhu , Ngoc-Anh Le , Shihang Li , Thang D. V. Truong

This paper focuses on the active flow control of a computational fluid dynamics simulation over a range of Reynolds numbers using deep reinforcement learning (DRL). More precisely, the proximal policy optimization (PPO) method is used to…

Fluid Dynamics · Physics 2020-06-24 Hongwei Tang , Jean Rabault , Alexander Kuhnle , Yan Wang , Tongguang Wang

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

Navigation precision, speed and stability are crucial for safe Unmanned Aerial Vehicle (UAV) flight maneuvers and effective flight mission executions in dynamic environments. Different flight missions may have varying objectives, such as…

Robotics · Computer Science 2025-01-22 Junyang Zhang , Cristian Emanuel Ocampo Rivera , Kyle Tyni , Steven Nguyen

Agile flights of autonomous quadrotors in cluttered environments require constrained motion planning and control subject to translational and rotational dynamics. Traditional model-based methods typically demand complicated design and heavy…

Robotics · Computer Science 2022-09-23 Yixiao Wang , Bingheng Wang , Shenning Zhang , Han Wei Sia , Lin Zhao

Creating safe paths in unknown and uncertain environments is a challenging aspect of leader-follower formation control. In this architecture, the leader moves toward the target by taking optimal actions, and followers should also avoid…

Robotics · Computer Science 2024-02-28 Behnaz Hadi , Alireza Khosravi , Pouria Sarhadi

Learning-based adaptive control methods hold the premise of enabling autonomous agents to reduce the effect of process variations with minimal human intervention. However, its application to autonomous underwater vehicles (AUVs) has so far…

Designing effective low-level robot controllers often entail platform-specific implementations that require manual heuristic parameter tuning, significant system knowledge, or long design times. With the rising number of robotic and…

This paper presents a deep reinforcement learning (DRL) framework for active flow control (AFC) to reduce drag in aerodynamic bodies. Tested on a 3D cylinder at Re = 100, the DRL approach achieved a 9.32% drag reduction and a 78.4% decrease…

Machine Learning · Computer Science 2024-11-11 Ricard Montalà , Bernat Font , Pol Suárez , Jean Rabault , Oriol Lehmkuhl , Ivette Rodriguez

Mastering autonomous drone landing on dynamic platforms presents formidable challenges due to unpredictable velocities and external disturbances caused by the wind, ground effect, turbines or propellers of the docking platform. This study…

Robotics · Computer Science 2024-03-13 Robinroy Peter , Lavanya Ratnabala , Demetros Aschu , Aleksey Fedoseev , Dzmitry Tsetserukou

Deep reinforcement learning (DRL) has emerged as a powerful paradigm for solving complex decision-making problems. However, DRL-based systems still face significant dependability challenges particularly in real-time environments due to the…

Software Engineering · Computer Science 2026-03-25 Guoxin Su , Thomas Robinson , Hoa Khanh Dam , Li Liu , David S. Rosenblum

The objective of the project is to explore synergies between classical control algorithms such as PID and contemporary reinforcement learning algorithms to come up with a pragmatic control mechanism to control the CrazyFlie 2.X quadrotor.…

Robotics · Computer Science 2023-06-16 Arshad Javeed , Valentín López Jiménez

This paper proposes a novel Reinforcement Learning (RL) approach for sim-to-real policy transfer of Vertical Take-Off and Landing Unmanned Aerial Vehicle (VTOL-UAV). The proposed approach is designed for VTOL-UAV landing on offshore docking…

Robotics · Computer Science 2024-08-01 Ali M. Ali , Aryaman Gupta , Hashim A. Hashim

Learning control policies in simulation enables rapid, safe, and cost-effective development of advanced robotic capabilities. However, transferring these policies to the real world remains difficult due to the sim-to-real gap, where…

Robotics · Computer Science 2026-01-16 Jiahe Pan , Jiaxu Xing , Rudolf Reiter , Yifan Zhai , Elie Aljalbout , Davide Scaramuzza