English
Related papers

Related papers: GustPilot: A Hierarchical DRL-INDI Framework for W…

200 papers

Real-world quadruped navigation is constrained by a scale mismatch between high-level navigation decisions and low-level gait execution, as well as by instabilities under out-of-distribution environmental changes. Such variations challenge…

Robotics · Computer Science 2026-03-09 Sijia Li , Haoyu Wang , Shenghai Yuan , Yizhuo Yang , Thien-Minh Nguyen

The real power of artificial intelligence appears in reinforcement learning, which is computationally and physically more sophisticated due to its dynamic nature. Rotation and injection are some of the proven ways in active flow control for…

Fluid Dynamics · Physics 2024-01-02 Kamyar Dobakhti , Jafar Ghazanfarian

This paper presents a new deep reinforcement learning (DRL)-based approach to the trajectory planning and jamming rejection of an unmanned aerial vehicle (UAV) for the Internet-of-Things (IoT) applications. Jamming can prevent timely…

Signal Processing · Electrical Eng. & Systems 2023-02-13 Shuyan Hu , Xin Yuan , Wei Ni , Xin Wang , Abbas Jamalipour

Drifting, characterized by controlled vehicle motion at high sideslip angles, is crucial for safely handling emergency scenarios at the friction limits. While recent reinforcement learning approaches show promise for drifting control, they…

Robotics · Computer Science 2025-08-04 Yihan Zhou , Yiwen Lu , Bo Yang , Jiayun Li , Yilin Mo

This paper proposes a reinforcement learning (RL) framework for controlling and stabilizing the Twin Rotor Aerodynamic System (TRAS) at specific pitch and azimuth angles and tracking a given trajectory. The complex dynamics and non-linear…

Robotics · Computer Science 2025-12-16 Zeyad Gamal , Youssef Mahran , Ayman El-Badawy

Learning human-like, robust bipedal walking remains difficult due to hybrid dynamics and terrain variability. We propose a lightweight framework that combines a gait generator network learned from human motion with Proximal Policy…

Robotics · Computer Science 2025-11-24 Yusuf Baran Ates , Omer Morgul

We tackle the problem of minimum-time flight for a quadrotor through a sequence of waypoints in the presence of obstacles while exploiting the full quadrotor dynamics. Early works relied on simplified dynamics or polynomial trajectory…

Robotics · Computer Science 2022-06-22 Robert Penicka , Yunlong Song , Elia Kaufmann , Davide Scaramuzza

The wall cycle in wall-bounded turbulent flows is a complex turbulence regeneration mechanism that remains not fully understood. This study explores the potential of deep reinforcement learning (DRL) for managing the wall regeneration cycle…

Fluid Dynamics · Physics 2024-10-21 Giorgio Maria Cavallazzi , Luca Guastoni , Ricardo Vinuesa , Alfredo Pinelli

This paper presents a novel reinforcement learning framework for trajectory tracking of unmanned aerial vehicles in cluttered environments using a dual-agent architecture. Traditional optimization methods for trajectory tracking face…

Robotics · Computer Science 2024-11-01 Shaswat Garg , Houman Masnavi , Baris Fidan , Farrokh Janabi-Sharifi

Bounding is one of the important gaits in quadrupedal locomotion for negotiating obstacles. The authors proposed an effective approach that can learn robust bounding gaits more efficiently despite its large variation in dynamic body…

Robotics · Computer Science 2023-10-31 Zhicheng Wang , Anqiao Li , Yixiao Zheng , Anhuan Xie , Zhibin Li , Jun Wu , Qiuguo Zhu

We propose a command-filter backstepping controller that integrates a disturbance observer and a high-gain observer (HGO) to handle unknown internal and external disturbances acting on a quadrotor. To build the controller, we first define…

Systems and Control · Electrical Eng. & Systems 2025-10-31 Mustafa Mohammed Mustafa

The low-altitude Internet of Things (IoT), supported by unmanned aerial vehicles (UAVs), provides ground sensing networks with advanced real-time monitoring and data collection. To maximize data collection volume from distributed IoT nodes,…

Computational Engineering, Finance, and Science · Computer Science 2026-05-25 Zhenjia Xu , Xiaoling Zhang , Nan Qi , Guangxu Zhu , Xiaojie Li , Luliang Jia

Embedding the intrinsic symmetry of a flow system in training its machine learning algorithms has become a significant trend in the recent surge of their application in fluid mechanics. This paper leverages the geometric symmetry of a…

Fluid Dynamics · Physics 2025-06-04 Xuan Dai , Da Xu , Mengqi Zhang , Yantao Yang

The rapid growth of the low-altitude economy has driven the widespread adoption of unmanned aerial vehicles (UAVs). This growing deployment presents new challenges for UAV trajectory planning in complex urban environments. However, existing…

Artificial Intelligence · Computer Science 2025-11-27 Yanwei Gong , Junchao Fan , Ruichen Zhang , Dusit Niyato , Yingying Yao , Xiaolin Chang

In this paper, we present a novel guidance scheme based on model-based deep reinforcement learning (RL) technique. With model-based deep RL method, a deep neural network is trained as a predictive model of guidance dynamics which is…

Robotics · Computer Science 2019-04-16 Chen Liang , Weihong Wang , Zhenghua Liu , Chao Lai , Benchun Zhou

A major challenge in autonomous flights is unknown disturbances, which can jeopardize safety and lead to collisions, especially in obstacle-rich environments. This paper presents a disturbance-aware motion planning and control framework…

The suspension system is a crucial part of the automotive chassis, improving vehicle ride comfort and isolating passengers from rough road excitation. Unlike passive suspension, which has constant spring and damping coefficients, active…

Robotics · Computer Science 2024-08-19 Anh N. Nhu , Ngoc-Anh Le , Shihang Li , Thang D. V. Truong

The paper presents a technique using reinforcement learning (RL) to adapt the control gains of a quadcopter controller. Specifically, we employed Proximal Policy Optimization (PPO) to train a policy which adapts the gains of a cascaded…

Systems and Control · Electrical Eng. & Systems 2024-03-13 Mike Timmerman , Aryan Patel , Tim Reinhart

Fluid antenna systems (FAS) enable dynamic antenna positioning, offering new opportunities to enhance integrated sensing and communication (ISAC) performance. However, existing studies primarily focus on communication enhancement or…

Signal Processing · Electrical Eng. & Systems 2025-01-03 Shunxing Yang , Junteng Yao , Jie Tang , Tuo Wu , Maged Elkashlan , Chau Yuen , Merouane Debbah , Hyundong Shin , Matthew Valenti

Reconfigurable intelligent surfaces (RISs) mounted on unmanned aerial vehicles (UAVs) can reshape wireless propagation on-demand. However, their performance is sensitive to UAV jitter and cascaded channel uncertainty. This paper…

Information Theory · Computer Science 2026-01-01 Anas K. Saeed , Mahmoud M. Salim , Ali Arshad Nasir , Ali H. Muqaibel