English
Related papers

Related papers: Deep Residual Reinforcement Learning based Autonom…

200 papers

A multi-agent deep reinforcement learning (DRL)-based model is presented in this study to reconstruct flow fields from noisy data. A combination of the reinforcement learning with pixel-wise rewards (PixelRL), physical constraints…

Fluid Dynamics · Physics 2023-09-28 Mustafa Z. Yousif , Meng Zhang , Yifan Yang , Haifeng Zhou , Linqi Yu , HeeChang Lim

Autonomous drone navigation in dynamic environments remains a critical challenge, especially when dealing with unpredictable scenarios including fast-moving objects with rapidly changing goal positions. While traditional planners and…

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

This study employs Deep Reinforcement Learning (DRL) for active flow control in a turbulent flow field of high Reynolds numbers at $Re=274000$. That is, an agent is trained to obtain a control strategy that can reduce the drag of a cylinder…

Fluid Dynamics · Physics 2024-12-23 Jingbo Chen , Enrico Ballini , Stefano Micheletti

The autonomous control of flippers plays an important role in enhancing the intelligent operation of tracked robots within complex environments. While existing methods mainly rely on hand-crafted control models, in this paper, we introduce…

Robotics · Computer Science 2023-06-21 Hainan Pan , Bailiang Chen , Kaihong Huang , Junkai Ren , Xieyuanli Chen , Huimin Lu

Deep reinforcement learning (DRL) for fluidic pinball, three individually rotating cylinders in the uniform flow arranged in an equilaterally triangular configuration, can learn the efficient flow control strategies due to the validity of…

Systems and Control · Electrical Eng. & Systems 2023-05-03 Haodong Feng , Yue Wang , Hui Xiang , Zhiyang Jin , Dixia Fan

Machine learning has recently become a promising technique in fluid mechanics, especially for active flow control (AFC) applications. A recent work [J. Fluid Mech. (2019), vol. 865, pp. 281-302] has demonstrated the feasibility and…

Fluid Dynamics · Physics 2021-03-22 Feng Ren , Jean Rabault , Hui Tang

This paper develops a Deep Reinforcement Learning (DRL)-agent for navigation and control of autonomous surface vessels (ASV) on inland waterways. Spatial restrictions due to waterway geometry and the resulting challenges, such as high flow…

Machine Learning · Computer Science 2023-04-04 Niklas Paulig , Ostap Okhrin

This paper investigates goal-directed tracking control of underactuated blimps with center-of-mass (CoM) reconfiguration. Unlike conventional overactuated blimp designs that rely on redundant actuation for simplified control, this paper…

Robotics · Computer Science 2026-05-05 Xiaorui Wang , Hongwu Wang , Yue Fan , Hao Cheng , Feitian Zhang

Variable speed limits (VSL) control is a flexible way to improve traffic condition,increase safety and reduce emission. There is an emerging trend of using reinforcement learning technique for VSL control and recent studies have shown…

Machine Learning · Computer Science 2018-10-26 Yuankai Wu , Huachun Tan , Bin Ran

In this paper, we study the use of robust model independent bounded extremum seeking (ES) feedback control to improve the robustness of deep reinforcement learning (DRL) controllers for a class of nonlinear time-varying systems. DRL has the…

Machine Learning · Computer Science 2026-03-11 Shaifalee Saxena , Alan Williams , Rafael Fierro , Alexander Scheinker

This study proposes a self-learning algorithm for closed-loop cylinder wake control targeting lower drag and lower lift fluctuations with the additional challenge of sparse sensor information, taking deep reinforcement learning as the…

Machine Learning · Computer Science 2024-06-04 Qiulei Wang , Lei Yan , Gang Hu , Wenli Chen , Jean Rabault , Bernd R. Noack

We present a deep reinforcement learning approach to a classical problem in fluid dynamics, i.e., the reduction of the drag of a bluff body. We cast the problem as a discrete-time control with continuous action space: at each time step, an…

Fluid Dynamics · Physics 2023-05-08 Enrico Ballini , Alberto Silvio Chiappa , Stefano Micheletti

Natural hazards such as hurricanes and floods damage power grid equipment, forcing operators to replan restoration repeatedly as new information becomes available. This paper develops a deep reinforcement learning (DRL) dispatcher that…

Systems and Control · Electrical Eng. & Systems 2026-01-16 Farshad Amani , Faezeh Ardali , Amin Kargarian

Turbulent-flow control aims to develop strategies that effectively manipulate fluid systems, such as the reduction of drag in transportation and enhancing energy efficiency, both critical steps towards reducing global CO$_2$ emissions. Deep…

Fluid Dynamics · Physics 2026-05-25 Miguel Beneitez , Andres Cremades , Luca Guastoni , Ricardo Vinuesa

In order for robots to perform mission-critical tasks, it is essential that they are able to quickly adapt to changes in their environment as well as to injuries and or other bodily changes. Deep reinforcement learning has been shown to be…

Robotics · Computer Science 2017-10-19 Ayaka Kume , Eiichi Matsumoto , Kuniyuki Takahashi , Wilson Ko , Jethro Tan

The use of robotics in controlled environments has flourished over the last several decades and training robots to perform tasks using control strategies developed from dynamical models of their hardware have proven very effective. However,…

Robotics · Computer Science 2019-07-16 Zach Dwiel , Madhavun Candadai , Mariano Phielipp

Particle robots are novel biologically-inspired robotic systems where locomotion can be achieved collectively and robustly, but not independently. While its control is currently limited to a hand-crafted policy for basic locomotion tasks,…

Robotics · Computer Science 2025-05-12 Jeremy Shen , Erdong Xiao , Yuchen Liu , Chen Feng

Deep reinforcement learning (DRL) shows promising potential for autonomous driving decision-making. However, DRL demands extensive computational resources to achieve a qualified policy in complex driving scenarios due to its low learning…

Robotics · Computer Science 2024-12-25 Hao Pang , Zhenpo Wang , Guoqiang Li

Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers is time consuming…

Systems and Control · Electrical Eng. & Systems 2019-11-15 Kai Liang Tan , Subhadipto Poddar , Anuj Sharma , Soumik Sarkar