English
Related papers

Related papers: Towards Active Flow Control Strategies Through Dee…

200 papers

The Karman Vortex Street has been investigated for over a century and offers a reference case for investigation of flow stability and control of high dimensionality, non-linear systems. Active flow control, while of considerable interest…

Fluid Dynamics · Physics 2018-09-03 Jean Rabault , Ulysse Reglade , Nicolas Cerardi , Miroslav Kuchta , Atle Jensen

Controlling instabilities in complex dynamical systems is challenging in scientific and engineering applications. Deep reinforcement learning (DRL) has seen promising results for applications in different scientific applications. The…

Machine Learning · Computer Science 2025-04-09 Luning Sun , Xin-Yang Liu , Siyan Zhao , Aditya Grover , Jian-Xun Wang , Jayaraman J. Thiagarajan

Aquatic organisms are known for their ability to generate efficient propulsion with low energy expenditure. While existing research has sought to leverage bio-inspired structures to reduce energy costs in underwater robotics, the crucial…

Robotics · Computer Science 2025-06-06 Xinyu Cui , Boai Sun , Yi Zhu , Ning Yang , Haifeng Zhang , Weicheng Cui , Dixia Fan , Jun Wang

Deep reinforcement learning (DRL) has shown significant promise for uncovering sophisticated control policies that interact in complex environments, such as stabilizing a tokamak fusion reactor or minimizing the drag force on an object in a…

Machine Learning · Computer Science 2025-08-26 Nicholas Zolman , Christian Lagemann , Urban Fasel , J. Nathan Kutz , Steven L. Brunton

Due to complexity and dynamics of construction work, resource, and cash flows, poor management of them usually leads to time and cost overruns, bankruptcy, even project failure. Existing approaches in construction failed to achieve optimal…

Artificial Intelligence · Computer Science 2023-08-17 Can Jiang , Xin Li , Jia-Rui Lin , Ming Liu , Zhiliang Ma

This paper presents a model-free deep reinforcement learning (DRL) approach for controlling a fiber drawing system. The custom DRL-based control system predictively regulates fiber diameter and produces a fiber with a desired, constant or…

Systems and Control · Electrical Eng. & Systems 2021-01-07 Sangwoon Kim , David Donghyun Kim , Brian Anthony

With the development of deep representation learning, the domain of reinforcement learning (RL) has become a powerful learning framework now capable of learning complex policies in high dimensional environments. This review summarises deep…

Machine Learning · Computer Science 2021-01-26 B Ravi Kiran , Ibrahim Sobh , Victor Talpaert , Patrick Mannion , Ahmad A. Al Sallab , Senthil Yogamani , Patrick Pérez

Transmission interface power flow adjustment is a critical measure to ensure the security and economy operation of power systems. However, conventional model-based adjustment schemes are limited by the increasing variations and…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Shunyu Liu , Wei Luo , Yanzhen Zhou , Kaixuan Chen , Quan Zhang , Huating Xu , Qinglai Guo , Mingli Song

Ramp metering that uses traffic signals to regulate vehicle flows from the on-ramps has been widely implemented to improve vehicle mobility of the freeway. Previous studies generally update signal timings in real-time based on predefined…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Bing Liu , Yu Tang , Yuxiong Ji , Yu Shen , Yuchuan Du

The high dimensionality and complex dynamics of turbulent flows remain an obstacle to the discovery and implementation of control strategies. Deep reinforcement learning (RL) is a promising avenue for overcoming these obstacles, but…

Fluid Dynamics · Physics 2023-01-31 Alec J. Linot , Kevin Zeng , Michael D. Graham

In this paper, we present our proposed approach for active tracking to increase the autonomy of Unmanned Aerial Vehicles (UAVs) using event cameras, low-energy imaging sensors that offer significant advantages in speed and dynamic range.…

Robotics · Computer Science 2024-10-22 Ala Souissi , Hajer Fradi , Panagiotis Papadakis

Deep Reinforcement Learning (DRL) is being used in many domains. One of the biggest advantages of DRL is that it enables the continuous improvement of a learning agent. Secondly, the DRL framework is robust and flexible enough to be…

Machine Learning · Computer Science 2022-05-05 Muhammad Usman Awais

The autonomous control of flippers plays an important role in enhancing the intelligent operation of tracked robots within complex environments. While existing methods mainly rely on hand-crafted control models, in this paper, we introduce…

Robotics · Computer Science 2023-06-21 Hainan Pan , Bailiang Chen , Kaihong Huang , Junkai Ren , Xieyuanli Chen , Huimin Lu

In robotics, contemporary strategies are learning-based, characterized by a complex black-box nature and a lack of interpretability, which may pose challenges in ensuring stability and safety. To address these issues, we propose integrating…

Robotics · Computer Science 2024-08-23 Mehdi Heydari Shahna , Seyed Adel Alizadeh Kolagar , Jouni Mattila

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

Effective traffic control methods have great potential in alleviating network congestion. Existing literature generally focuses on a single control approach, while few studies have explored the effectiveness of integrated and coordinated…

Machine Learning · Computer Science 2023-03-08 Zijian Hu , Wei Ma

This paper proposes a new control framework for manipulating soft objects. A Deep Reinforcement Learning (DRL) approach is used to make the shape of a deformable object reach a set of desired points by controlling a robotic arm which…

Docking control of an autonomous underwater vehicle (AUV) is a task that is integral to achieving persistent long term autonomy. This work explores the application of state-of-the-art model-free deep reinforcement learning (DRL) approaches…

Robotics · Computer Science 2021-08-06 Mihir Patil , Bilal Wehbe , Matias Valdenegro-Toro

We propose a novel framework for Deep Reinforcement Learning (DRL) in modular robotics using traditional robotic tools that extend state-of-the-art DRL implementations and provide an end-to-end approach which trains a robot directly from…

Robotics · Computer Science 2018-02-08 Risto Kojcev , Nora Etxezarreta , Alejandro Hernández , Víctor Mayoral

Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they…

Robotics · Computer Science 2019-11-14 Eivind Bøhn , Erlend M. Coates , Signe Moe , Tor Arne Johansen