English
Related papers

Related papers: Efficient Active Flow Control Strategy for Confine…

200 papers

We propose a novel benchmark environment for Safe Reinforcement Learning focusing on aquatic navigation. Aquatic navigation is an extremely challenging task due to the non-stationary environment and the uncertainties of the robotic…

Machine Learning · Computer Science 2021-12-21 Enrico Marchesini , Davide Corsi , Alessandro Farinelli

Conventional simulations on multi-exit indoor evacuation focus primarily on how to determine a reasonable exit based on numerous factors in a changing environment. Results commonly include some congested and other under-utilized exits,…

Machine Learning · Computer Science 2020-07-14 Dong Xu , Xiao Huang , Joseph Mango , Xiang Li , Zhenlong Li

Perimeter control maintains high traffic efficiency within protected regions by controlling transfer flows among regions to ensure that their traffic densities are below critical values. Existing approaches can be categorized as either…

Machine Learning · Computer Science 2023-06-01 Xiaocan Li , Ray Coden Mercurius , Ayal Taitler , Xiaoyu Wang , Mohammad Noaeen , Scott Sanner , Baher Abdulhai

This work investigates transfer learning strategies to accelerate deep reinforcement learning (DRL) for multifidelity control of chaotic fluid flows. Progressive neural networks (PNNs), a modular architecture designed to preserve and reuse…

Machine Learning · Computer Science 2025-10-21 Saeed Salehi

An emerging public health application of connected and automated vehicle (CAV) technologies is to reduce response times of emergency medical service (EMS) by indirectly coordinating traffic. Therefore, in this work we study the CAV-assisted…

Robotics · Computer Science 2023-12-19 Dajiang Suo , Vindula Jayawardana , Cathy Wu

We present a novel multiscale super-resolution framework (SRLBM) that applies deep learning directly to the mesoscopic density distribution functions of the lattice Boltzmann method for high-fidelity flow reconstruction. Two neural network…

Fluid Dynamics · Physics 2025-09-19 Gengchao Yang , Renyu Luo , Qinghe Yao , Peiji Wang , Jinxiu Zhang

We study the joint active/passive beamforming and channel blocklength (CBL) allocation in a non-ideal reconfigurable intelligent surface (RIS)-aided ultra-reliable and low-latency communication (URLLC) system. The considered scenario is a…

Information Theory · Computer Science 2024-10-28 Ramin Hashemi , Samad Ali , Nurul Huda Mahmood , Matti Latva-aho

Reinforcement learning has by now become well established in finding excellent flow control strategies for a variety of scenarios. Existing literature has focused on using a simple two-jet solution (and variants there-of) or a…

Fluid Dynamics · Physics 2026-04-30 Rohan Kaushik , Anna Schwarz , Andrea Beck

This study addresses the challenge of optimal power allocation in stochastic wireless networks by employing a Deep Reinforcement Learning (DRL) framework. Specifically, we design a Deep Q-Network (DQN) agent capable of learning adaptive…

Networking and Internet Architecture · Computer Science 2026-01-09 Marie Diane Iradukunda , Chabi F. Elégbédé , Yaé Ulrich Gaba

We investigate drag reduction mechanisms in flows past two- and three-dimensional cylinders controlled by surface actuators using deep reinforcement learning. We investigate 2D and 3D flows at Reynolds numbers up to 8,000 and 4,000,…

Fluid Dynamics · Physics 2023-09-06 Michail Chatzimanolakis , Pascal Weber , Petros Koumoutsakos

Instabilities arise in a number of flow configurations. One such manifestation is the development of interfacial waves in multiphase flows, such as those observed in the falling liquid film problem. Controlling the development of such…

Fluid Dynamics · Physics 2019-10-18 Vincent Belus , Jean Rabault , Jonathan Viquerat , Zhizhao Che , Elie Hachem , Ulysse Reglade

This paper focuses on energy savings in downlink operation of cell-free massive MIMO (CF mMIMO) networks under dynamic traffic conditions. We propose a multi-agent deep reinforcement learning (MADRL) algorithm that enables each access point…

Information Theory · Computer Science 2026-04-09 Qichen Wang , Keyu Li , Ozan Alp Topal , Özlem Tugfe Demir , Mustafa Ozger , Cicek Cavdar

Computational fluid dynamics (CFD) provides high-fidelity simulations of fluid flows but remains computationally expensive for many-query applications. In recent years deep learning (DL) has been used to construct data-driven fluid-dynamic…

Machine Learning · Computer Science 2026-04-13 David Ramos , Lucas Lacasa , Fermín Gutiérrez , Eusebio Valero , Gonzalo Rubio

Dams impact downstream river dynamics through flow regulation and disruption of upstream-downstream linkages. However, current dam operation is far from satisfactory due to the inability to respond the complicated and uncertain dynamics of…

This paper presents a Pre-Training Deep Reinforcement Learning(DRL) for avoidance navigation without map for mobile robots which map raw sensor data to control variable and navigate in an unknown environment. The efficient offline training…

Robotics · Computer Science 2023-08-04 Yang Wenkai Ji Ruihang Zhang Yuxiang Lei Hao , Zhao Zijie

For self-scheduling cascaded hydropower (S-CHP) facilities, medium-term planning is a critical step that coordinates water availability over the medium-term horizon, providing water usage guidance for their short-term operations in…

Systems and Control · Electrical Eng. & Systems 2025-01-10 Xianbang Chen , Yikui Liu , Neng Fan , Lei Wu

Cost-effective asset management is an area of interest across several industries. Specifically, this paper develops a deep reinforcement learning (DRL) solution to automatically determine an optimal rehabilitation policy for continuously…

Machine Learning · Computer Science 2023-04-19 Zaharah A. Bukhsh , Nils Jansen , Hajo Molegraaf

Symmetry is pervasive in robotics and has been widely exploited to improve sample efficiency in deep reinforcement learning (DRL). However, existing approaches primarily focus on spatial symmetries, such as reflection, rotation, and…

Robotics · Computer Science 2025-10-22 Yunpeng Jiang , Jianshu Hu , Paul Weng , Yutong Ban

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

Effectively controlling systems governed by Partial Differential Equations (PDEs) is crucial in several fields of Applied Sciences and Engineering. These systems usually yield significant challenges to conventional control schemes due to…

Machine Learning · Computer Science 2024-11-07 Florian Wolf , Nicolò Botteghi , Urban Fasel , Andrea Manzoni