English
Related papers

Related papers: Improving turbulence control through explainable d…

200 papers

As the quantity and complexity of information processed by software systems increase, large-scale software systems have an increasing requirement for high-performance distributed computing systems. With the acceleration of the Internet in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-22 Guangyao Zhou , Wenhong Tian , Rajkumar Buyya , Ruini Xue , Liang Song

Dynamic hedging is the practice of periodically transacting financial instruments to offset the risk caused by an investment or a liability. Dynamic hedging optimization can be framed as a sequential decision problem; thus, Reinforcement…

Computational Finance · Quantitative Finance 2024-02-26 Andrei Neagu , Frédéric Godin , Clarence Simard , Leila Kosseim

Aquatic organisms are known for their ability to generate efficient propulsion with low energy expenditure. While existing research has sought to leverage bio-inspired structures to reduce energy costs in underwater robotics, the crucial…

Robotics · Computer Science 2025-06-06 Xinyu Cui , Boai Sun , Yi Zhu , Ning Yang , Haifeng Zhang , Weicheng Cui , Dixia Fan , Jun Wang

The control of complex systems is of critical importance in many branches of science, engineering, and industry. Controlling an unsteady fluid flow is particularly important, as flow control is a key enabler for technologies in energy…

Machine Learning · Computer Science 2020-12-18 Katharina Bieker , Sebastian Peitz , Steven L. Brunton , J. Nathan Kutz , Michael Dellnitz

This article presents a motion planning and control framework for flexible robotic manipulators, integrating deep reinforcement learning (DRL) with a nonlinear partial differential equation (PDE) controller. Unlike conventional approaches…

Robotics · Computer Science 2025-06-11 Amir Hossein Barjini , Seyed Adel Alizadeh Kolagar , Sadeq Yaqubi , Jouni Mattila

Effective traffic control methods have great potential in alleviating network congestion. Existing literature generally focuses on a single control approach, while few studies have explored the effectiveness of integrated and coordinated…

Machine Learning · Computer Science 2023-03-08 Zijian Hu , Wei Ma

An efficient urban bus control system has the potential to significantly reduce travel delays and streamline the allocation of transportation resources, thereby offering enhanced and user-friendly transit services to passengers. However,…

Systems and Control · Electrical Eng. & Systems 2023-08-17 Qinghui Nie , Jishun Ou , Haiyang Zhang , Jiawei Lu , Shen Li , Haotian Shi

Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers is time consuming…

Systems and Control · Electrical Eng. & Systems 2019-11-15 Kai Liang Tan , Subhadipto Poddar , Anuj Sharma , Soumik Sarkar

Traffic congestion is a serious problem in urban areas. Dynamic congestion pricing is one of the useful schemes to eliminate traffic congestion in strategic scale. However, in the reality, an optimal dynamic congestion pricing is very…

Systems and Control · Electrical Eng. & Systems 2022-06-27 Kimihiro Sato , Toru Seo , Takashi Fuse

Data processing and analytics are fundamental and pervasive. Algorithms play a vital role in data processing and analytics where many algorithm designs have incorporated heuristics and general rules from human knowledge and experience to…

Machine Learning · Computer Science 2022-02-07 Qingpeng Cai , Can Cui , Yiyuan Xiong , Wei Wang , Zhongle Xie , Meihui Zhang

To improve the system performance towards the Shannon limit, advanced radio resource management mechanisms play a fundamental role. In particular, scheduling should receive much attention, because it allocates radio resources among…

Machine Learning · Computer Science 2021-03-23 Jian Wang , Chen Xu , Rong Li , Yiqun Ge , Jun Wang

Deep reinforcement learning (DRL) has proven extremely useful in a large variety of application domains. However, even successful DRL-based software can exhibit highly undesirable behavior. This is due to DRL training being based on…

Machine Learning · Computer Science 2023-09-12 Ophir M. Carmel , Guy Katz

This study addresses the challenge of resource scheduling optimization in edge-cloud collaborative computing using deep reinforcement learning (DRL). The proposed DRL-based approach improves task processing efficiency, reduces overall…

Machine Learning · Computer Science 2025-04-30 Yuqing Wang , Xiao Yang

Data-driven flow control has significant potential for industry, energy systems, and climate science. In this work, we study the effectiveness of Reinforcement Learning (RL) for reducing convective heat transfer in the 2D Rayleigh-B\'enard…

Fluid Dynamics · Physics 2025-09-01 Thorben Markmann , Michiel Straat , Sebastian Peitz , Barbara Hammer

Since deep neural networks' resurgence, reinforcement learning has gradually strengthened and surpassed humans in many conventional games. However, it is not easy to copy these accomplishments to autonomous driving because state spaces are…

Robotics · Computer Science 2023-02-14 B. Udugama

Autonomous navigation in unknown complex environment is still a hard problem, especially for small Unmanned Aerial Vehicles (UAVs) with limited computation resources. In this paper, a neural network-based reactive controller is proposed for…

Robotics · Computer Science 2021-02-03 Lei He , Aouf Nabil , Bifeng Song

The popularity of deep reinforcement learning (DRL) methods in economics have been exponentially increased. DRL through a wide range of capabilities from reinforcement learning (RL) and deep learning (DL) for handling sophisticated dynamic…

Statistical Finance · Quantitative Finance 2020-04-06 Amir Mosavi , Pedram Ghamisi , Yaser Faghan , Puhong Duan

The complexity of emerging sixth-generation (6G) wireless networks has sparked an upsurge in adopting artificial intelligence (AI) to underpin the challenges in network management and resource allocation under strict service level…

Networking and Internet Architecture · Computer Science 2023-03-28 Farhad Rezazadeh , Hatim Chergui , Josep Mangues-Bafalluy

Power system emergency control is generally regarded as the last safety net for grid security and resiliency. Existing emergency control schemes are usually designed off-line based on either the conceived "worst" case scenario or a few…

Machine Learning · Computer Science 2019-04-23 Qiuhua Huang , Renke Huang , Weituo Hao , Jie Tan , Rui Fan , Zhenyu Huang

This work investigates transfer learning strategies to accelerate deep reinforcement learning (DRL) for multifidelity control of chaotic fluid flows. Progressive neural networks (PNNs), a modular architecture designed to preserve and reuse…

Machine Learning · Computer Science 2025-10-21 Saeed Salehi