English
Related papers

Related papers: Double Deep Q-learning Based Real-Time Optimizatio…

200 papers

This paper introduces a deep reinforcement learning (RL) framework for optimizing the operations of power plants pairing renewable energy with storage. The objective is to maximize revenue from energy markets while minimizing storage…

Machine Learning · Computer Science 2023-06-16 Lucien Werner , Peeyush Kumar

The Integrated Process Planning and Scheduling (IPPS) problem combines process route planning and shop scheduling to achieve high efficiency in manufacturing and maximize resource utilization, which is crucial for modern manufacturing…

Optimization and Control · Mathematics 2024-09-04 Hongpei Li , Han Zhang , Ziyan He , Yunkai Jia , Bo Jiang , Xiang Huang , Dongdong Ge

Deep reinforcement learning (DRL) has demonstrated impressive performance in various gaming simulators and real-world applications. In practice, however, a DRL agent may receive faulty observation by abrupt interferences such as black-out,…

Machine Learning · Computer Science 2022-01-26 Chao-Han Huck Yang , I-Te Danny Hung , Yi Ouyang , Pin-Yu Chen

We consider the problem of minimizing the difference in the demand and the supply of power using microgrids. We setup multiple microgrids, that provide electricity to a village. They have access to the batteries that can store renewable…

Systems and Control · Computer Science 2017-08-29 Raghuram Bharadwaj Diddigi , D. Sai Koti Reddy , Shalabh Bhatnagar

Task scheduling is a critical problem when one user offloads multiple different tasks to the edge server. When a user has multiple tasks to offload and only one task can be transmitted to server at a time, while server processes tasks…

Machine Learning · Computer Science 2022-08-05 Xiucheng Wang , Longfei Ma , Haocheng Li , Zhisheng Yin , Tom. Luan , Nan Cheng

High-level penetration of intermittent renewable energy sources (RESs) has introduced significant uncertainties into modern power systems. In order to rapidly and economically respond to the fluctuations of power system operating state,…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Pengfei Wu , Chen Chen , Dexiang Lai , Jian Zhong

Several real-world scenarios, such as remote control and sensing, are comprised of action and observation delays. The presence of delays degrades the performance of reinforcement learning (RL) algorithms, often to such an extent that…

Machine Learning · Computer Science 2021-08-18 Somjit Nath , Mayank Baranwal , Harshad Khadilkar

Path planning is an important problem with the the applications in many aspects, such as video games, robotics etc. This paper proposes a novel method to address the problem of Deep Reinforcement Learning (DRL) based path planning for a…

Robotics · Computer Science 2024-04-11 Hao Liu , Yi Shen , Shuangjiang Yu , Zijun Gao , Tong Wu

The exponential growth of digital services has positioned data centers among the most energy-intensive infrastructures in the modern economy, raising critical concerns regarding operational costs, carbon emissions, and the sustainable…

Machine Learning · Computer Science 2026-05-05 Abderaouf Bahi , Amel Ourici , Hasan Dincer , Serhat Yuksel , Akila Djebbar

Energy management systems (EMS) are becoming increasingly important in order to utilize the continuously growing curtailed renewable energy. Promising energy storage systems (ESS), such as batteries and green hydrogen should be employed to…

Machine Learning · Computer Science 2022-12-13 Dongju Kang , Doeun Kang , Sumin Hwangbo , Haider Niaz , Won Bo Lee , J. Jay Liu , Jonggeol Na

In this paper, we investigate a novel digital network twin (DNT) assisted deep learning (DL) model training framework. In particular, we consider a physical network where a base station (BS) uses several antennas to serve multiple mobile…

Networking and Internet Architecture · Computer Science 2026-03-11 Hanzhi Yu , Hasan Farooq , Julien Forgeat , Shruti Bothe , Kristijonas Cyras , Md Moin Uddin Chowdhury , Mingzhe Chen

Deep Reinforcement Learning (DRL) is widely used to optimize the performance of multi-UAV networks. However, the training of DRL relies on the frequent interactions between the UAVs and the environment, which consumes lots of energy due to…

Machine Learning · Computer Science 2023-10-26 Xiucheng Wang , Nan Cheng , Longfei Ma , Zhisheng Yin , Tom. Luan , Ning Lu

Deep reinforcement learning (DRL) has recently shown its success in tackling complex combinatorial optimization problems. When these problems are extended to multiobjective ones, it becomes difficult for the existing DRL approaches to…

Artificial Intelligence · Computer Science 2022-02-15 Zizhen Zhang , Zhiyuan Wu , Hang Zhang , Jiahai Wang

Microgrids with energy storage systems and distributed renewable energy sources play a crucial role in reducing the consumption from traditional power sources and the emission of $CO_2$. Connecting multi microgrid to a distribution power…

Neural and Evolutionary Computing · Computer Science 2021-03-12 Jiangjiao Xu , Ke Li , Mohammad Abusara

The online optimization of gasoline blending benefits refinery economies. However, the nonlinear blending mechanism, the oil property fluctuations, and the blending model mismatch bring difficulties to the optimization. To solve the above…

Computational Engineering, Finance, and Science · Computer Science 2023-09-07 Muyi Huang , Renchu He , Xin Dai , Xin Peng , Wenli Du , Feng Qian

Intelligent omni-surface (IOS) is a promising technique to enhance the capacity of wireless networks, by reflecting and refracting the incident signal simultaneously. Traditional IOS configuration schemes, relying on all sub-channels'…

Networking and Internet Architecture · Computer Science 2024-12-30 Xiaowen Ye , Xianghao Yu , Liqun Fu

The lifelong control problem of an off-grid microgrid is composed of two tasks, namely estimation of the condition of the microgrid devices and operational planning accounting for the uncertainties by forecasting the future consumption and…

Systems and Control · Electrical Eng. & Systems 2020-05-19 Simone Totaro , Ioannis Boukas , Anders Jonsson , Bertrand Cornélusse

Spectrum sharing among users is a fundamental problem in the management of any wireless network. In this paper, we discuss the problem of distributed spectrum collaboration without central management under general unknown channels. Since…

Signal Processing · Electrical Eng. & Systems 2021-04-07 Pranav M. Pawar , Amir Leshem

Ensuring strict safety guarantees is the paramount challenge for emerging 5G/6G wireless systems, particularly as they increasingly govern mission-critical applications ranging from autonomous UAV swarms to industrial automation. While deep…

Signal Processing · Electrical Eng. & Systems 2026-04-21 Haoran Peng , Tong Wu , Hang Liu , Weijia Zheng , Ying-Jun Angela Zhang , Anna Scaglione

Multi-user delay constrained scheduling is important in many real-world applications including wireless communication, live streaming, and cloud computing. Yet, it poses a critical challenge since the scheduler needs to make real-time…

Machine Learning · Computer Science 2022-08-31 Pihe Hu , Ling Pan , Yu Chen , Zhixuan Fang , Longbo Huang