English
Related papers

Related papers: A New Error Temporal Difference Algorithm for Deep…

200 papers

Industrial systems demand reliable predictive maintenance strategies to enhance operational efficiency and reduce downtime. This paper introduces an integrated framework that leverages the capabilities of the Transformer model-based neural…

Machine Learning · Computer Science 2024-08-06 Yang Zhao , Jiaxi Yang , Wenbo Wang , Helin Yang , Dusit Niyato

This paper introduces a Deep Reinforcement Learning (DRL) based TCP congestion-control algorithm that uses a Deep Q-Network (DQN) to adapt the congestion window (cWnd) dynamically based on observed network state. The proposed approach…

Networking and Internet Architecture · Computer Science 2026-01-21 Efe Ağlamazlar , Emirhan Eken , Harun Batur Geçici

Dispatching strategies for gas turbines (GTs) are changing in modern electricity grids. A growing incorporation of intermittent renewable energy requires GTs to operate more but shorter cycles and more frequently on partial loads. Deep…

Machine Learning · Computer Science 2023-08-30 Manuel Sage , Martin Staniszewski , Yaoyao Fiona Zhao

Taking advantage of their data-driven and model-free features, Deep Reinforcement Learning (DRL) algorithms have the potential to deal with the increasing level of uncertainty due to the introduction of renewable-based generation. To deal…

Systems and Control · Electrical Eng. & Systems 2022-08-02 Hou Shengren , Edgar Mauricio Salazar , Pedro P. Vergara , Peter Palensky

Deep reinforcement learning (DRL), acting as a novel and powerful paradigm for quantum optimal control, offers transformative opportunities for advancing neutral-atom quantum computing. In this work, we theoretically demonstrate a DRL-based…

Quantum Physics · Physics 2026-05-07 Yue Cai , Hanlin Zhang , Keye Zhang , Jing Qian

The charging scheduling problem of Electric Buses (EBs) is investigated based on Deep Reinforcement Learning (DRL). A Markov Decision Process (MDP) is conceived, where the time horizon includes multiple charging and operating periods in a…

Machine Learning · Computer Science 2025-05-16 Jiaju Qi , Lei Lei , Thorsteinn Jonsson , Lajos Hanzo

Temporal difference (TD) learning is a cornerstone reinforcement learning (RL) method for policy evaluation, where the goal is to estimate the value function of a Markov decision process under a fixed policy. While a substantial body of…

Machine Learning · Computer Science 2026-02-02 Donghwan Lee , Do Wan Kim

As a model-free optimization and decision-making method, deep reinforcement learning (DRL) has been widely applied to the filed of energy management in energy Internet. While, some DRL-based energy management schemes also incorporate the…

Systems and Control · Electrical Eng. & Systems 2021-10-07 Zhaoming Qin , Huaying Zhang , Yuzhou Zhao , Hong Xie , Junwei Cao

Control Co-Design (CCD) integrates physical and control system design to improve the performance of dynamic and autonomous systems. Despite advances in uncertainty-aware CCD methods, real-world uncertainties remain highly unpredictable.…

Machine Learning · Computer Science 2025-10-14 Ying-Kuan Tsai , Vispi Karkaria , Yi-Ping Chen , Wei Chen

Distributional reinforcement learning (DRL) has achieved empirical success in various domains. One core task in DRL is distributional policy evaluation, which involves estimating the return distribution $\eta^\pi$ for a given policy $\pi$.…

Machine Learning · Statistics 2025-01-17 Yang Peng , Liangyu Zhang , Zhihua Zhang

To coordinate the interests of operator and users in a microgrid under complex and changeable operating conditions, this paper proposes a microgrid scheduling model considering the thermal flexibility of thermostatically controlled loads…

Systems and Control · Electrical Eng. & Systems 2024-12-25 Yang Li , Jiankai Gao , Yuanzheng Li , Chen Chen , Sen Li , Mohammad Shahidehpour , Zhe Chen

This letter presents a novel deep reinforcement learning (DRL) approach for joint time allocation and power control in a cognitive Internet of Things (CIoT) system with simultaneous wireless information and power transfer (SWIPT). The CIoT…

Signal Processing · Electrical Eng. & Systems 2025-12-18 Nadia Abdolkhani , Nada Abdel Khalek , Walaa Hamouda , Iyad Dayoub

Balancing mutually diverging performance metrics, such as, processing latency, outcome accuracy, and end device energy consumption is a challenging undertaking for deep learning model inference in ad-hoc edge environments. In this paper, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Motahare Mounesan , Xiaojie Zhang , Saptarshi Debroy

Recent years witnessed a remarkable increase in the availability of data and computing resources in communication networks. This contributed to the rise of data-driven over model-driven algorithms for network automation. This paper…

Networking and Internet Architecture · Computer Science 2023-01-30 Marco Skocaj , Lorenzo Mario Amorosa , Giorgio Ghinamo , Giuliano Muratore , Davide Micheli , Flavio Zabini , Roberto Verdone

Deep reinforcement learning (DRL) holds significant promise for managing voltage control challenges in simulated power grid environments. However, its real-world application in power system operations remains underexplored. This study…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Di Shi , Qiang Zhang , Mingguo Hong , Fengyu Wang , Slava Maslennikov , Xiaochuan Luo , Yize Chen

Temporal difference (TD) methods constitute a class of methods for learning predictions in multi-step prediction problems, parameterized by a recency factor lambda. Currently the most important application of these methods is to temporal…

Artificial Intelligence · Computer Science 2008-02-03 P. Cichosz

Dynamic distribution network reconfiguration (DNR) algorithms perform hourly status changes of remotely controllable switches to improve distribution system performance. The problem is typically solved by physical model-based control…

Systems and Control · Electrical Eng. & Systems 2020-06-24 Yuanqi Gao , Wei Wang , Jie Shi , Nanpeng Yu

Emergency control, typically such as under-voltage load shedding (UVLS), is broadly used to grapple with low voltage and voltage instability issues in practical power systems under contingencies. However, existing emergency control schemes…

Systems and Control · Electrical Eng. & Systems 2021-02-26 Ying Zhang , Meng Yue , Jianhui Wang

The goal of this manuscript is to conduct a controltheoretic analysis of Temporal Difference (TD) learning algorithms. TD-learning serves as a cornerstone in the realm of reinforcement learning, offering a methodology for approximating the…

Artificial Intelligence · Computer Science 2023-09-12 Donghwan Lee , Do Wan Kim

This paper addresses the problem of designing control policies for agents with unknown stochastic dynamics and control objectives specified using Linear Temporal Logic (LTL). Recent Deep Reinforcement Learning (DRL) algorithms have aimed to…

Robotics · Computer Science 2025-04-23 Jun Wang , Hosein Hasanbeig , Kaiyuan Tan , Zihe Sun , Yiannis Kantaros