English
Related papers

Related papers: Attentive Convolutional Deep Reinforcement Learnin…

200 papers

Autonomous parking is a key technology in modern autonomous driving systems, requiring high precision, strong adaptability, and efficiency in complex environments. This paper proposes a Deep Reinforcement Learning (DRL) framework based on…

Robotics · Computer Science 2025-05-01 Zheyu Zhang , Yutong Luo , Yongzhou Chen , Haopeng Zhao , Zhichao Ma , Hao Liu

In this letter, we address the problem of controlling energy storage systems (ESSs) for arbitrage in real-time electricity markets under price uncertainty. We first formulate this problem as a Markov decision process, and then develop a…

Machine Learning · Computer Science 2019-05-07 Hanchen Xu , Xiao Li , Xiangyu Zhang , Junbo Zhang

Advances in wireless technology have significantly increased the number of wireless connections, leading to higher energy consumption in networks. Among these, base stations (BSs) in radio access networks (RANs) account for over half of the…

Signal Processing · Electrical Eng. & Systems 2024-12-30 Shuo Sun , Chong Huang , Gaojie Chen , Pei Xiao , Rahim Tafazolli

The intelligent reflection surface (IRS) and unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC) system is widely used in temporary and emergency scenarios. Our goal is to minimize the energy consumption of the MEC system by…

Machine Learning · Computer Science 2024-08-05 Li Dong , Feibo Jiang , Minjie Wang , Yubo Peng , Xiaolong Li

Grid-scale battery energy storage systems (BESSs) can provide flexibility to the power system and capture shortterm price volatility by shifting energy in time through controlled charging and discharging. The highly volatile European…

Computational Engineering, Finance, and Science · Computer Science 2025-06-10 Timothée Hornek , Youngsub Lee , Sergio Potenciano Menci , Ivan Pavić

Millions of sensors, cameras, meters, and other edge devices are deployed in networks to collect and analyse data. In many cases, such devices are powered only by Energy Harvesting(EH) and have limited energy available to analyse acquired…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ryoichi Shinkuma , George Iosifidis , Ivana Dusparic

It is estimated that about 40%-50% of total electricity consumption in commercial buildings can be attributed to Heating, Ventilation, and Air Conditioning (HVAC) systems. Minimizing the energy cost while considering the thermal comfort of…

Machine Learning · Computer Science 2021-10-27 Vinay Hanumaiah , Sahika Genc

Deep reinforcement learning (DRL) is a well-suited approach to financial decision-making, where an agent makes decisions based on its trading strategy developed from market observations. Existing DRL intraday trading strategies mainly use…

Trading and Market Microstructure · Quantitative Finance 2024-06-13 Sven Goluža , Tomislav Kovačević , Tessa Bauman , Zvonko Kostanjčar

Reinforcement learning (RL) is gaining attention by more and more researchers in quantitative finance as the agent-environment interaction framework is aligned with decision making process in many business problems. Most of the current…

Mathematical Finance · Quantitative Finance 2022-05-31 Huifang Huang , Ting Gao , Yi Gui , Jin Guo , Peng Zhang

Deep Reinforcement Learning (DRL) has emerged as a promising approach for solving Combinatorial Optimization (CO) problems, such as the 3D Bin Packing Problem (3D-BPP), Traveling Salesman Problem (TSP), or Vehicle Routing Problem (VRP), but…

Machine Learning · Computer Science 2026-01-30 Han Fang , Paul Weng , Yutong Ban

As power systems are undergoing a significant transformation with more uncertainties, less inertia and closer to operation limits, there is increasing risk of large outages. Thus, there is an imperative need to enhance grid emergency…

Machine Learning · Computer Science 2022-02-08 Renke Huang , Yujiao Chen , Tianzhixi Yin , Qiuhua Huang , Jie Tan , Wenhao Yu , Xinya Li , Ang Li , Yan Du

The penetration of distributed renewable energy (DRE) greatly raises the risk of distribution network operation such as peak shaving and voltage stability. Battery energy storage (BES) has been widely accepted as the most potential…

Optimization and Control · Mathematics 2017-07-03 Chenghui Tang , Jian Xu , Yuanzhang Sun , Siyang Liao , Deping Ke , Xiong Li

Multi-access Edge Computing (MEC) addresses computational and battery limitations in devices by allowing them to offload computation tasks. To overcome the difficulties in establishing line-of-sight connections, integrating unmanned aerial…

Networking and Internet Architecture · Computer Science 2023-12-15 Pyae Sone Aung , Loc X. Nguyen , Yan Kyaw Tun , Zhu Han , Choong Seon Hong

Advancing autonomous green technologies in solar photovoltaic (PV) systems is key to improving sustainability and efficiency in renewable energy production. This study presents a reinforcement learning (RL)-based framework to autonomously…

Machine Learning · Computer Science 2026-03-10 Heungjo An

This paper presents a mixed-integer, nonlinear, multi-objective optimization strategy for optimal power allocation among parallel strings in Battery Energy Storage Systems (BESS). High-fidelity control is achieved by co-simulating the…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Vivek Teja Tanjavooru , Prashant Pant , Thomas Hamacher , Holger Hesse

The objective of this work is to reduce the storage dimensions required to operate a coupled photovoltaic (PV) and Battery Energy Storage System (BESS) in an electricity market, while keeping the same level of performance. Performance is…

Systems and Control · Electrical Eng. & Systems 2019-10-16 Thomas Carriere , Christophe Vernay , Sebastien Pitaval , Franccois-Pascal Neirac , George Kariniotakis

In today's forex market traders increasingly turn to algorithmic trading, leveraging computers to seek more profits. Deep learning techniques as cutting-edge advancements in machine learning, capable of identifying patterns in financial…

Computational Engineering, Finance, and Science · Computer Science 2024-08-31 Davoud Sarani , Parviz Rashidi-Khazaee

Growth in the penetration of renewable energy sources makes supply more uncertain and leads to an increase in the system imbalance. This trend, together with the single imbalance pricing, opens an opportunity for balance responsible parties…

Machine Learning · Computer Science 2024-01-02 Seyed Soroush Karimi Madahi , Bert Claessens , Chris Develder

Modern algorithms in the domain of Deep Reinforcement Learning (DRL) demonstrated remarkable successes; most widely known are those in game-based scenarios, from ATARI video games to Go and the StarCraft~\textsc{II} real-time strategy game.…

Artificial Intelligence · Computer Science 2020-05-29 Eric MSP Veith , Nils Wenninghoff , Emilie Frost

The stochastic and dynamic nature of renewable energy sources and power electronic devices are creating unique challenges for modern power systems. One such challenge is that the conventional mathematical systems models-based optimal active…

Optimization and Control · Mathematics 2019-09-02 Jiajun Duan , Haifeng Li , Xiaohu Zhang , Ruisheng Diao , Bei Zhang , Di Shi , Xiao Lu , Zhiwei Wang , Siqi Wang