English
Related papers

Related papers: Multi-Timescale Control and Communications with De…

200 papers

We present a Reinforcement Learning (RL) approach to the problem of controlling the Discontinuous Reception (DRX) policy from a Base Transceiver Station (BTS) in a cellular network. We do so by means of optimally timing the transmission of…

Information Theory · Computer Science 2024-06-21 Adriano Pastore , Adrián Agustín de Dios , Álvaro Valcarce

Cooperative intelligent transport systems rely on a set of Vehicle-to-Everything (V2X) applications to enhance road safety. Emerging new V2X applications like Advanced Driver Assistance Systems (ADASs) and Connected Autonomous Driving (CAD)…

Networking and Internet Architecture · Computer Science 2024-07-02 Badreddine Yacine Yacheur , Toufik Ahmed , Mohamed Mosbah

Distributed resource allocation algorithms differ from centralized methods by relying on locally collected information for resource selection, leading to a low vehicle-to-everything (V2X) communication quality of service (QoS) in…

Systems and Control · Electrical Eng. & Systems 2024-12-19 Taesik Nam , Seungjae Lee , Kiwoong Park , Sunbeom Kwon , Nathan Jeong , Han-Shin Jo , Jong-Gwan Yook

We consider a joint uplink and downlink scheduling problem of a fully distributed wireless networked control system (WNCS) with a limited number of frequency channels. Using elements of stochastic systems theory, we derive a sufficient…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Gaoyang Pang , Kang Huang , Daniel E. Quevedo , Branka Vucetic , Yonghui Li , Wanchun Liu

Dynamic spectrum access (DSA) is regarded as an effective and efficient technology to share radio spectrum among different networks. As a secondary user (SU), a DSA device will face two critical problems: avoiding causing harmful…

Machine Learning · Computer Science 2018-10-30 Hao-Hsuan Chang , Hao Song , Yang Yi , Jianzhong Zhang , Haibo He , Lingjia Liu

We present a novel reinforcement learning (RL) based task allocation and decentralized navigation algorithm for mobile robots in warehouse environments. Our approach is designed for scenarios in which multiple robots are used to perform…

Robotics · Computer Science 2022-09-08 Aakriti Agrawal , Senthil Hariharan , Amrit Singh Bedi , Dinesh Manocha

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

Automated driving at unsignalized intersections is challenging due to complex multi-vehicle interactions and the need to balance safety and efficiency. Model Predictive Control (MPC) offers structured constraint handling through…

Robotics · Computer Science 2026-04-16 Saeed Rahmani , Gözde Körpe , Zhenlin , Xu , Bruno Brito , Simeon Craig Calvert , Bart van Arem

The model-based power allocation algorithm has been investigated for decades, but it requires the mathematical models to be analytically tractable and it usually has high computational complexity. Recently, the data-driven model-free…

Information Theory · Computer Science 2019-01-23 Fan Meng , Peng Chen , Lenan Wu , Julian Cheng

In an RF-powered backscatter cognitive radio network, multiple secondary users communicate with a secondary gateway by backscattering or harvesting energy and actively transmitting their data depending on the primary channel state. To…

Machine Learning · Computer Science 2018-10-11 Tran The Anh , Nguyen Cong Luong , Dusit Niyato , Ying-Chang Liang , Dong In Kim

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

Systems and Control · Electrical Eng. & Systems 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

Resource allocation plays a critical role in minimizing cycle time and improving the efficiency of business processes. Recently, Deep Reinforcement Learning (DRL) has emerged as a powerful technique to optimize resource allocation policies…

Machine Learning · Computer Science 2025-09-03 Jeroen Middelhuis , Zaharah Bukhsh , Ivo Adan , Remco Dijkman

The impact of Vehicle-to-Everything (V2X) communications on platoon control performance is investigated. Platoon control is essentially a sequential stochastic decision problem (SSDP), which can be solved by Deep Reinforcement Learning…

Systems and Control · Electrical Eng. & Systems 2022-03-30 Lei Lei , Tong Liu , Kan Zheng , Lajos Hanzo

Optical camera communications (OCC) has emerged as a key enabling technology for the seamless operation of future autonomous vehicles. In this paper, we introduce a spectral efficiency optimization approach in vehicular OCC. Specifically,…

Machine Learning · Computer Science 2022-05-06 Amirul Islam , Leila Musavian , Nikolaos Thomos

We address the problem of resource allocation (RA) in a cognitive radio (CR) communication system with multiple secondary operators sharing spectrum with an incumbent primary operator. The key challenge of the RA problem is the…

Signal Processing · Electrical Eng. & Systems 2020-05-11 Ehsan Tohidi , David Gesbert , Philippe Ciblat

Many real-world applications can be formulated as multi-agent cooperation problems, such as network packet routing and coordination of autonomous vehicles. The emergence of deep reinforcement learning (DRL) provides a promising approach for…

Multiagent Systems · Computer Science 2022-06-28 Zhixuan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Huafeng Xu

Deep Reinforcement Learning (DRL) is a powerful tool used for addressing complex challenges in mobile networks. This paper investigates the application of two DRL models, on-policy and off-policy, in the field of resource allocation for…

Networking and Internet Architecture · Computer Science 2024-12-04 Manal Mehdaoui , Amine Abouaomar

Vehicle platooning, one of the advanced services supported by 5G NR-V2X, improves traffic efficiency in the connected intelligent transportation systems (C-ITSs). However, the packet delivery ratio of platoon communication, especially in…

Networking and Internet Architecture · Computer Science 2021-05-04 Liu Cao , Hao Yin

A joint resource allocation (RA), user association (UA), and power control (PC) problem is addressed for proportional fairness maximization in a cooperative multiuser downlink small cell network with limited backhaul capacity, based on…

Networking and Internet Architecture · Computer Science 2018-08-14 Jonggyu Jang , Hyun Jong Yang , Hyekyung Jwa

In this paper, we present the use of Model Predictive Control (MPC) based on Reinforcement Learning (RL) to find the optimal policy for a multi-agent battery storage system. A time-varying prediction of the power price and production-demand…

Systems and Control · Electrical Eng. & Systems 2021-06-08 A. Bahari Kordabad , W. Cai , S. Gros