English
Related papers

Related papers: Multi-Timescale Control and Communications with De…

200 papers

Deep reinforcement learning (DRL) has been used to learn effective heuristics for solving complex combinatorial optimisation problem via policy networks and have demonstrated promising performance. Existing works have focused on solving…

Machine Learning · Computer Science 2020-12-25 Nasrin Sultana , Jeffrey Chan , A. K. Qin , Tabinda Sarwar

Mobile edge computing (MEC) is a promising technique to improve the computational capacity of smart devices (SDs) in Internet of Things (IoT). However, the performance of MEC is restricted due to its fixed location and limited service…

Networking and Internet Architecture · Computer Science 2025-08-04 Saichao Liu , Geng Sun , Chuang Zhang , Xuejie Liu , Jiacheng Wang , Changyuan Zhao , Dusit Niyato

We apply deep reinforcement learning (DRL) to design of a networked controller with network delays to complete a temporal control task that is described by a signal temporal logic (STL) formula. STL is useful to deal with a specification…

Systems and Control · Electrical Eng. & Systems 2022-03-29 Junya Ikemoto , Toshimitsu Ushio

Model Predictive Control (MPC) is attracting tremendous attention in the autonomous driving task as a powerful control technique. The success of an MPC controller strongly depends on an accurate internal dynamics model. However, the static…

Machine Learning · Computer Science 2023-04-28 Yuan Zhang , Joschka Boedecker , Chuxuan Li , Guyue Zhou

Adaptive Traffic Signal Control (ATSC) has become a popular research topic in intelligent transportation systems. Regional Traffic Signal Control (RTSC) using the Multi-agent Deep Reinforcement Learning (MADRL) technique has become a…

Multiagent Systems · Computer Science 2025-02-20 Hankang Gu , Shangbo Wang , Dongyao Jia , Yuli Zhang , Yanrong Luo , Guoqiang Mao , Jianping Wang , Eng Gee Lim

Nowadays, as the need for capacity continues to grow, entirely novel services are emerging. A solid cloud-network integrated infrastructure is necessary to supply these services in a real-time responsive, and scalable way. Due to their…

Networking and Internet Architecture · Computer Science 2023-09-20 Masoud Shokrnezhad , Tarik Taleb , Patrizio Dazzi

This letter proposes a semantic-aware resource allocation (SARA) framework with flexible duty cycle (DC) coexistence mechanism (SARADC) for 5G-V2X Heterogeneous Network (HetNets) based on deep reinforcement learning (DRL) proximal policy…

Networking and Internet Architecture · Computer Science 2025-06-23 Zhiyu Shao , Qiong Wu , Pingyi Fan , Nan Cheng , Qiang Fan , Jiangzhou Wang

Deploying controllers trained with Reinforcement Learning (RL) on real robots can be challenging: RL relies on agents' policies being modeled as Markov Decision Processes (MDPs), which assume an inherently discrete passage of time. The use…

Robotics · Computer Science 2024-04-03 Dong Wang , Giovanni Beltrame

Wireless network optimization has been becoming very challenging as the problem size and complexity increase tremendously, due to close couplings among network entities with heterogeneous service and resource requirements. By continuously…

Information Theory · Computer Science 2020-01-29 Shimin Gong , Yutong Xie , Jing Xu , Dusit Niyato , Ying-Chang Liang

In this paper, we aim to maximize the SSR for heterogeneous service demands in the cooperative MEC-assisted RAN slicing system by jointly considering the multi-node computing resources cooperation and allocation, the transmission resource…

Networking and Internet Architecture · Computer Science 2024-05-29 Chong Zheng , Yongming Huang , Cheng Zhang , Tony Q. S. Quek

In millimeter wave (mmWave) vehicular communications, multi-hop relay disconnection by line-of-sight (LOS) blockage is a critical problem, especially in the early diffusion phase of mmWave-available vehicles, where not all the vehicles have…

Networking and Internet Architecture · Computer Science 2019-03-25 Akihito Taya , Takayuki Nishio , Masahiro Morikura , Koji Yamamoto

Deep Reinforcement Learning (DRL) has become a powerful methodology to solve complex decision-making problems. However, DRL has several limitations when used in real-world problems (e.g., robotics applications). For instance, long training…

Robotics · Computer Science 2019-08-15 Rodrigo Pérez-Dattari , Carlos Celemin , Javier Ruiz-del-Solar , Jens Kober

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

It can be difficult to autonomously produce driver behavior so that it appears natural to other traffic participants. Through Inverse Reinforcement Learning (IRL), we can automate this process by learning the underlying reward function from…

Robotics · Computer Science 2022-01-19 Keuntaek Lee , David Isele , Evangelos A. Theodorou , Sangjae Bae

To improve the system performance towards the Shannon limit, advanced radio resource management mechanisms play a fundamental role. In particular, scheduling should receive much attention, because it allocates radio resources among…

Machine Learning · Computer Science 2021-03-23 Jian Wang , Chen Xu , Rong Li , Yiqun Ge , Jun Wang

Deep Reinforcement Learning (RL) has shown great success in learning complex control policies for a variety of applications in robotics. However, in most such cases, the hardware of the robot has been considered immutable, modeled as part…

Robotics · Computer Science 2020-11-10 Tianjian Chen , Zhanpeng He , Matei Ciocarlie

This paper addresses the challenges of resource allocation in vehicular networks enhanced by Intelligent Reflecting Surfaces (IRS), considering the uncertain Channel State Information (CSI) typical of vehicular environments due to the…

Signal Processing · Electrical Eng. & Systems 2025-04-17 Peng Wang , Weihua Wu

Sampling-based model predictive control (MPC) has found significant success in optimal control problems with non-smooth system dynamics and cost function. Many machine learning-based works proposed to improve MPC by a) learning or…

Machine Learning · Computer Science 2024-01-08 Sungwook Yang , Chaoying Pei , Ran Dai , Chuangchuang Sun

Power system optimal dispatch with transient security constraints is commonly represented as Transient Security-Constrained Optimal Power Flow (TSC-OPF). Deep Reinforcement Learning (DRL)-based TSC-OPF trains efficient decision-making…

Systems and Control · Electrical Eng. & Systems 2025-04-03 Tannan Xiao , Ying Chen , Han Diao , Shaowei Huang , Chen Shen

Resource allocation in wireless networks typically occurs at PHY/MAC layers, while random network coding (RNC) is a network layer strategy. An interesting question is how resource allocation mechanisms can be tuned to improve RNC…

Networking and Internet Architecture · Computer Science 2013-03-27 Kai Su , Dan Zhang , Narayan B. Mandayam