English
Related papers

Related papers: Multi-Timescale Control and Communications with De…

200 papers

We study the joint active/passive beamforming and channel blocklength (CBL) allocation in a non-ideal reconfigurable intelligent surface (RIS)-aided ultra-reliable and low-latency communication (URLLC) system. The considered scenario is a…

Information Theory · Computer Science 2024-10-28 Ramin Hashemi , Samad Ali , Nurul Huda Mahmood , Matti Latva-aho

Unmanned Aerial Vehicles (UAVs) are increasingly essential in various fields such as surveillance, reconnaissance, and telecommunications. This study aims to develop a learning algorithm for the path planning of UAV wireless communication…

Machine Learning · Computer Science 2025-01-20 Joseanne Viana , Boris Galkin , Lester Ho , Holger Claussen

Developing an automated driving system capable of navigating complex traffic environments remains a formidable challenge. Unlike rule-based or supervised learning-based methods, Deep Reinforcement Learning (DRL) based controllers eliminate…

Machine Learning · Computer Science 2025-01-28 Zhihao Zhang , Ekim Yurtsever , Keith A. Redmill

In this study, we explore an innovative approach to enhance cooperative driving in vehicle platooning systems through the use of vehicle-to-everything (V2X) communication technologies. As Connected and Autonomous Vehicles (CAVs) integrate…

Multiagent Systems · Computer Science 2025-12-11 Mahdi Razzaghpour , Shahriar Shahram , Rodolfo Valiente , Mahdi Zaman , Yaser P. Fallah

Multi-agent Deep Reinforcement Learning (MADRL) based traffic signal control becomes a popular research topic in recent years. To alleviate the scalability issue of completely centralized RL techniques and the non-stationarity issue of…

Artificial Intelligence · Computer Science 2023-09-08 Hankang Gu , Shangbo Wang , Xiaoguang Ma , Dongyao Jia , Guoqiang Mao , Eng Gee Lim , Cheuk Pong Ryan Wong

Air transportation is undergoing a rapid evolution globally with the introduction of Advanced Air Mobility (AAM) and with it comes novel challenges and opportunities for transforming aviation. As AAM operations introduce increasing…

Artificial Intelligence · Computer Science 2024-07-02 Luis E. Alvarez , Marc W. Brittain , Steven D. Young

Lane-changing (LC) is a challenging scenario for connected and automated vehicles (CAVs) because of the complex dynamics and high uncertainty of the traffic environment. This challenge can be handled by deep reinforcement learning (DRL)…

Robotics · Computer Science 2024-07-04 Xue Yao , Shengren Hou , Serge P. Hoogendoorn , Simeon C. Calvert

In this work, we propose a novel learning-based model predictive control (MPC) framework for motion planning and control of urban self-driving. In this framework, instantaneous references and cost functions of online MPC are learned from…

Robotics · Computer Science 2024-02-29 Yubin Wang , Zengqi Peng , Yusen Xie , Yulin Li , Hakim Ghazzai , Jun Ma

Increasing traffic demands, higher levels of automation, and communication enhancements provide novel design opportunities for future air traffic controllers (ATCs). This article presents a novel deep reinforcement learning (DRL) controller…

Machine Learning · Computer Science 2022-11-28 Lei Wang , Hongyu Yang , Yi Lin , Suwan Yin , Yuankai Wu

Transmission interface power flow adjustment is a critical measure to ensure the security and economy operation of power systems. However, conventional model-based adjustment schemes are limited by the increasing variations and…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Shunyu Liu , Wei Luo , Yanzhen Zhou , Kaixuan Chen , Quan Zhang , Huating Xu , Qinglai Guo , Mingli Song

Developing an autonomous vehicle control strategy for signalised intersections (SI) is one of the challenging tasks due to its inherently complex decision-making process. This study proposes a Deep Reinforcement Learning (DRL) based…

Artificial Intelligence · Computer Science 2025-05-15 Pankaj Kumar , Aditya Mishra , Pranamesh Chakraborty , Subrahmanya Swamy Peruru

Rotating detonation engines (RDEs) are a promising propulsion concept that may offer higher thermodynamic efficiency and specific impulse than conventional systems, but nonlinear phenomena, including transitions to oscillatory or chaotic…

Fluid Dynamics · Physics 2026-04-17 Kristian Holme , Jean Rabault , Ricardo Vinuesa , Mikael Mortensen

We propose a hybrid reinforcement learning (RL) and model predictive control (MPC) framework for mixed-integer optimal control, where discrete variables enter the cost and dynamics but not the constraints. Existing hierarchical approaches…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Joschua Wüthrich , Romir Damle , Giona Fieni , Melanie N. Zeilinger , Christopher H. Onder , Andrea Carron

In this paper, dynamic non-cooperative coexistence between a cognitive pulsed radar and a nearby communications system is addressed by applying nonlinear value function approximation via deep reinforcement learning (Deep RL) to develop a…

Signal Processing · Electrical Eng. & Systems 2020-08-28 Charles E. Thornton , Mark A. Kozy , R. Michael Buehrer , Anthony F. Martone , Kelly D. Sherbondy

Reinforcement learning (RL) has shown great effectiveness in quadrotor control, enabling specialized policies to develop even human-champion-level performance in single-task scenarios. However, these specialized policies often struggle with…

Robotics · Computer Science 2024-12-18 Jiaxu Xing , Ismail Geles , Yunlong Song , Elie Aljalbout , Davide Scaramuzza

With the rapid deployment of the Internet of Things (IoT), fifth-generation (5G) and beyond 5G networks are required to support massive access of a huge number of devices over limited radio spectrum radio. In wireless networks, different…

Signal Processing · Electrical Eng. & Systems 2020-12-18 Helin Yang , Zehui Xiong , Jun Zhao , Dusit Niyato , Chau Yuen , Ruilong Deng

In multi-agent deep reinforcement learning (MADRL), agents can communicate with one another to perform a task in a coordinated manner. When multiple tasks are involved, agents can also leverage knowledge from one task to improve learning in…

Multiagent Systems · Computer Science 2025-11-07 Changxi Zhu , Mehdi Dastani , Shihan Wang

Deep Reinforcement Learning (DRL) has emerged as a promising approach to enhancing motion control and decision-making through a wide range of robotic applications. While prior research has demonstrated the efficacy of DRL algorithms in…

Delayed Markov decision processes (DMDPs) fulfill the Markov property by augmenting the state space of agents with a finite time window of recently committed actions. In reliance on these state augmentations, delay-resolved reinforcement…

Robotics · Computer Science 2025-11-17 Mohammadhossein Malmir , Josip Josifovski , Noah Klarmann , Alois Knoll

With the advent of universal function approximators in the domain of reinforcement learning, the number of practical applications leveraging deep reinforcement learning (DRL) has exploded. Decision-making in autonomous vehicles (AVs) has…

Robotics · Computer Science 2024-06-14 Hanxi Wan , Pei Li , Arpan Kusari