English
Related papers

Related papers: Cascade Reinforcement Learning with State Space Fa…

200 papers

The vision of 5G lies in providing high data rates, low latency (for the aim of near-real-time applications), significantly increased base station capacity, and near-perfect quality of service (QoS) for users, compared to LTE networks. In…

Networking and Internet Architecture · Computer Science 2022-09-14 Hakan Erdol , Xiaoyang Wang , Peizheng Li , Jonathan D. Thomas , Robert Piechocki , George Oikonomou , Rui Inacio , Abdelrahim Ahmad , Keith Briggs , Shipra Kapoor

In 5G non-standalone mode, an intelligent traffic steering mechanism can vastly aid in ensuring smooth user experience by selecting the best radio access technology (RAT) from a multi-RAT environment for a specific traffic flow. In this…

Networking and Internet Architecture · Computer Science 2023-01-20 Md Arafat Habib , Hao Zhou , Pedro Enrique Iturria-Rivera , Medhat Elsayed , Majid Bavand , Raimundas Gaigalas , Yigit Ozcan , Melike Erol-Kantarci

Deep Reinforcement Learning (DRL) uses diverse, unstructured data and makes RL capable of learning complex policies in high dimensional environments. Intelligent Transportation System (ITS) based on Autonomous Vehicles (AVs) offers an…

Machine Learning · Computer Science 2022-06-30 Anum Mushtaq , Irfan ul Haq , Muhammad Azeem Sarwar , Asifullah Khan , Omair Shafiq

Reinforcement Learning (RL) is currently one of the most commonly used techniques for traffic signal control (TSC), which can adaptively adjusted traffic signal phase and duration according to real-time traffic data. However, a fully…

Computer Science and Game Theory · Computer Science 2023-01-03 Yuli. Zhang , Shangbo. Wang , Ruiyuan. Jiang

The Intelligent Transportation System (ITS) environment is known to be dynamic and distributed, where participants (vehicle users, operators, etc.) have multiple, changing and possibly conflicting objectives. Although Reinforcement Learning…

Machine Learning · Computer Science 2024-03-19 Jing Tan , Ramin Khalili , Holger Karl

System optimal traffic routing can mitigate congestion by assigning routes for a portion of vehicles so that the total travel time of all vehicles in the transportation system can be reduced. However, achieving real-time optimal routing…

Machine Learning · Computer Science 2024-07-11 Zemian Ke , Qiling Zou , Jiachao Liu , Sean Qian

The open radio access network (O-RAN) architecture introduces RAN intelligent controllers (RICs) to facilitate the management and optimization of the disaggregated RAN. Reinforcement learning (RL) and its advanced form, deep RL (DRL), are…

Artificial Intelligence · Computer Science 2025-06-17 Mohammadreza Kouchaki , Aly Sabri Abdalla , Vuk Marojevic

Proper functioning of connected and automated vehicles (CAVs) is crucial for the safety and efficiency of future intelligent transport systems. Meanwhile, transitioning to fully autonomous driving requires a long period of mixed autonomy…

Robotics · Computer Science 2022-11-08 Qi Liu , Xueyuan Li , Zirui Li , Jingda Wu , Guodong Du , Xin Gao , Fan Yang , Shihua Yuan

The recent development of connected and automated vehicle (CAV) technologies has spurred investigations to optimize dense urban traffic to maximize vehicle speed and throughput. This paper explores advisory autonomy, in which real-time…

Robotics · Computer Science 2026-04-13 Jung-Hoon Cho , Sirui Li , Jeongyun Kim , Cathy Wu

Most Reinforcement Learning (RL) methods are traditionally studied in an active learning setting, where agents directly interact with their environments, observe action outcomes, and learn through trial and error. However, allowing…

Artificial Intelligence · Computer Science 2023-10-16 Maryam Zare , Parham M. Kebria , Abbas Khosravi

Opportunistic Networks (OppNets) employ the Store-Carry-Forward (SCF) paradigm to maintain communication during intermittent connectivity. However, routing performance suffers due to dynamic topology changes, unpredictable contact patterns,…

Networking and Internet Architecture · Computer Science 2026-02-18 Meisam Sharifi Sani , Saeid Iranmanesh , Raad Raad , Faisel Tubbal

Traffic steering (TS) is a promising approach to support various service requirements and enhance transmission reliability by distributing network traffic loads to appropriate base stations (BSs). In conventional cell-centric TS strategies,…

Networking and Internet Architecture · Computer Science 2023-11-30 Han Zhang , Hao Zhou , Medhat Elsayed , Majid Bavand , Raimundas Gaigalas , Yigit Ozcan , Melike Erol-Kantarci

The teleoperated driving (TD) scenario comes with stringent Quality of Service (QoS) communication constraints, especially in terms of end-to-end (E2E) latency and reliability. In this context, Predictive Quality of Service (PQoS), possibly…

Networking and Internet Architecture · Computer Science 2025-05-07 Giacomo Avanzi , Marco Giordani , Michele Zorzi

Connected and autonomous vehicles (CAVs) promise next-gen transportation systems with enhanced safety, energy efficiency, and sustainability. One typical control strategy for CAVs is the so-called cooperative adaptive cruise control (CACC)…

Systems and Control · Electrical Eng. & Systems 2024-02-20 Dong Chen , Kaixiang Zhang , Yongqiang Wang , Xunyuan Yin , Zhaojian Li , Dimitar Filev

Energy consumption in mobile communication networks has become a significant challenge due to its direct impact on Capital Expenditure (CAPEX) and Operational Expenditure (OPEX). The introduction of Open RAN (O-RAN) enables…

Networking and Internet Architecture · Computer Science 2025-04-22 Rawlings Ntassah , Gian Michele Dell'Aera , Fabrizio Granelli

Open Radio Access Network (O RAN) disaggregates conventional RAN into interoperable components, enabling flexible resource allocation, energy savings, and agile architectural design. In legacy deployments, the binding between logical…

Networking and Internet Architecture · Computer Science 2025-12-24 Sebastian Racedo , Brigitte Jaumard , Oscar Delgado , Meysam Masoudi

In this paper, we propose reconfigurable intelligent surface (RIS)-assisted unmanned aerial vehicles (UAVs) networks that can utilise both advantages of UAV's agility and RIS's reflection for enhancing the network's performance. To aim at…

Signal Processing · Electrical Eng. & Systems 2021-08-09 Khoi Khac Nguyen , Saeed Khosravirad , Daniel Benevides da Costa , Long D. Nguyen , Trung Q. Duong

Densely deployed base stations are responsible for the majority of the energy consumed in Radio access network (RAN). While these deployments are crucial to deliver the required data rate in busy hours of the day, the network can save…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Xuanyu Liang , Ahmed Al-Tahmeesschi , Swarna Chetty , Cicek Cavdar , Berk Canberk , Hamed Ahmadi

Deep reinforcement learning (DRL) has been increasingly employed to handle the dynamic and complex resource management in network slicing. The deployment of DRL policies in real networks, however, is complicated by heterogeneous cell…

Networking and Internet Architecture · Computer Science 2023-06-26 Tianlun Hu , Qi Liao , Qiang Liu , Georg Carle

Connected Vehicles (CVs) can leverage the unique features of 5G and future 6G/NextG networks to enhance Intelligent Transportation System (ITS) services. However, even with advancements in cellular network generations, CV applications may…

Networking and Internet Architecture · Computer Science 2024-12-31 Maria Barbosa , Kelvin Dias