English
Related papers

Related papers: Multi-Satellite Beam Hopping and Power Allocation …

200 papers

The application of reinforcement learning (RL) to dynamic resource allocation in optical networks has been the focus of intense research activity in recent years, with almost 100 peer-reviewed papers. We present a review of progress in the…

Networking and Internet Architecture · Computer Science 2025-04-23 Michael Doherty , Robin Matzner , Rasoul Sadeghi , Polina Bayvel , Alejandra Beghelli

This paper introduces a full solution for decentralized routing in Low Earth Orbit satellite constellations based on continual Deep Reinforcement Learning (DRL). This requires addressing multiple challenges, including the partial knowledge…

Machine Learning · Computer Science 2024-05-22 Federico Lozano-Cuadra , Beatriz Soret , Israel Leyva-Mayorga , Petar Popovski

Scheduling plays a pivotal role in multi-user wireless communications, since the quality of service of various users largely depends upon the allocated radio resources. In this paper, we propose a novel scheduling algorithm with contiguous…

Networking and Internet Architecture · Computer Science 2020-11-30 Shu Sun , Xiaofeng Li

Efficient data transfers over high-speed, long-distance shared networks require proper utilization of available network bandwidth. Using parallel TCP streams enables an application to utilize network parallelism and can improve transfer…

Networking and Internet Architecture · Computer Science 2022-12-02 Hasibul Jamil , Elvis Rodrigues , Jacob Goldverg , Tevfik Kosar

We develop a multi-agent reinforcement learning (MARL) algorithm to minimize the total energy consumption of multiple massive MIMO (multiple-input multiple-output) base stations (BSs) in a multi-cell network while preserving the overall…

Information Theory · Computer Science 2024-02-06 Tianzhang Cai , Qichen Wang , Shuai Zhang , Özlem Tuğfe Demir , Cicek Cavdar

We consider the problem of distributed downlink beam scheduling and power allocation for millimeter-Wave (mmWave) cellular networks where multiple base stations (BSs) belonging to different service operators share the same unlicensed…

Information Theory · Computer Science 2021-10-19 Xiang Zhang , Shamik Sarkar , Arupjyoti Bhuyan , Sneha Kumar Kasera , Mingyue Ji

In this paper, we present a novel distributed UAVs beam reforming approach to dynamically form and reform a space-selective beam path in addressing the coexistence with satellite and terrestrial communications. Despite the unique advantage…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Sudhanshu Arya , Yifeng Peng , Jingda Yang , Ying Wang

In this paper, the design of an optimal trajectory for an energy-constrained drone operating in dynamic network environments is studied. In the considered model, a drone base station (DBS) is dispatched to provide uplink connectivity to…

Machine Learning · Computer Science 2020-05-27 Ye Hu , Mingzhe Chen , Walid Saad , H. Vincent Poor , Shuguang Cui

The dynamic allocation of spectrum in 5G / 6G networks is critical to efficient resource utilization. However, applying traditional deep reinforcement learning (DRL) is often infeasible due to its immense sample complexity and the safety…

Machine Learning · Computer Science 2026-03-02 Oluwaseyi Giwa , Tobi Awodunmila , Muhammad Ahmed Mohsin , Ahsan Bilal , Muhammad Ali Jamshed

Mobile edge computing (MEC) is a promising technique to improve the computational capacity of smart devices (SDs) in Internet of Things (IoT). However, the performance of MEC is restricted due to its fixed location and limited service…

Networking and Internet Architecture · Computer Science 2025-08-04 Saichao Liu , Geng Sun , Chuang Zhang , Xuejie Liu , Jiacheng Wang , Changyuan Zhao , Dusit Niyato

Millimeter Wave (mmWave) is an important part of 5G new radio (NR), in which highly directional beams are adapted to compensate for the substantial propagation loss based on UE locations. However, the location information may have some…

Systems and Control · Electrical Eng. & Systems 2022-04-26 Yujie Yao , Hao Zhou , Melike Erol-Kantarci

Deep reinforcement learning (DRL) has long been a promising solution for sequential resource management in wireless networks. However, conventional DRL methods are fundamentally limited by their reliance on unimodal policy distributions,…

Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Collaborative end-edge-cloud computing for deep learning provides a range of performance and efficiency…

Machine Learning · Computer Science 2022-02-24 Sina Shahhosseini , Tianyi Hu , Dongjoo Seo , Anil Kanduri , Bryan Donyanavard , Amir M. Rahmani , Nikil Dutt

In this paper, the downlink packet scheduling problem for cellular networks is modeled, which jointly optimizes throughput, fairness and packet drop rate. Two genie-aided heuristic search methods are employed to explore the solution space.…

Information Theory · Computer Science 2019-11-14 Chen Xu , Jian Wang , Tianhang Yu , Chuili Kong , Yourui Huangfu , Rong Li , Yiqun Ge , Jun Wang

This study addresses the challenge of resource scheduling optimization in edge-cloud collaborative computing using deep reinforcement learning (DRL). The proposed DRL-based approach improves task processing efficiency, reduces overall…

Machine Learning · Computer Science 2025-04-30 Yuqing Wang , Xiao Yang

Bike sharing provides an environment-friendly way for traveling and is booming all over the world. Yet, due to the high similarity of user travel patterns, the bike imbalance problem constantly occurs, especially for dockless bike sharing…

Artificial Intelligence · Computer Science 2018-12-04 Ling Pan , Qingpeng Cai , Zhixuan Fang , Pingzhong Tang , Longbo Huang

A mega-constellation of low-earth orbit (LEO) satellites has the potential to enable long-range communication with low latency. Integrating this with burgeoning unmanned aerial vehicle (UAV) assisted non-terrestrial networks will be a…

Networking and Internet Architecture · Computer Science 2020-05-27 Ju-Hyung Lee , Jihong Park , Mehdi Bennis , Young-Chai Ko

Routing in multi-hop wireless networks is a complex problem, especially in heterogeneous networks where multiple wireless communication technologies coexist. Reinforcement learning (RL) methods, such as Q-learning, have been introduced for…

Signal Processing · Electrical Eng. & Systems 2025-08-21 Brian Kim , Justin H. Kong , Terrence J. Moore , Fikadu T. Dagefu

This paper explores the feasibility of leveraging concepts from deep reinforcement learning (DRL) to enable dynamic resource management in Wi-Fi networks implementing distributed multi-user MIMO (D-MIMO). D-MIMO is a technique by which a…

The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms…

Systems and Control · Electrical Eng. & Systems 2023-05-10 Hou Shengren , Pedro P. Vergara , Edgar Mauricio Salazar Duque , Peter Palensky