English
Related papers

Related papers: A Novel Joint DRL-Based Utility Optimization for U…

200 papers

This article presents a digital twin (DT)-enhanced reinforcement learning (RL) framework aimed at optimizing performance and reliability in network resource management, since the traditional RL methods face several unified challenges when…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Nan Cheng , Xiucheng Wang , Zan Li , Zhisheng Yin , Tom Luan , Xuemin Shen

User location is a piece of critical information for network management and control. However, location uncertainty is unavoidable in certain settings leading to localization errors. In this paper, we consider the user location uncertainty…

Systems and Control · Electrical Eng. & Systems 2022-08-04 Yujie Yao , Hao Zhou , Melike Erol-Kantarci

This paper investigates a deep reinforcement learning (DRL)-based approach for managing channel access in wireless networks. Specifically, we consider a scenario in which an intelligent user device (iUD) shares a time-varying uplink…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Abdul Basit , Muddasir Rahim , Georges Kaddoum , Tri Nhu Do , Nadir Adam

In this work, we consider the problem of network parameter optimization for rate maximization. We frame this as a joint optimization problem of power control, beam forming, and interference cancellation. We consider the setting where…

Machine Learning · Computer Science 2023-11-14 Heasung Kim , Sravan Kumar Ankireddy

This paper investigates the application of deep deterministic policy gradient (DDPG) to intelligent reflecting surface (IRS) based unmanned aerial vehicles (UAV) assisted non-orthogonal multiple access (NOMA) downlink networks. The…

Signal Processing · Electrical Eng. & Systems 2023-04-06 Shiyu Jiao , Ximing Xie , Zhiguo Ding

In this paper, we propose a deep reinforcement learning (DRL) based mobility load balancing (MLB) algorithm along with a two-layer architecture to solve the large-scale load balancing problem for ultra-dense networks (UDNs). Our…

Machine Learning · Computer Science 2020-03-03 Yue Xu , Wenjun Xu , Zhi Wang , Jiaru Lin , Shuguang Cui

Unmanned Aerial Vehicles (UAVs) have attracted considerable research interest recently. Especially when it comes to the realm of Internet of Things, the UAVs with Internet connectivity are one of the main demands. Furthermore, the energy…

Machine Learning · Computer Science 2020-11-30 Arash Hooshmand

The unmanned aerial vehicle (UAV)-enabled communication technology is regarded as an efficient and effective solution for some special application scenarios where existing terrestrial infrastructures are overloaded to provide reliable…

Networking and Internet Architecture · Computer Science 2022-09-20 Jinjing Wang , Xindi Wang

Image retrieval (IR) has emerged as a promising approach for self-localization in unmanned aerial vehicles (UAVs). However, IR-based methods face several challenges: 1) Pre- and post-processing incur significant computational and storage…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Ming Dai , Enhui Zheng , Jiahao Chen , Lei Qi , Zhenhua Feng , Wankou Yang

In this paper, a Deep Q-Network (DQN) based multi-agent multi-user power allocation algorithm is proposed for hybrid networks composed of radio frequency (RF) and visible light communication (VLC) access points (APs). The users are capable…

Networking and Internet Architecture · Computer Science 2021-02-04 Bekir Sait Ciftler , Abdulmalik Alwarafy , Mohamed Abdallah , Mounir Hamdi

Millimeter-wave (mmWave) communication systems, particularly those leveraging multi-user multiple-input and multiple-output (MU-MIMO) with hybrid beamforming, face challenges in optimizing user throughput and minimizing latency due to the…

Information Theory · Computer Science 2026-03-04 Ramin Hashemi , Vismika Ranasinghe , Teemu Veijalainen , Petteri Kela , Risto Wichman

In this letter, a novel framework to deliver critical spread out URLLC services deploying unmanned aerial vehicles (UAVs) in an out-of-coverage area is developed. To this end, the resource optimization problem, i.e., resource blocks (RBs)…

Networking and Internet Architecture · Computer Science 2021-04-13 Shashi Raj Pandey , Kitae Kim , Madyan Alsenwi , Yan Kyaw Tun , Zhu Han , Choong Seon Hong

The massive integration of renewable-based distributed energy resources (DERs) inherently increases the energy system's complexity, especially when it comes to defining its operational schedule. Deep reinforcement learning (DRL) algorithms…

Systems and Control · Electrical Eng. & Systems 2023-05-10 Hou Shengren , Pedro P. Vergara , Edgar Mauricio Salazar Duque , Peter Palensky

Network slicing is a critical technique for 5G communications that covers radio access network (RAN), edge, transport and core slicing.The evolving network architecture requires the orchestration of multiple network resources such as radio…

Systems and Control · Electrical Eng. & Systems 2022-09-02 Hao Zhou , Melike Erol-Kantarci , Vincent Poor

Age-of-information (AoI) and transmission power are crucial performance metrics in low energy wireless networks, where information freshness is of paramount importance. This study examines a power-limited internet of things (IoT) network…

Unmanned aerial vehicles (UAV) have emerged as a practical solution that provides on-demand services to users in areas where the terrestrial network is non-existent or temporarily unavailable, e.g., due to natural disasters or network…

Signal Processing · Electrical Eng. & Systems 2023-05-09 Asad Mahmood , Thang X. Vu , Symeon Chatzinotas , Björn Ottersten

Intelligent reflecting surface (IRS) is a promising technology to assist downlink information transmissions from a multi-antenna access point (AP) to a receiver. In this paper, we minimize the AP's transmit power by a joint optimization of…

Signal Processing · Electrical Eng. & Systems 2020-05-26 Jiaye Lin , Yuze Zou , Xiaoru Dong , Shimin Gong , Dinh Thai Hoang , Dusit Niyato

Open Radio Access Network (Open RAN) has gained tremendous attention from industry and academia with decentralized baseband functions across multiple processing units located at different places. However, the ever-expanding scope of RANs,…

Networking and Internet Architecture · Computer Science 2023-10-06 Haiyuan Li , Amin Emami , Karcius Assis , Antonis Vafeas , Ruizhi Yang , Reza Nejabati , Shuangyi Yan , Dimitra Simeonidou

This paper considers the problem of cost-aware downlink sum-rate maximization via joint optimal radio access technologies (RATs) assignment and power allocation in next-generation heterogeneous wireless networks (HetNets). We consider a…

Signal Processing · Electrical Eng. & Systems 2025-07-04 Abdulmalik Alwarafy , Bekir Sait Ciftler , Mohamed Abdallah , Mounir Hamdi , Naofal Al-Dhahir

In this paper, dynamic non-cooperative coexistence between a cognitive pulsed radar and a nearby communications system is addressed by applying nonlinear value function approximation via deep reinforcement learning (Deep RL) to develop a…

Signal Processing · Electrical Eng. & Systems 2020-08-28 Charles E. Thornton , Mark A. Kozy , R. Michael Buehrer , Anthony F. Martone , Kelly D. Sherbondy