English
Related papers

Related papers: Deep Q-Learning Assisted Bandwidth Reservation for…

200 papers

The teleoperated driving (TD) scenario comes with stringent Quality of Service (QoS) communication constraints, especially in terms of end-to-end (E2E) latency and reliability. In this context, Predictive Quality of Service (PQoS), possibly…

Networking and Internet Architecture · Computer Science 2025-05-07 Giacomo Avanzi , Marco Giordani , Michele Zorzi

Effective network slicing requires an infrastructure/network provider to deal with the uncertain demand and real-time dynamics of network resource requests. Another challenge is the combinatorial optimization of numerous resources, e.g.,…

Networking and Internet Architecture · Computer Science 2019-02-27 Nguyen Van Huynh , Dinh Thai Hoang , Diep N. Nguyen , Eryk Dutkiewicz

This letter presents a deep reinforcement learning (DRL) approach for transmission design to optimize the energy efficiency in vehicle-to-vehicle (V2V) communication links. Considering the dynamic environment of vehicular communications,…

Signal Processing · Electrical Eng. & Systems 2024-04-22 Zhengpeng Wang , Yanqun Tang , Yingzhe Mao , Tao Wang , Xiunan Huang

Large-scale deep neural networks (DNNs) have achieved remarkable success in many application scenarios. However, high computational complexity and energy costs of modern DNNs make their deployment on edge devices challenging. Model…

Machine Learning · Computer Science 2024-04-29 Cédric Gernigon , Silviu-Ioan Filip , Olivier Sentieys , Clément Coggiola , Mickael Bruno

Extended reality (XR) is one of the most important applications of beyond 5G and 6G networks. Real-time XR video transmission presents challenges in terms of data rate and delay. In particular, the frame-by-frame transmission mode of XR…

Networking and Internet Architecture · Computer Science 2024-04-16 Guangjin Pan , Shugong Xu , Shunqing Zhang , Xiaojing Chen , Yanzan Sun

This letter indicates the critical need for prioritized multi-tenant quality-of-service (QoS) management by emerging mobile edge systems, particularly for high-throughput beyond fifth-generation networks. Existing traffic engineering tools…

Networking and Internet Architecture · Computer Science 2024-03-26 Mohammad Sajid Shahriar , Faisal Ahmed , Genshe Chen , Khanh D. Pham , Suresh Subramaniam , Motoharu Matsuura , Hiroshi Hasegawa , Shih-Chun Lin

In this paper, we aim to address the challenge of hybrid mobile edge-quantum computing (MEQC) for sustainable task offloading scheduling in mobile networks. We develop cost-effective designs for both task offloading mode selection and…

Systems and Control · Electrical Eng. & Systems 2023-06-27 Ziqiang Ye , Yulan Gao , Yue Xiao , Minrui Xu , Han Yu , Dusit Niyato

The paper considers a class of multi-agent Markov decision processes (MDPs), in which the network agents respond differently (as manifested by the instantaneous one-stage random costs) to a global controlled state and the control actions of…

Machine Learning · Statistics 2015-06-04 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

5th generation networks are envisioned to provide seamless and ubiquitous connection to 1000-fold more devices and is believed to provide ultra-low latency and higher data rates up to tens of Gbps. Different technologies enabling these…

Artificial Intelligence · Computer Science 2018-09-25 Kamran Zia , Nauman Javed , Muhammad Nadeem Sial , Sohail Ahmed , Hifsa Iram , Asad Amir Pirzada

In this paper, we propose a novel joint deep reinforcement learning (DRL)-based solution to optimize the utility of an uncrewed aerial vehicle (UAV)-assisted communication network. To maximize the number of users served within the…

Networking and Internet Architecture · Computer Science 2025-01-03 Xuli Cai , Poonam Lohan , Burak Kantarci

In this paper, we design a navigation policy for multiple unmanned aerial vehicles (UAVs) where mobile base stations (BSs) are deployed to improve the data freshness and connectivity to the Internet of Things (IoT) devices. First, we…

Signal Processing · Electrical Eng. & Systems 2020-03-11 Sarder Fakhrul Abedin , Md. Shirajum Munir , Nguyen H. Tran , Zhu Han , Choong Seon Hong

Beamforming is one of the key techniques in millimeter wave (mmWave) multi-input multi-output (MIMO) communications. Designing appropriate beamforming not only improves the quality and strength of the received signal, but also can help…

Signal Processing · Electrical Eng. & Systems 2020-08-14 Xueyuan Wang , M. Cenk Gursoy

We present a novel definition of the reinforcement learning state, actions and reward function that allows a deep Q-network (DQN) to learn to control an optimization hyperparameter. Using Q-learning with experience replay, we train two DQNs…

Optimization and Control · Mathematics 2016-06-21 Samantha Hansen

In this paper, we study an optimal online resource reservation problem in a simple communication network. The network is composed of two compute nodes linked by a local communication link. The system operates in discrete time; at each time…

Optimization and Control · Mathematics 2024-04-04 Ahmed Sid-Ali , Ioannis Lambadaris , Yiqiang Q. Zhao , Gennady Shaikhet , Shima Kheradmand

Autonomous deployment of unmanned aerial vehicles (UAVs) supporting next-generation communication networks requires efficient trajectory planning methods. We propose a new end-to-end reinforcement learning (RL) approach to UAV-enabled data…

Machine Learning · Computer Science 2021-01-28 Harald Bayerlein , Mirco Theile , Marco Caccamo , David Gesbert

Recently, deep convolutional neural networks (CNNs) have achieved many eye-catching results. However, deploying CNNs on resource-constrained edge devices is constrained by limited memory bandwidth for transmitting large intermediated data…

Image and Video Processing · Electrical Eng. & Systems 2022-07-20 Yu-Shan Tai , Cheng-Yang Chang , Chieh-Fang Teng , AnYeu , Wu

Optimizing network throughput in real-world dynamic systems is critical, especially for diverse and delay-sensitive multimedia data types such as VoIP and video streaming. Traditional routing protocols, which rely on static metrics and…

Networking and Internet Architecture · Computer Science 2025-05-22 Md. Arquam , Suchi Kumari

Stochastic network optimization problems entail finding resource allocation policies that are optimum on an average but must be designed in an online fashion. Such problems are ubiquitous in communication networks, where resources such as…

Optimization and Control · Mathematics 2018-05-09 Amrit S. Bedi , Ketan Rajawat

Unmanned aerial vehicles (UAVs) are the emerging vital components of millimeter wave (mmWave) wireless systems. Accurate beam alignment is essential for efficient beam-based mmWave communications of UAVs with base stations (BSs).…

Signal Processing · Electrical Eng. & Systems 2021-10-14 Susarla Praneeth , Gouda Bikshapathi , Deng Yansha , Juntti Markku , Silven Olli , Tolli Antti

Federated learning allows mobile devices, i.e., workers, to use their local data to collaboratively train a global model required by the model owner. Federated learning thus addresses the privacy issues of traditional machine learning.…

Networking and Internet Architecture · Computer Science 2019-10-22 Huy T. Nguyen , Nguyen Cong Luong , Jun Zhao , Chau Yuen , Dusit Niyato