English
Related papers

Related papers: Accelerated Structure-Aware Reinforcement Learning…

200 papers

Wireless sensor networks consist of randomly distributed sensor nodes for monitoring targets or areas of interest. Maintaining the network for continuous surveillance is a challenge due to the limited battery capacity in each sensor.…

Machine Learning · Computer Science 2023-10-03 Ngoc Bui , Phi Le Nguyen , Viet Anh Nguyen , Phan Thuan Do

This paper proposes a multi-agent reinforcement learning based medium access framework for wireless networks. The access problem is formulated as a Markov Decision Process (MDP), and solved using reinforcement learning with every network…

Machine Learning · Computer Science 2021-04-30 Hrishikesh Dutta , Subir Biswas

Next-generation networks aim to provide performance guarantees to real-time interactive services that require timely and cost-efficient packet delivery. In this context, the goal is to reliably deliver packets with strict deadlines imposed…

Networking and Internet Architecture · Computer Science 2026-03-05 Ozan Aygün , Vincenzo Norman Vitale , Antonia M. Tulino , Hao Feng , Elza Erkip , Jaime Llorca

In this paper, we consider delay-optimal power control for an energy harvesting wireless system with finite energy storage. The wireless system is powered solely by a renewable energy source with bursty data arrivals, and is characterized…

Information Theory · Computer Science 2015-06-22 Fan Zhang , Vincent K. N. Lau

In this paper, we consider the problem of real-time transmission scheduling over time-varying channels. We first formulate the transmission scheduling problem as a Markov decision process (MDP) and systematically unravel the structural…

Machine Learning · Computer Science 2010-03-15 Fangwen Fu , Mihaela van der Schaar

Resource allocation is still a difficult issue to deal with in wireless networks. The unstable channel condition and traffic demand for Quality of Service (QoS) raise some barriers that interfere with the process. It is significant that an…

Artificial Intelligence · Computer Science 2017-09-28 Einar Cesar Santos

For an RF-powered cognitive radio network with ambient backscattering capability, while the primary channel is busy, the RF-powered secondary user (RSU) can either backscatter the primary signal to transmit its own data or harvest energy…

Networking and Internet Architecture · Computer Science 2018-08-24 Nguyen Van Huynh , Dinh Thai Hoang , Diep N. Nguyen , Eryk Dutkiewicz , Dusit Niyato , Ping Wang

As sensor networks for health monitoring become more prevalent, so will the need to control their usage and consumption of energy. This paper presents a method which leverages the algorithm's performance and energy consumption. By utilising…

Signal Processing · Electrical Eng. & Systems 2018-12-07 Michal Kozlowski , Ryan McConville , Raul Santos-Rodriguez , Robert Piechocki

The evolving landscape of the Internet of Things (IoT) has given rise to a pressing need for an efficient communication scheme. As the IoT user ecosystem continues to expand, traditional communication protocols grapple with substantial…

Signal Processing · Electrical Eng. & Systems 2024-06-25 Rafaela Scaciota , Glauber Brante , Richard Souza , Onel Lopez , Septimia Sarbu , Mehdi Bennis , Sumudu Samarakoon

The optimal scheduling of interfering links in a dense wireless network with full frequency reuse is a challenging task. The traditional method involves first estimating all the interfering channel strengths then optimizing the scheduling…

Signal Processing · Electrical Eng. & Systems 2021-02-05 Wei Cui , Kaiming Shen , Wei Yu

Media streaming is the dominant application over wireless edge (access) networks. The increasing softwarization of such networks has led to efforts at intelligent control, wherein application-specific actions may be dynamically taken to…

Systems and Control · Electrical Eng. & Systems 2024-04-18 Archana Bura , Sarat Chandra Bobbili , Shreyas Rameshkumar , Desik Rengarajan , Dileep Kalathil , Srinivas Shakkottai

In this paper, we study a real-time monitoring system in which multiple source nodes are responsible for sending update packets to a common destination node in order to maintain the freshness of information at the destination. Since it may…

Information Theory · Computer Science 2019-08-20 Mohamed A. Abd-Elmagid , Harpreet S. Dhillon , Nikolaos Pappas

We consider an underlay cognitive radio network where the secondary user (SU) harvests energy from the environment. We consider a slotted-mode of operation where each slot of SU is used for either energy harvesting or data transmission.…

Information Theory · Computer Science 2019-06-04 Kalpant Pathak , Adrish Banerjee

This study addresses the challenge of optimal power allocation in stochastic wireless networks by employing a Deep Reinforcement Learning (DRL) framework. Specifically, we design a Deep Q-Network (DQN) agent capable of learning adaptive…

Networking and Internet Architecture · Computer Science 2026-01-09 Marie Diane Iradukunda , Chabi F. Elégbédé , Yaé Ulrich Gaba

Low latency communication is one of the fundamental requirements for 5G wireless networks and beyond. In this paper, a novel approach for joint caching, user scheduling and resource allocation is proposed for minimizing the queuing latency…

Networking and Internet Architecture · Computer Science 2023-09-22 Tamoor-ul-Hassan Syed , Samarakoon Sumudu , Bennis Mehdi , Matti Latva-aho

With the advent of the Internet of Things (IoT), an increasing number of energy harvesting methods are being used to supplement or supplant battery based sensors. Energy harvesting sensors need to be configured according to the application,…

Machine Learning · Computer Science 2018-11-29 Francesco Fraternali , Bharathan Balaji , Rajesh Gupta

The problem of resource constrained scheduling in a dynamic and heterogeneous wireless setting is considered here. In our setup, the available limited bandwidth resources are allocated in order to serve randomly arriving service demands,…

Machine Learning · Computer Science 2022-04-01 Apostolos Avranas , Marios Kountouris , Philippe Ciblat

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

We consider a joint uplink and downlink scheduling problem of a fully distributed wireless networked control system (WNCS) with a limited number of frequency channels. Using elements of stochastic systems theory, we derive a sufficient…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Gaoyang Pang , Kang Huang , Daniel E. Quevedo , Branka Vucetic , Yonghui Li , Wanchun Liu

In this paper, we consider the problem of energy efficient uplink scheduling with delay constraint for a multi-user wireless system. We address this problem within the framework of constrained Markov decision processes (CMDPs) wherein one…

Networking and Internet Architecture · Computer Science 2009-08-25 Nitin Salodkar , Abhay Karandikar , V. S. Borkar