English
Related papers

Related papers: A Reinforcement Learning Approach to Age of Inform…

200 papers

Age of information (AoI) is a recently proposed metric that measures the time elapsed since the generation of the last received information update. We consider the problem of AoI minimization for a network under general interference…

Networking and Internet Architecture · Computer Science 2018-05-18 Rajat Talak , Igor Kadota , Sertac Karaman , Eytan Modiano

Offline reinforcement learning (RL) aims to find optimal policies in dynamic environments in order to maximize the expected total rewards by leveraging pre-collected data. Learning from heterogeneous data is one of the fundamental…

Machine Learning · Statistics 2026-03-10 Rui Miao , Babak Shahbaba , Annie Qu

In cellular networks, resource allocation is performed in a centralized way, which brings huge computation complexity to the base station (BS) and high transmission overhead. This paper investigates the distributed resource allocation…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Zelin Ji , Zhijin Qin

This study presents a novel computer system performance optimization and adaptive workload management scheduling algorithm based on Q-learning. In modern computing environments, characterized by increasing data volumes, task complexity, and…

Machine Learning · Computer Science 2024-11-11 Pochun Li , Yuyang Xiao , Jinghua Yan , Xuan Li , Xiaoye Wang

This paper introduces a novel approach to radio resource allocation in multi-cell wireless networks using a fully scalable multi-agent reinforcement learning (MARL) framework. A distributed method is developed where agents control…

Multiagent Systems · Computer Science 2024-09-19 Yiming Zhang , Dongning Guo

We consider a source monitoring a stochastic process with a transmitter to transmit timely information through a wireless ON/OFF channel to a destination. We assume that once the source samples the data, the sampled data has to be processed…

Information Theory · Computer Science 2023-06-27 Jayanth S , Nikolaos Pappas , Rajshekhar V Bhat

Traditional concept of cognitive radio is the coexistence of primary and secondary user in multiplexed manner. we consider the opportunistic channel access scheme in IEEE 802.11 based networks subject to the interference mitigation…

Networking and Internet Architecture · Computer Science 2015-10-19 Rukhsana Ruby , Victor C. M. Leung , John Sydor

In this paper, we investigate centralized scheduling strategies for cooperative incremental redundancy retransmissions in the slow-fading half-duplex multiple access multiple relay channel. Time Division Multiple Access is assumed for the…

Signal Processing · Electrical Eng. & Systems 2018-08-30 Stefan Cerović , Raphaël Visoz , Louis Madier , Antoine O. Berthet

Age of information (AoI) measures information freshness at the receiver. AoI may provide insights into quality of service in communication systems. For this reason, it has been used as a cross-layer metric for wireless communication…

Systems and Control · Electrical Eng. & Systems 2020-05-06 Onur Ayan , H. Murat Gürsu , Sandra Hirche , Wolfgang Kellerer

With the rapid advance of information technology, network systems have become increasingly complex and hence the underlying system dynamics are often unknown or difficult to characterize. Finding a good network control policy is of…

Performance · Computer Science 2022-04-08 Bai Liu , Qiaomin Xie , Eytan Modiano

In typical wireless cellular systems, the handover mechanism involves reassigning an ongoing session handled by one cell into another. In order to support increased capacity requirement and to enable newer use cases, the next generation…

Information Theory · Computer Science 2020-10-20 Vijaya Yajnanarayana , Henrik Rydén , László Hévizi

The innovative services empowered by the Internet of Things (IoT) require a seamless and reliable wireless infrastructure that enables communications within heterogeneous and dynamic low-power and lossy networks (LLNs). The Routing Protocol…

Networking and Internet Architecture · Computer Science 2021-05-21 Hossam Farag , Cedomir Stefanovic

Vertical Cavity Surface Emitting Lasers (VCSELs) have demonstrated suitability for data transmission in indoor optical wireless communication (OWC) systems due to the high modulation bandwidth and low manufacturing cost of these sources.…

Signal Processing · Electrical Eng. & Systems 2021-06-23 Abdelrahman S. Elgamal , Osama Z. Alsulami , Ahmad Adnan Qidan , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

Artificial Intelligence · Computer Science 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

Online reinforcement learning (RL) enhances policies through direct interactions with the environment, but faces challenges related to sample efficiency. In contrast, offline RL leverages extensive pre-collected data to learn policies, but…

Machine Learning · Computer Science 2026-03-10 Xuefeng Liu , Hung T. C. Le , Siyu Chen , Rick Stevens , Zhuoran Yang , Matthew R. Walter , Yuxin Chen

Motivated by cooperative distributed networks in which users dynamically alternate between transmit and receive modes under half-duplex constraints, this paper studies the Age of Information (AoI) in a distributed multi-user network using…

Information Theory · Computer Science 2026-04-16 Peng Zou , Ali Maatouk , Egemen Erbayat , Suresh Subramaniam

We consider a slotted-time system with a transmitter-receiver pair. In the system, a transmitter observes a dynamic source and sends updates to a remote receiver through a communication channel. We assume that the channel is error-free but…

Information Theory · Computer Science 2023-01-19 Yutao Chen , Anthony Ephremides

Considering grant-free transmissions in low-power IoT networks with unknown time-frequency distribution of interference, we address the problem of Dynamic Resource Configuration (DRC), which amounts to a Markov decision process.…

Information Theory · Computer Science 2021-06-08 Yang Huang , Caiyong Hao , Yijie Mao , Fuhui Zhou

In this paper, we study the problem of dynamic channel allocation for URLLC traffic in a multi-user multi-channel wireless network where urgent packets have to be successfully transmitted in a timely manner. We formulate the problem as a…

Networking and Internet Architecture · Computer Science 2018-11-08 Nesrine Ben-Khalifa , Mohamad Assaad , Mérouane Debbah

The complex transmission mechanism of cross-packet hybrid automatic repeat request (XP-HARQ) hinders its optimal system design. To overcome this difficulty, this letter attempts to use the deep reinforcement learning (DRL) to solve the rate…

Information Theory · Computer Science 2023-08-07 Da Wu , Jiahui Feng , Zheng Shi , Hongjiang Lei , Guanghua Yang , Shaodan Ma