English
Related papers

Related papers: Uncertainty-of-Information Scheduling: A Restless …

200 papers

This paper studies restless multi-armed bandit (RMAB) problems with unknown arm transition dynamics but with known correlated arm features. The goal is to learn a model to predict transition dynamics given features, where the Whittle index…

Machine Learning · Computer Science 2023-08-15 Kai Wang , Shresth Verma , Aditya Mate , Sanket Shah , Aparna Taneja , Neha Madhiwalla , Aparna Hegde , Milind Tambe

Restless Multi-Armed Bandits (RMABs) are powerful models for decision-making under uncertainty, yet classical formulations typically assume fixed dynamics, an assumption often violated in nonstationary environments. We introduce MARBLE…

Machine Learning · Computer Science 2026-04-13 Mohsen Amiri , Konstantin Avrachenkov , Ibtihal El Mimouni , Sindri Magnússon

This paper addresses an important class of restless multi-armed bandit (RMAB) problems that finds broad application in operations research, stochastic optimization, and reinforcement learning. There are $N$ independent Markov processes that…

Optimization and Control · Mathematics 2025-04-18 Keqin Liu

Motivated by applications such as machine repair, project monitoring, and anti-poaching patrol scheduling, we study intervention planning of stochastic processes under resource constraints. This planning problem has previously been modeled…

Artificial Intelligence · Computer Science 2026-02-26 Arpita Biswas , Jackson A. Killian , Paula Rodriguez Diaz , Susobhan Ghosh , Milind Tambe

We consider a quantum switch with a finite number of quantum memory registers that aims to serve multipartite entanglement requests among $N$ users. We propose scheduling policies that aim to optimize the average number of requests served…

Information Theory · Computer Science 2026-03-25 Subhankar Banerjee , Stavros Mitrolaris , Sennur Ulukus

Energy demands from data centers have surged and stressed the grid in recent years. Electric grids require balancing supply and demand every second, motivating demand response (reduction) from large loads, including data centers. This can…

Computational Engineering, Finance, and Science · Computer Science 2026-05-20 Yifu Ding , Zixi Chen , Thomas Magnanti

In this paper, we explore how to schedule multiple users to optimize information freshness in a pull-based wireless network, where the status updates from users are requested by randomly arriving queries at the destination. We use the age…

Information Theory · Computer Science 2024-11-13 Jingwei Liu , He Chen

We consider a large-scale cyber network with N components (e.g., paths, servers, subnets). Each component is either in a healthy state (0) or an abnormal state (1). Due to random intrusions, the state of each component transits from 0 to 1…

Systems and Control · Computer Science 2011-12-02 Keqin Liu , Qing Zhao

In this paper, we analyze the impact of data freshness on remote inference systems, where a pre-trained neural network blue infers a time-varying target (e.g., the locations of vehicles and pedestrians) based on features (e.g., video…

Networking and Internet Architecture · Computer Science 2024-06-21 Md Kamran Chowdhury Shisher , Yin Sun , I-Hong Hou

Wake-Up Radio (WUR) enables resource-constrained, battery-powered sensor nodes to remain in a low-power deep sleep state while continuously listening for a Wake-Up Signal (WUS). Sensor nodes only wake and transmit data after receiving the…

Signal Processing · Electrical Eng. & Systems 2026-05-21 Sokipriala Jonah , Seong Ki Yoo , Saurav Sthapit , Anita Khadka

In this paper, we study age of information (AoI) optimization for status updating in an integrated sensing and communication (ISAC) system. We consider a discrete-time architecture in which a base station interacts with a physical…

Information Theory · Computer Science 2026-05-26 Marco Zanni , Mohamad Assaad , Touraj Soleymani

We propose a variant of the Age of Information (AoI) metric called Channel-Aware Age of Information (CA-AoI). Unlike AoI, CA-AoI takes into account the channel conditions between the source and the intended destination to compute the "age"…

Systems and Control · Electrical Eng. & Systems 2021-01-12 Bhishma Dedhia , Sharayu Moharir

As 5G and Internet-of-Things (IoT) are deeply integrated into vertical industries such as autonomous driving and industrial robotics, timely status update is crucial for remote monitoring and control. In this regard, Age of Information…

Information Theory · Computer Science 2020-02-20 Xi Zheng , Sheng Zhou , Zhisheng Niu

In this work, a wireless broadcast network with a base station (BS) sending random time-sensitive information updates to multiple users with interference constraints is considered. The Age of Synchronization (AoS), namely the amount of time…

Information Theory · Computer Science 2020-03-06 Haoyue Tang , Jintao Wang , Zihan Tang , Jian Song

In Internet of Things (IoTs), the freshness of system status information is crucial for real-time monitoring and decision-making. This paper studies the transmission scheduling problem in wireless monitoring systems, where information…

Networking and Internet Architecture · Computer Science 2026-03-09 Yuchong Zhang , Yi Cao , Xianghui Cao

We consider a system composed of a sensor node tracking a time varying quantity. In every discretized time slot, the node attempts to send an update to a central monitoring station through one of K communication channels. We consider the…

Systems and Control · Electrical Eng. & Systems 2022-07-19 Ishank Juneja , Santosh Fatale , Sharayu Moharir

Age of information (AoI) is an effective performance metric measuring the freshness of information and is particularly suitable for applications involving status update. In this paper, using the age violation probability as the metric,…

Information Theory · Computer Science 2023-08-11 Kuan-Yu Lin , Yu-Chih Huang , Yu-Pin Hsu

In an Internet-of-Things system where status data are collected from sensors and actuators for time-critical applications, the freshness of data is vital and can be quantified by the recently proposed age-of-information (AoI) metric. In…

Information Theory · Computer Science 2018-03-23 Zhiyuan Jiang , Bhaskar Krishnamachari , Sheng Zhou , Zhisheng Niu

Consider a discrete-time system in which a centralized controller (CC) is tasked with assigning at each time interval (or slot) K resources (or servers) to K out of M>=K nodes. When assigned a server, a node can execute a task. The tasks…

Optimization and Control · Mathematics 2016-11-17 Fabio Iannello , Osvaldo Simeone , Umberto Spagnolini

With the rapid growth of real-time Internet of Things (IoT) applications, the need for fresh information has surged. Age of Information (AoI) is a tailor-made metric to characterize the information freshness perceived by the devices. In…

Information Theory · Computer Science 2019-03-12 Jingzhou Sun , Zhiyuan Jiang , Sheng Zhou , Zhisheng Niu