English
Related papers

Related papers: Asynchronous Fractional Multi-Agent Deep Reinforce…

200 papers

In this paper, a novel joint energy and age of information (AoI) optimization framework for IoT devices in a non-stationary environment is presented. In particular, IoT devices that are distributed in the real-world are required to…

Networking and Internet Architecture · Computer Science 2023-12-04 Zhenzhen Gong , Omar Hashash , Yingze Wang , Qimei Cui , Wei Ni , Walid Saad , Kei Sakaguchi

We consider the problem where $M$ agents interact with $M$ identical and independent environments with $S$ states and $A$ actions using reinforcement learning for $T$ rounds. The agents share their data with a central server to minimize…

Machine Learning · Computer Science 2021-02-23 Mridul Agarwal , Bhargav Ganguly , Vaneet Aggarwal

This paper studies multi-agent reinforcement learning in Markov games, with the goal of learning Nash equilibria or coarse correlated equilibria (CCE) sample-optimally. All prior results suffer from at least one of the two obstacles: the…

Machine Learning · Computer Science 2022-10-13 Gen Li , Yuejie Chi , Yuting Wei , Yuxin Chen

We present two elegant solutions for modeling continuous-time dynamics, in a novel model-based reinforcement learning (RL) framework for semi-Markov decision processes (SMDPs), using neural ordinary differential equations (ODEs). Our models…

Machine Learning · Computer Science 2020-10-27 Jianzhun Du , Joseph Futoma , Finale Doshi-Velez

This work introduces a framework for analyzing the Age of Incorrect Information (AoII) in a real-time monitoring system with a generic discrete-time Markov source. We study a noisy communication system employing a hybrid automatic repeat…

Information Theory · Computer Science 2026-03-31 Konstantinos Bountrogiannis , Anthony Ephremides , Panagiotis Tsakalides , George Tzagkarakis

In this correspondence, we investigate an intelligent reflective surface (IRS) assisted downlink ultra-reliable and low-latency communication (URLLC) system, where an access point (AP) sends short packets to multiple devices with the help…

Information Theory · Computer Science 2023-04-18 Yangyi Zhang , Xinrong Guan , Qingqing Wu , Zhi Ji , Yueming Cai

The ever-growing popularity and rapid improving of artificial intelligence (AI) have raised rethinking on the evolution of wireless networks. Mobile edge computing (MEC) provides a natural platform for AI applications since it is with rich…

Information Theory · Computer Science 2020-12-29 Shanfeng Huang , Shuai Wang , Rui Wang , Miaowen Wen , Kaibin Huang

Age of Information (AoI) is emerging as a novel metric for measuring information freshness in real-time monitoring systems. For computation-intensive status data, the information is not revealed until being processed. We consider a status…

Information Theory · Computer Science 2025-08-21 Jianhang Zhu , Jie Gong

In this paper, we aim to address the challenge of hybrid mobile edge-quantum computing (MEQC) for sustainable task offloading scheduling in mobile networks. We develop cost-effective designs for both task offloading mode selection and…

Systems and Control · Electrical Eng. & Systems 2023-06-27 Ziqiang Ye , Yulan Gao , Yue Xiao , Minrui Xu , Han Yu , Dusit Niyato

Agentic reinforcement learning (RL) has emerged as a transformative workload in cloud clusters, enabling large language models (LLMs) to solve complex problems through interactions with real world. However, unlike traditional RL, agentic RL…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-16 Bangjun Xiao , Yihao Zhao , Xiangwei Deng , Shihua Yu , Yuxing Xiang , Huaqiu Liu , Qiying Wang , Liang Zhao , Hailin Zhang , Xuanzhe Liu , Xin Jin , Fuli Luo

The design of beamforming for downlink multi-user massive multi-input multi-output (MIMO) relies on accurate downlink channel state information (CSI) at the transmitter (CSIT). In fact, it is difficult for the base station (BS) to obtain…

Signal Processing · Electrical Eng. & Systems 2023-07-20 Zhenyuan Feng , Bruno Clerckx

Reinforcement learning (RL) has emerged as a promising strategy for finetuning small language models (SLMs) to solve targeted tasks such as math and coding. However, RL algorithms tend to be resource-intensive, taking a significant amount…

Machine Learning · Computer Science 2025-10-07 Lianghuan Huang , Sagnik Anupam , Insup Lee , Shuo Li , Osbert Bastani

In recent years, unmanned aerial vehicles (UAVs) have found numerous sensing applications, which are expected to add billions of dollars to the world economy in the next decade. To further improve the Quality-of-Service (QoS) in such…

Systems and Control · Electrical Eng. & Systems 2020-03-13 Fanyi Wu , Hongliang Zhang , Jianjun Wu , Lingyang Song , Zhu Han , H. Vincent Poor

This paper studies the problem of information freshness-aware task offloading in an air-ground integrated multi-access edge computing system, which is deployed by an infrastructure provider (InP). A third-party real-time application service…

Signal Processing · Electrical Eng. & Systems 2020-07-21 Xianfu Chen , Celimuge Wu , Tao Chen , Zhi Liu , Honggang Zhang , Mehdi Bennis , Hang Liu , Yusheng Ji

Age-of-Information (AoI) is a recently proposed metric for quantifying the freshness of information from the UE's perspective in a communication network. Recently, Kadota et al. [1] have proposed an index-type approximately optimal…

Information Theory · Computer Science 2019-04-02 Arunabh Srivastava , Abhishek Sinha , Krishna Jagannathan

To overcome the curse of dimensionality and curse of modeling in Dynamic Programming (DP) methods for solving classical Markov Decision Process (MDP) problems, Reinforcement Learning (RL) algorithms are popular. In this paper, we consider…

Machine Learning · Computer Science 2018-11-29 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

Two-time-scale optimization is a framework introduced in Zeng et al. (2024) that abstracts a range of policy evaluation and policy optimization problems in reinforcement learning (RL). Akin to bi-level optimization under a particular type…

Optimization and Control · Mathematics 2026-01-21 Sihan Zeng , Thinh T. Doan

Age-of-Information (AoI) is a performance metric for scheduling systems that measures the freshness of the data available at the intended destination. AoI is formally defined as the time elapsed since the destination received the recent…

Systems and Control · Electrical Eng. & Systems 2021-01-20 Archiki Prasad , Vishal Jain , Sharayu Moharir

In real-time status update services for the Internet of Things (IoT), the timely dissemination of information requiring timely updates is crucial to maintaining its relevance. Failing to keep up with these updates results in outdated…

Networking and Internet Architecture · Computer Science 2024-10-03 Seifu Birhanu Tadele , Binayak Kar , Frezer Guteta Wakgra , Asif Uddin Khan

The sim-to-real gap, where agents trained in a simulator face significant performance degradation during testing, is a fundamental challenge in reinforcement learning. Extansive works adopt the framework of distributionally robust RL, to…

Machine Learning · Statistics 2025-11-12 Zewu Zheng , Yuanyuan Lin