English
Related papers

Related papers: A Deep Reinforcement Learning Approach for Dynamic…

200 papers

In a typical Internet of Things (IoT) application where a central controller collects status updates from multiple terminals, e.g., sensors and monitors, through a wireless multiaccess uplink, an important problem is how to attain timely…

Information Theory · Computer Science 2018-01-15 Zhiyuan Jiang , Bhaskar Krishnamachari , Xi Zheng , Sheng Zhou , Zhisheng Niu

We investigate the problem of supporting Industrial Internet of Things user equipment (IIoT UEs) with intent (i.e., requested quality of service (QoS)) and random traffic arrival. A deep reinforcement learning (DRL) based centralized…

Information Theory · Computer Science 2025-01-07 Salwa Mostafa , Mateus P. Mota , Alvaro Valcarce , Mehdi Bennis

Next-gen networks require significant evolution of management to enable automation and adaptively adjust network configuration based on traffic dynamics. The advent of software-defined networking (SDN) and programmable switches enables…

Networking and Internet Architecture · Computer Science 2024-02-08 Akshita Abrol , Purnima Murali Mohan , Tram Truong-Huu

Dynamic adaptive streaming over HTTP (DASH) has been widely used in video streaming recently. In DASH, the client downloads video chunks in order from a server. The rate adaptation function at the video client enhances the user's…

Networking and Internet Architecture · Computer Science 2023-08-24 Nghia T. Nguyen , Long Luu , Phuong L. Vo , Thi Thanh Sang Nguyen , Cuong T. Do , Ngoc-thanh Nguyen

Internet of Things (IoT) is considered as the enabling platform for a variety of promising applications, such as smart transportation and smart city, where massive devices are interconnected for data collection and processing. These IoT…

Networking and Internet Architecture · Computer Science 2021-03-22 Laha Ale , Ning Zhang , Xiaojie Fang , Xianfu Chen , Shaohua Wu , Longzhuang Li

In this paper, we investigate the scheduling issue of diesel generators (DGs) in an Internet of Things (IoT)-Driven isolated microgrid (MG) by deep reinforcement learning (DRL). The renewable energy is fully exploited under the uncertainty…

Machine Learning · Computer Science 2023-07-07 Jiaju Qi , Lei Lei , Kan Zheng , Simon X. Yang , Xuemin , Shen

We consider distributed caching of content across several small base stations (SBSs) in a wireless network, where the content is encoded using a maximum distance separable code. Specifically, we apply soft time-to-live (STTL) cache…

Information Theory · Computer Science 2021-04-15 Jesper Pedersen , Alexandre Graell i Amat , Fredrik Brännström , Eirik Rosnes

In this letter, we investigate the problem of joint content caching and routing in satellite-terrestrial edge computing networks (STECNs) to improve caching service for geographically distributed users. To handle the challenges arising from…

Networking and Internet Architecture · Computer Science 2025-08-25 Yuhao Zheng , Ting You , Kejia Peng , Chang Liu

To overcome the curse of dimensionality and curse of modeling in Dynamic Programming (DP) methods for solving classical Markov Decision Process (MDP) problems, Reinforcement Learning (RL) algorithms are popular. In this paper, we consider…

Machine Learning · Computer Science 2018-11-29 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

The combination of energy harvesting (EH), cognitive radio (CR), and non-orthogonal multiple access (NOMA) is a promising solution to improve energy efficiency and spectral efficiency of the upcoming beyond fifth generation network (B5G),…

Information Theory · Computer Science 2021-09-21 Zhaoyuan Shi , Xianzhong Xie , Huabing Lu , Helin Yang , Jun Cai , Zhiguo Ding

In the evolving landscape of the Internet of Things (IoT), integrating cognitive radio (CR) has become a practical solution to address the challenge of spectrum scarcity, leading to the development of cognitive IoT (CIoT). However, the…

Signal Processing · Electrical Eng. & Systems 2025-12-18 Nadia Abdolkhani , Nada Abdel Khalek , Walaa Hamouda

Many systems necessitate frequent and consistent updates of a specific information. Often this information is updated regularly, where an old packet becomes completely obsolete in the presence of a new packet. In this context, we consider a…

Information Theory · Computer Science 2023-10-04 Shiksha Singhal , Veeraruna Kavitha , Vidya Shankar

A large body of applications that involve monitoring, decision making, and forecasting require timely status updates for their efficient operation. Age of Information (AoI) is a newly proposed metric that effectively captures this…

Information Theory · Computer Science 2018-10-09 George Stamatakis , Nikolaos Pappas , Apostolos Traganitis

In the coded caching, the server uses the cached information at the users to serve multiple users in parallel with a single coded multi-casting message or packet, that is, a merged packet, and thus mitigates the peak network congestion. In…

Information Theory · Computer Science 2026-05-26 Amirhossein Yousefiramandi

In 5G and beyond communication systems, the notion of latency gets great momentum in wireless connectivity as a metric for serving real-time communications requirements. However, in many applications, research has pointed out that latency…

Networking and Internet Architecture · Computer Science 2023-05-16 Emmanouil Fountoulakis , Themistoklis Charalambous , Anthony Ephremides , Nikolaos Pappas

The feasibility of deep neural networks (DNNs) to address data stream problems still requires intensive study because of the static and offline nature of conventional deep learning approaches. A deep continual learning algorithm, namely…

Machine Learning · Computer Science 2020-01-10 Andri Ashfahani , Mahardhika Pratama

Several real-time delay-sensitive applications pose varying degrees of freshness demands on the requested content. The performance of cache replacement policies that are agnostic to these demands is likely to be sub-optimal. Motivated by…

Networking and Internet Architecture · Computer Science 2018-01-01 Pawan Poojary , Sharayu Moharir , Krishna Jagannathan

Meeting the strict Quality of Service (QoS) requirements of terminals has imposed a signiffcant challenge on Multiaccess Edge Computing (MEC) systems, due to the limited multidimensional resources. To address this challenge, we propose a…

Networking and Internet Architecture · Computer Science 2024-04-29 Qianqian Liu , Haixia Zhang , Xin Zhang , Dongfeng Yuan

With the tremendous growth of data traffic over wired and wireless networks along with the increasing number of rich-media applications, caching is envisioned to play a critical role in next-generation networks. To intelligently prefetch…

Information Theory · Computer Science 2020-05-20 Alireza Sadeghi , Georgios B. Giannakis , Gang Wang , Fatemeh Sheikholeslami

We consider a multi-source hybrid automatic repeat request (HARQ) based system, where a transmitter sends status update packets of random arrival (i.e., uncontrollable sampling) and generate-atwill (i.e., controllable sampling) sources to a…

Systems and Control · Electrical Eng. & Systems 2022-07-20 Saeid Sadeghi Vilni , Mohammad Moltafet , Markus Leinonen , Marian Codreanu