English
Related papers

Related papers: Learning Automata Based Q-learning for Content Pla…

200 papers

We introduce the lookahead-bounded Q-learning (LBQL) algorithm, a new, provably convergent variant of Q-learning that seeks to improve the performance of standard Q-learning in stochastic environments through the use of ``lookahead'' upper…

Machine Learning · Computer Science 2020-06-30 Ibrahim El Shar , Daniel R. Jiang

This article investigates the cache-enabling unmanned aerial vehicle (UAV) cellular networks with massive access capability supported by non-orthogonal multiple access (NOMA). The delivery of a large volume of multimedia contents for ground…

Signal Processing · Electrical Eng. & Systems 2020-08-13 Tiankui Zhang , Ziduan Wang , Yuanwei Liu , Wenjun Xu , Arumugam Nallanathan

Lane-changing decisions, which are crucial for autonomous vehicle path planning, face practical challenges due to rule-based constraints and limited data. Deep reinforcement learning has become a major research focus due to its advantages…

Artificial Intelligence · Computer Science 2025-10-27 Xiaojun Bi , Mingjie He , Yiwen Sun

In this paper, we propose a deep state-action-reward-state-action (SARSA) $\lambda$ learning approach for optimising the uplink resource allocation in non-orthogonal multiple access (NOMA) aided ultra-reliable low-latency communication…

Information Theory · Computer Science 2022-01-19 Waleed Ahsan , Wenqiang Yi , Yuanwei Liu , Arumugam Nallanathan

This letter proposes two novel proactive cooperative caching approaches using deep learning (DL) to predict users' content demand in a mobile edge caching network. In the first approach, a (central) content server takes responsibilities to…

Networking and Internet Architecture · Computer Science 2018-12-14 Yuris Mulya Saputra , Dinh Thai Hoang , Diep N. Nguyen , Eryk Dutkiewicz , Dusit Niyato , Dong In Kim

This study presents a semi-nonparametric Latent Class Choice Model (LCCM) with a flexible class membership component. The proposed model formulates the latent classes using mixture models as an alternative approach to the traditional random…

This paper investigates learning-based caching in small-cell networks (SCNs) when user preference is unknown. The goal is to optimize the cache placement in each small base station (SBS) for minimizing the system long-term transmission…

Networking and Internet Architecture · Computer Science 2020-01-15 Xianzhe Xu , Meixia Tao , Cong Shen

Score-based and flow-based generative models exhibit remarkable expressive capacity in capturing complex distributions, and have been extensively deployed in tasks ranging from image generation to reinforcement learning. Nevertheless, these…

Machine Learning · Computer Science 2026-05-29 Yiyan , Liang , Sifei Liu , Weitong Zhang

Cooperative edge caching in overlapping zones couples Base Station (BS) decisions, making content replacement sensitive to spatial topology and temporal reuse. Conventional heuristics suffer from myopia, while Deep Reinforcement Learning…

Networking and Internet Architecture · Computer Science 2026-04-03 Ning Yang , Wentao Wang , Lingtao Ouyang , Haijun Zhang

Fully decentralized learning, where the global information, i.e., the actions of other agents, is inaccessible, is a fundamental challenge in cooperative multi-agent reinforcement learning. However, the convergence and optimality of most…

Machine Learning · Computer Science 2023-02-03 Jiechuan Jiang , Zongqing Lu

Recent progress in Learning by Reading and Machine Reading systems has significantly increased the capacity of knowledge-based systems to learn new facts. In this work, we discuss the problem of selecting a set of learning requests for…

Artificial Intelligence · Computer Science 2025-02-18 Abhishek Sharma

Effective coordination of agents actions in partially-observable domains is a major challenge of multi-agent systems research. To address this, many researchers have developed techniques that allow the agents to make decisions based on…

Multiagent Systems · Computer Science 2011-09-28 P. S. Dutta , N. R. Jennings , L. Moreau

This paper presents a proof-of concept study for demonstrating the viability of building collaboration among multiple agents through standard Q learning algorithm embedded in particle swarm optimisation. Collaboration is formulated to be…

Artificial Intelligence · Computer Science 2018-04-06 Mehmet Emin Aydin , Ryan Fellows

Stream media content caching is a key enabling technology to promote the value chain of future urban vehicular networks. Nevertheless, the high mobility of vehicles, intermittency of information transmissions, high dynamics of user…

Information Theory · Computer Science 2023-05-15 Biqian Feng , Chenyuan Feng , Daquan Feng , Yongpeng Wu , Xiang-Gen Xia

Low latency communication is one of the fundamental requirements for 5G wireless networks and beyond. In this paper, a novel approach for joint caching, user scheduling and resource allocation is proposed for minimizing the queuing latency…

Networking and Internet Architecture · Computer Science 2023-09-22 Tamoor-ul-Hassan Syed , Samarakoon Sumudu , Bennis Mehdi , Matti Latva-aho

Joint caching and transmission optimization problem is challenging due to the deep coupling between decisions. This paper proposes an iterative distributed multi-agent learning approach to jointly optimize caching and transmission. The goal…

Multiagent Systems · Computer Science 2022-09-12 Qirui Mi , Ning Yang , Haifeng Zhang , Haijun Zhang , Jun Wang

Finding the optimal signal timing strategy is a difficult task for the problem of large-scale traffic signal control (TSC). Multi-Agent Reinforcement Learning (MARL) is a promising method to solve this problem. However, there is still room…

Machine Learning · Computer Science 2021-09-14 Xiaoqiang Wang , Liangjun Ke , Zhimin Qiao , Xinghua Chai

Edge caching is a promising solution for next-generation networks by empowering caching units in small-cell base stations (SBSs), which allows user equipments (UEs) to fetch users' requested contents that have been pre-cached in SBSs. It is…

Machine Learning · Computer Science 2024-06-06 Qiong Wu , Wenhua Wang , Pingyi Fan , Qiang Fan , Huiling Zhu , Khaled B. Letaief

As an efficient distributed machine learning approach, Federated learning (FL) can obtain a shared model by iterative local model training at the user side and global model aggregating at the central server side, thereby protecting privacy…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-19 Kecheng Fan , Wen Chen , Jun Li , Xiumei Deng , Xuefeng Han , Ming Ding

The design of effective online caching policies is an increasingly important problem for content distribution networks, online social networks and edge computing services, among other areas. This paper proposes a new algorithmic toolbox for…

Networking and Internet Architecture · Computer Science 2022-09-28 Naram Mhaisen , George Iosifidis , Douglas Leith