English
Related papers

Related papers: Phoebe: Reuse-Aware Online Caching with Reinforcem…

200 papers

This paper addresses the challenge of edge caching in dynamic environments, where rising traffic loads strain backhaul links and core networks. We propose a Proximal Policy Optimization (PPO)-based caching strategy that fully incorporates…

Networking and Internet Architecture · Computer Science 2024-11-18 Farnaz Niknia , Ping Wang

Continual learning agents with finite capacity must balance acquiring new knowledge with retaining the old. This requires controlled forgetting of knowledge that is no longer needed, freeing up capacity to learn. Weight decay, viewed as a…

Machine Learning · Computer Science 2026-05-01 Aditya A. Ramesh , Alex Lewandowski , Jürgen Schmidhuber

Web phishing poses a dynamic threat, requiring detection systems to quickly adapt to the latest tactics. Traditional approaches of accumulating data and periodically retraining models are outpaced. We propose a novel paradigm combining…

Machine Learning · Computer Science 2024-10-01 Jesher Joshua M , Adhithya R , Sree Dananjay S , M Revathi

Federated Learning (FL) is a novel distributed machine learning which allows thousands of edge devices to train model locally without uploading data concentrically to the server. But since real federated settings are resource-constrained,…

Machine Learning · Computer Science 2024-04-16 Li Li , Moming Duan , Duo Liu , Yu Zhang , Ao Ren , Xianzhang Chen , Yujuan Tan , Chengliang Wang

Network embedding aims to find a way to encode network by learning an embedding vector for each node in the network. The network often has property information which is highly informative with respect to the node's position and role in the…

Social and Information Networks · Computer Science 2018-11-28 Enya Shen , Zhidong Cao , Changqing Zou , Jianmin Wang

Meta-reinforcement learning (RL) addresses the problem of sample inefficiency in deep RL by using experience obtained in past tasks for a new task to be solved. However, most meta-RL methods require partially or fully on-policy data, i.e.,…

Artificial Intelligence · Computer Science 2021-01-07 Takahisa Imagawa , Takuya Hiraoka , Yoshimasa Tsuruoka

In modern GPU inference, cache efficiency remains a major bottleneck, and heuristic policies such as \textsc{LRU} can perform far worse than the offline optimum. Existing learning-based caching systems improve hit rates mainly through…

Edge caching is a promising solution for next-generation networks by empowering caching units in small-cell base stations (SBSs), which allows user equipments (UEs) to fetch users' requested contents that have been pre-cached in SBSs. It is…

Machine Learning · Computer Science 2024-06-06 Qiong Wu , Wenhua Wang , Pingyi Fan , Qiang Fan , Huiling Zhu , Khaled B. Letaief

Humans learn adaptively and efficiently throughout their lives. However, incrementally learning tasks causes artificial neural networks to overwrite relevant information learned about older tasks, resulting in 'Catastrophic Forgetting'.…

Machine Learning · Computer Science 2021-02-04 Gobinda Saha , Isha Garg , Aayush Ankit , Kaushik Roy

Recent advances in large reasoning models have leveraged reinforcement learning with verifiable rewards (RLVR) to improve reasoning capabilities. However, scaling these methods typically requires extensive rollout computation and large…

Machine Learning · Computer Science 2025-09-03 Xinyu Tang , Zhenduo Zhang , Yurou Liu , Wayne Xin Zhao , Zujie Wen , Zhiqiang Zhang , Jun Zhou

Mobile edge computing (a.k.a. fog computing) has recently emerged to enable \emph{in-situ} processing of delay-sensitive applications at the edge of mobile networks. Providing grid power supply in support of mobile edge computing, however,…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-09-19 Jie Xu , Shaolei Ren

Federated Unlearning (FU) is emerging as a powerful tool that enables the selective removal of client data to effectively address data contamination and meet strict privacy regulations in mobile edge computing (MEC) systems. Although FU has…

Networking and Internet Architecture · Computer Science 2026-05-22 Zihao Ding , Beining Wu , Jun Huang

To enhance the quality and speed of data processing and protect the privacy and security of the data, edge computing has been extensively applied to support data-intensive intelligent processing services at edge. Among these data-intensive…

Networking and Internet Architecture · Computer Science 2020-10-30 Yana Qin , Danye Wu , Zhiwei Xu , Jie Tian , Yujun Zhang

Machine learning models deployed in real-world settings must operate under evolving data distributions and constrained computational resources. This challenge is particularly acute in non-stationary domains such as energy time series,…

Machine Learning · Computer Science 2026-03-17 Daniel Bretsko , Piotr Walas , Devashish Khulbe , Sebastian Stros , Stanislav Sobolevsky , Tomas Satura

Delivering an immersive experience to virtual reality (VR) users through wireless connectivity offers the freedom to engage from anywhere at any time. Nevertheless, it is challenging to ensure seamless wireless connectivity that delivers…

Information Theory · Computer Science 2025-01-23 Krishnendu S. Tharakan , Hayssam Dahrouj , Nour Kouzayha , Hesham ElSawy , Tareq Y. Al-Naffouri

Federated Learning (FL) allows multiple distributed devices to jointly train a shared model without centralizing data, but communication cost remains a major bottleneck, especially in resource-constrained environments. This paper introduces…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-25 Ahmad Alhonainy , Praveen Rao

Recommender models are commonly used to suggest relevant items to a user for e-commerce and online advertisement-based applications. These models use massive embedding tables to store numerical representation of items' and users'…

Information Retrieval · Computer Science 2024-03-19 Muhammad Adnan , Yassaman Ebrahimzadeh Maboud , Divya Mahajan , Prashant J. Nair

Recent approaches for learning policies to improve caching, target just one out of the prefetching, admission and eviction processes. In contrast, we propose an end to end pipeline to learn all three policies using machine learning. We also…

Operating Systems · Computer Science 2020-09-22 Ayush Mangal , Jitesh Jain , Keerat Kaur Guliani , Omkar Bhalerao

Federated learning (FL) has emerged as a solution to deal with the risk of privacy leaks in machine learning training. This approach allows a variety of mobile devices to collaboratively train a machine learning model without sharing the…

Machine Learning · Computer Science 2022-12-01 Young Geun Kim , Carole-Jean Wu

Federated Learning (FL) enables model development by leveraging data distributed across numerous edge devices without transferring local data to a central server. However, existing FL methods still face challenges when dealing with scarce…

Machine Learning · Computer Science 2024-06-24 Tong Xia , Abhirup Ghosh , Xinchi Qiu , Cecilia Mascolo