English
Related papers

Related papers: Reinforcement Learning for Adaptive Caching with D…

200 papers

This paper proposes a novel computationally efficient algorithm for optimal sizing of Battery Energy Storage Systems (BESS) considering renewable energy bidding strategies. Unlike existing two-stage methods, our algorithm enables the…

Systems and Control · Electrical Eng. & Systems 2026-02-24 Taiyo Mantani , Hikaru Hoshino , Tomonari Kanazawa , Eiko Furutani

Caching networks are designed to reduce traffic load at backhaul links, by serving demands from edge-nodes. In the past decades, many studies have been done to address the caching problem. However, in practice, finding an optimal caching…

Networking and Internet Architecture · Computer Science 2018-07-03 Elahe Rezaei , Hafez Eslami Manoochehri , Babak Hossein Khalaj

Unlike traditional recommendation tasks, finite user time budgets introduce a critical resource constraint, requiring the recommender system to balance item relevance and evaluation cost. For example, in a mobile shopping interface, users…

Machine Learning · Computer Science 2026-04-15 Sayak Chakrabarty , Souradip Pal

We design a self-exploratory reinforcement learning (RL) framework, based on the Q-learning algorithm, that enables the base station (BS) to choose a suitable modulation and coding scheme (MCS) that maximizes the spectral efficiency while…

Networking and Internet Architecture · Computer Science 2019-12-10 Mateus P. Mota , Daniel C. Araujo , Francisco Hugo Costa Neto , Andre L. F. de Almeida , F. Rodrigo P. Cavalcanti

This paper shows how reinforcement learning can be used to derive optimal hedging strategies for derivatives when there are transaction costs. The paper illustrates the approach by showing the difference between using delta hedging and…

Computational Finance · Quantitative Finance 2021-03-31 Jay Cao , Jacky Chen , John Hull , Zissis Poulos

Reinforcement learning has been explored for many problems, from video games with deterministic environments to portfolio and operations management in which scenarios are stochastic; however, there have been few attempts to test these…

General Finance · Quantitative Finance 2024-02-19 Sherly Alfonso-Sánchez , Jesús Solano , Alejandro Correa-Bahnsen , Kristina P. Sendova , Cristián Bravo

With the growing needs of online A/B testing to support the innovation in industry, the opportunity cost of running an experiment becomes non-negligible. Therefore, there is an increasing demand for an efficient continuous monitoring…

Machine Learning · Computer Science 2023-04-04 Runzhe Wan , Yu Liu , James McQueen , Doug Hains , Rui Song

Provided with mobile edge computing (MEC) services, wireless devices (WDs) no longer have to experience long latency in running their desired programs locally, but can pay to offload computation tasks to the edge server. Given its limited…

Networking and Internet Architecture · Computer Science 2020-11-05 Jia Yan , Suzhi Bi , Lingjie Duan , Ying-Jun Angela Zhang

This paper proposes a safe reinforcement learning algorithm for generation bidding decisions and unit maintenance scheduling in a competitive electricity market environment. In this problem, each unit aims to find a bidding strategy that…

Systems and Control · Electrical Eng. & Systems 2021-12-21 Pegah Rokhforoz , Olga Fink

We consider content-level selective offloading of cellular downlink traffic to a wireless infostation terminal which stores high data-rate content in its cache memory. Cellular users in the vicinity of the infostation can directly download…

Information Theory · Computer Science 2014-07-24 Pol Blasco , Deniz Gündüz

The advent of reusable rockets has heralded a new era in space exploration, reducing the costs of launching satellites by a significant factor. Traditional rockets were disposable, but the design of reusable rockets for repeated use has…

Artificial Intelligence · Computer Science 2023-10-11 Gyu Seon Kim , JaeHyun Chung , Soohyun Park

The majority of online continual learning (CL) advocates single-epoch training and imposes restrictions on the size of replay memory. However, single-epoch training would incur a different amount of computations per CL algorithm, and the…

Machine Learning · Computer Science 2025-03-18 Minhyuk Seo , Hyunseo Koh , Jonghyun Choi

Caching is frequently used by Internet Service Providers as a viable technique to reduce the latency perceived by end users, while jointly offloading network traffic. While the cache hit-ratio is generally considered in the literature as…

Networking and Internet Architecture · Computer Science 2014-08-27 Andrea Araldo , Michele Mangili , Fabio Martignon , Dario Rossi

Caching popular contents at mobile devices, assisted by device-to-device (D2D) communications, is considered as a promising technique for mobile content delivery. It can effectively reduce backhaul traffic and service cost, as well as…

Information Theory · Computer Science 2017-05-10 Rui Wang , Jun Zhang , K. B. Letaief

To enhance the quality and speed of data processing and protect the privacy and security of the data, edge computing has been extensively applied to support data-intensive intelligent processing services at edge. Among these data-intensive…

Networking and Internet Architecture · Computer Science 2020-10-30 Yana Qin , Danye Wu , Zhiwei Xu , Jie Tian , Yujun Zhang

Query optimization is a crucial component for the efficacy of Retrieval-Augmented Generation (RAG) systems. While reinforcement learning (RL)-based agentic and reasoning methods have recently emerged as a promising direction on query…

Artificial Intelligence · Computer Science 2026-01-30 Wei Wen , Sihang Deng , Tianjun Wei , Keyu Chen , Ruizhi Qiao , Xing Sun

One of the major challenges in training deep architectures for predictive tasks is the scarcity and cost of labeled training data. Active Learning (AL) is one way of addressing this challenge. In stream-based AL, observations are…

Machine Learning · Computer Science 2019-09-05 Andreas Kvistad , Massimiliano Ruocco , Eliezer de Souza da Silva , Erlend Aune

The growing renewable energy sources have posed significant challenges to traditional power scheduling. It is difficult for operators to obtain accurate day-ahead forecasts of renewable generation, thereby requiring the future scheduling…

Artificial Intelligence · Computer Science 2023-03-14 Shaohuai Liu , Jinbo Liu , Weirui Ye , Nan Yang , Guanglun Zhang , Haiwang Zhong , Chongqing Kang , Qirong Jiang , Xuri Song , Fangchun Di , Yang Gao

Flexible demand response (DR) resources can be leveraged to accommodate the stochasticity of some distributed energy resources. This paper develops an online learning approach that continuously estimates price sensitivities of residential…

Systems and Control · Computer Science 2020-04-28 Robert Mieth , Yury Dvorkin

Large language models (LLMs) typically approach combinatorial optimization as an inference-time procedure, solving each instance separately through sampling, search, or repeated prompting. We ask whether reinforcement learning can instead…

Machine Learning · Computer Science 2026-05-19 Soheyl Massoudi , Gabriel Apaza , Milad Habibi , Mark Fuge