English
Related papers

Related papers: Session-Level Dynamic Ad Load Optimization using O…

200 papers

Traditional offline reinforcement learning (RL) methods predominantly operate in a batch-constrained setting. This confines the algorithms to a specific state-action distribution present in the dataset, reducing the effects of…

Machine Learning · Statistics 2025-07-16 Charles A. Hepburn , Yue Jin , Giovanni Montana

Distributionally robust offline reinforcement learning (RL) aims to find a policy that performs the best under the worst environment within an uncertainty set using an offline dataset collected from a nominal model. While recent advances in…

Machine Learning · Computer Science 2025-01-07 Ruiquan Huang , Yingbin Liang , Jing Yang

Caching is envisioned to play a critical role in next-generation content delivery infrastructure, cellular networks, and Internet architectures. By smartly storing the most popular contents at the storage-enabled network entities during…

Information Theory · Computer Science 2019-07-12 Alireza Sadeghi , Gang Wang , Georgios B. Giannakis

Deep reinforcement learning (DRL) demonstrates its promising potential in the realm of adaptive video streaming and has recently received increasing attention. However, existing DRL-based methods for adaptive video streaming use only…

Multimedia · Computer Science 2025-01-03 Lingzhi Zhao , Ying Cui , Yuhang Jia , Yunfei Zhang , Klara Nahrstedt

Offline multi-agent reinforcement learning (MARL) is increasingly recognized as crucial for effectively deploying RL algorithms in environments where real-time interaction is impractical, risky, or costly. In the offline setting, learning…

Machine Learning · Computer Science 2024-08-26 Jihwan Oh , Sungnyun Kim , Gahee Kim , Sunghwan Kim , Se-Young Yun

Quantizing neural networks to low-bitwidth is important for model deployment on resource-limited edge hardware. Although a quantized network has a smaller model size and memory footprint, it is fragile to adversarial attacks. However, few…

Machine Learning · Computer Science 2022-10-18 Chaofan Tao , Ngai Wong

In this paper, we present an agentic double deep Q-network (DDQN) scheduler for licensed/unlicensed band allocation in New Radio (NR) sidelink (SL) networks. Beyond conventional reward-seeking reinforcement learning (RL), the agent…

Systems and Control · Electrical Eng. & Systems 2025-09-30 Po-Heng Chou , Pin-Qi Fu , Walid Saad , Li-Chun Wang

We introduce Dynamic Nested Depth (DND), a novel method that improves performance for off-the-shelf LLMs by selecting critical tokens to reprocess in a nested depth manner. Specifically, at the end of the given transformer layer, DND…

Computation and Language · Computer Science 2026-01-28 Tieyuan Chen , Xiaodong Chen , Haoxing Chen , Zhenzhong Lan , Weiyao Lin , Jianguo Li

Trajectory adjustment decisions throughout the drilling process, called geosteering, affect subsequent choices and information gathering, thus resulting in a coupled sequential decision problem. Previous works on applying decision…

Machine Learning · Computer Science 2025-01-23 Ressi Bonti Muhammad , Sergey Alyaev , Reidar Brumer Bratvold

We study the budget allocation problem in online marketing campaigns that utilize previously collected offline data. We first discuss the long-term effect of optimizing marketing budget allocation decisions in the offline setting. To…

Machine Learning · Computer Science 2023-09-07 Tianchi Cai , Jiyan Jiang , Wenpeng Zhang , Shiji Zhou , Xierui Song , Li Yu , Lihong Gu , Xiaodong Zeng , Jinjie Gu , Guannan Zhang

Integrating human expertise with machine learning is crucial for applications demanding high accuracy and safety, such as autonomous driving. This study introduces Interactive Double Deep Q-network (iDDQN), a Human-in-the-Loop (HITL)…

Machine Learning · Computer Science 2026-03-10 Alkis Sygkounas , Ioannis Athanasiadis , Andreas Persson , Michael Felsberg , Amy Loutfi

Deep Reinforcement Learning (DRL) offers a powerful approach to training neural network control policies for stochastic queuing networks (SQN). However, traditional DRL methods rely on offline simulations or static datasets, limiting their…

Artificial Intelligence · Computer Science 2024-04-08 Jerrod Wigmore , Brooke Shrader , Eytan Modiano

Anomaly detection in decision-making sequences is a challenging problem due to the complexity of normality representation learning and the sequential nature of the task. Most existing methods based on Reinforcement Learning (RL) are…

Machine Learning · Computer Science 2024-02-08 Chen Wang , Sarah Erfani , Tansu Alpcan , Christopher Leckie

This paper investigates a project with stochastic activity durations and cash flows under discrete scenarios, where activities must satisfy precedence constraints generating cash inflows and outflows. The objective is to maximize expected…

Machine Learning · Computer Science 2025-11-18 Wei Xu , Fan Yang , Qinyuan Cui , Zhi Chen

Offline reinforcement learning (RL), which seeks to learn an optimal policy using offline data, has garnered significant interest due to its potential in critical applications where online data collection is infeasible or expensive. This…

Machine Learning · Computer Science 2024-02-09 Jiin Woo , Laixi Shi , Gauri Joshi , Yuejie Chi

Offline Reinforcement Learning (RL) focuses on learning policies solely from a batch of previously collected data. offering the potential to leverage such datasets effectively without the need for costly or risky active exploration. While…

Machine Learning · Computer Science 2025-06-06 Riccardo Zamboni , Enrico Brunetti , Marcello Restelli

The goal of robust reinforcement learning (RL) is to learn a policy that is robust against the uncertainty in model parameters. Parameter uncertainty commonly occurs in many real-world RL applications due to simulator modeling errors,…

Machine Learning · Computer Science 2022-10-19 Kishan Panaganti , Zaiyan Xu , Dileep Kalathil , Mohammad Ghavamzadeh

Reinforcement learning (RL) has seen great advancements in the past few years. Nevertheless, the consensus among the RL community is that currently used methods, despite all their benefits, suffer from extreme data inefficiency, especially…

Machine Learning · Computer Science 2020-04-01 Kacper Kielak

In E-commerce, advertising is essential for merchants to reach their target users. The typical objective is to maximize the advertiser's cumulative revenue over a period of time under a budget constraint. In real applications, an…

Deep Reinforcement Learning (RL) recently emerged as one of the most competitive approaches for learning in sequential decision making problems with fully observable environments, e.g., computer Go. However, very little work has been done…

Machine Learning · Computer Science 2018-05-09 Pengfei Zhu , Xin Li , Pascal Poupart , Guanghui Miao