English
Related papers

Related papers: Advancing RAN Slicing with Offline Reinforcement L…

200 papers

The diverse requirements of beyond 5G services increase design complexity and demand dynamic adjustments to the network parameters. This can be achieved with slicing and programmable network architectures such as the open radio access…

Signal Processing · Electrical Eng. & Systems 2023-11-06 Suvidha Mhatre , Ferran Adelantado , Kostas Ramantas , Christos Verikoukis

Network slicing enables the operator to configure virtual network instances for diverse services with specific requirements. To achieve the slice-aware radio resource scheduling, dynamic slicing resource partitioning is needed to…

Networking and Internet Architecture · Computer Science 2022-02-28 Tianlun Hu , Qi Liao , Qiang Liu , Dan Wellington , Georg Carle

Offline reinforcement learning (RL) refers to the problem of learning policies from a static dataset of environment interactions. Offline RL enables extensive use and re-use of historical datasets, while also alleviating safety concerns…

Machine Learning · Computer Science 2020-12-22 Rafael Rafailov , Tianhe Yu , Aravind Rajeswaran , Chelsea Finn

Remote state estimation, where sensors send their measurements of distributed dynamic plants to a remote estimator over shared wireless resources, is essential for mission-critical applications of Industry 4.0. Existing algorithms on…

Systems and Control · Electrical Eng. & Systems 2022-05-26 Gaoyang Pang , Wanchun Liu , Yonghui Li , Branka Vucetic

Cost-effective asset management is an area of interest across several industries. Specifically, this paper develops a deep reinforcement learning (DRL) solution to automatically determine an optimal rehabilitation policy for continuously…

Machine Learning · Computer Science 2023-04-19 Zaharah A. Bukhsh , Nils Jansen , Hajo Molegraaf

Applying reinforcement learning (RL) to real-world problems is often made challenging by the inability to interact with the environment and the difficulty of designing reward functions. Offline RL addresses the first challenge by…

Machine Learning · Computer Science 2025-03-03 Alizée Pace , Bernhard Schölkopf , Gunnar Rätsch , Giorgia Ramponi

The performance of a reinforcement learning (RL) system depends on the computational architecture used to approximate a value function. Deep learning methods provide both optimization techniques and architectures for approximating nonlinear…

Machine Learning · Computer Science 2021-06-21 John D. Martin , Joseph Modayil

Deep Reinforcement Learning (DRL) has been a promising solution to many complex decision-making problems. Nevertheless, the notorious weakness in generalization among environments prevent widespread application of DRL agents in real-world…

Machine Learning · Computer Science 2022-05-31 Tong Sang , Hongyao Tang , Yi Ma , Jianye Hao , Yan Zheng , Zhaopeng Meng , Boyan Li , Zhen Wang

We present Q-chunking, a simple yet effective recipe for improving reinforcement learning (RL) algorithms for long-horizon, sparse-reward tasks. Our recipe is designed for the offline-to-online RL setting, where the goal is to leverage an…

Machine Learning · Computer Science 2026-05-12 Qiyang Li , Zhiyuan Zhou , Sergey Levine

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

Machine Learning · Computer Science 2021-06-03 Sindhu Padakandla

Robust reinforcement learning (RL) aims to learn policies that remain effective despite uncertainties in its environment, which frequently arise in real-world applications due to variations in environment dynamics. The robust RL methods…

Machine Learning · Computer Science 2025-05-30 Linh Le Pham Van , Minh Hoang Nguyen , Hung Le , Hung The Tran , Sunil Gupta

Deep reinforcement learning algorithms have succeeded in several challenging domains. Classic Online RL job schedulers can learn efficient scheduling strategies but often takes thousands of timesteps to explore the environment and adapt…

Machine Learning · Computer Science 2022-12-05 Vanamala Venkataswamy , Jake Grigsby , Andrew Grimshaw , Yanjun Qi

The integration of Generative AI models into AI-native network systems offers a transformative path toward achieving autonomous and adaptive control. However, the application of such models to continuous control tasks is impeded by…

Artificial Intelligence · Computer Science 2026-03-12 Yuanhao Li , Haozhe Wang , Geyong Min , Nektarios Georgalas , Wang Miao

Modern RAN operate in highly dynamic and heterogeneous environments, where hand-tuned, rule-based RRM algorithms often underperform. While RL can surpass such heuristics in constrained settings, the diversity of deployments and…

Machine Learning · Computer Science 2026-01-29 Burak Demirel , Yu Wang , Cristian Tatino , Pablo Soldati

Two central paradigms have emerged in the reinforcement learning (RL) community: online RL and offline RL. In the online RL setting, the agent has no prior knowledge of the environment, and must interact with it in order to find an…

Machine Learning · Computer Science 2023-07-21 Andrew Wagenmaker , Aldo Pacchiano

Offline reinforcement learning (RL) algorithms can acquire effective policies by utilizing previously collected experience, without any online interaction. It is widely understood that offline RL is able to extract good policies even from…

Machine Learning · Computer Science 2022-04-13 Aviral Kumar , Joey Hong , Anikait Singh , Sergey Levine

Reinforcement Learning (RL) has achieved state-of-the-art results in domains such as robotics and games. We build on this previous work by applying RL algorithms to a selection of canonical online stochastic optimization problems with a…

Offline reinforcement learning (RL) presents distinct challenges as it relies solely on observational data. A central concern in this context is ensuring the safety of the learned policy by quantifying uncertainties associated with various…

Machine Learning · Computer Science 2025-07-03 Xiaocong Chen , Siyu Wang , Tong Yu , Lina Yao

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

Machine Learning · Computer Science 2021-02-12 Mengjiao Yang , Ofir Nachum

Recent advances in deep learning have shown significant potential for solving combinatorial optimization problems in real-time. Unlike traditional methods, deep learning can generate high-quality solutions efficiently, which is crucial for…

Machine Learning · Computer Science 2025-04-08 Imanol Echeverria , Maialen Murua , Roberto Santana