English
Related papers

Related papers: Offline and Distributional Reinforcement Learning …

200 papers

Offline reinforcement learning (RL) aims to learn a policy that maximizes the expected return using a given static dataset of transitions. However, offline RL faces the distribution shift problem. The policy constraint offline RL method is…

Machine Learning · Computer Science 2025-12-24 Yuanhao Chen , Qi Liu , Pengbin Chen , Zhongjian Qiao , Yanjie Li

Online reinforcement learning (RL) enhances policies through direct interactions with the environment, but faces challenges related to sample efficiency. In contrast, offline RL leverages extensive pre-collected data to learn policies, but…

Machine Learning · Computer Science 2026-03-10 Xuefeng Liu , Hung T. C. Le , Siyu Chen , Rick Stevens , Zhuoran Yang , Matthew R. Walter , Yuxin Chen

Cloud native technology has revolutionized 5G beyond and 6G communication networks, offering unprecedented levels of operational automation, flexibility, and adaptability. However, the vast array of cloud native services and applications…

Networking and Internet Architecture · Computer Science 2023-05-11 Lin Wang , Jiasheng Wu , Yue Gao , Jingjing Zhang

Offline reinforcement learning (RL) enables training from fixed data without online interaction, but policies learned offline often struggle when deployed in dynamic environments due to distributional shift and unreliable value estimates on…

Machine Learning · Computer Science 2025-11-06 Lipeng Zu , Hansong Zhou , Xiaonan Zhang

Offline reinforcement learning requires reconciling two conflicting aims: learning a policy that improves over the behavior policy that collected the dataset, while at the same time minimizing the deviation from the behavior policy so as to…

Machine Learning · Computer Science 2021-10-13 Ilya Kostrikov , Ashvin Nair , Sergey Levine

In the future 6th generation networks, ultra-reliable and low-latency communications (URLLC) will lay the foundation for emerging mission-critical applications that have stringent requirements on end-to-end delay and reliability. Existing…

Signal Processing · Electrical Eng. & Systems 2020-02-26 Changyang She , Rui Dong , Zhouyou Gu , Zhanwei Hou , Yonghui Li , Wibowo Hardjawana , Chenyang Yang , Lingyang Song , Branka Vucetic

Offline reinforcement learning (RL) is a variant of RL where the policy is learned from a previously collected dataset of trajectories and rewards. In our work, we propose a practical approach to offline RL with large language models…

Reinforcement Learning (RL) has achieved impressive results in robotics, yet high-performing pipelines remain highly task-specific, with little reuse of prior data. Offline Model-based RL (MBRL) offers greater data efficiency by training…

Robotics · Computer Science 2026-01-09 Chenhao Li , Andreas Krause , Marco Hutter

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

The goal of robust reinforcement learning (RL) is to learn a policy that is robust against the uncertainty in model parameters. Parameter uncertainty commonly occurs in many real-world RL applications due to simulator modeling errors,…

Machine Learning · Computer Science 2022-10-19 Kishan Panaganti , Zaiyan Xu , Dileep Kalathil , Mohammad Ghavamzadeh

Reinforcement learning (RL) is typically concerned with estimating stationary policies or single-step models, leveraging the Markov property to factorize problems in time. However, we can also view RL as a generic sequence modeling problem,…

Machine Learning · Computer Science 2021-11-30 Michael Janner , Qiyang Li , Sergey Levine

Distributionally robust offline reinforcement learning (RL), which seeks robust policy training against environment perturbation by modeling dynamics uncertainty, calls for function approximations when facing large state-action spaces.…

Machine Learning · Computer Science 2025-11-03 Zhishuai Liu , Pan Xu

Wireless support of virtual reality (VR) has challenges when a network has multiple users, particularly for 3D VR gaming, digital AI avatars, and remote team collaboration. This work addresses these challenges through investigation of the…

Networking and Internet Architecture · Computer Science 2025-07-28 Muhammad Ahmed Mohsin , Sagnik Bhattacharya , Abhiram Gorle , Muhammad Ali Jamshed , John M. Cioffi

Artificial intelligence (AI) and Machine Learning (ML) are considered as key enablers for realizing the full potential of fifth-generation (5G) and beyond mobile networks, particularly in the context of resource management and…

Networking and Internet Architecture · Computer Science 2023-07-06 Farhad Rezazadeh , Lanfranco Zanzi , Francesco Devoti , Sergio Barrachina-Munoz , Engin Zeydan , Xavier Costa-Pérez , Josep Mangues-Bafalluy

A promising paradigm for offline reinforcement learning (RL) is to constrain the learned policy to stay close to the dataset behaviors, known as policy constraint offline RL. However, existing works heavily rely on the purity of the data,…

Machine Learning · Computer Science 2022-10-20 Chengqian Gao , Ke Xu , Liu Liu , Deheng Ye , Peilin Zhao , Zhiqiang Xu

As wireless networks grow to support more complex applications, the Open Radio Access Network (O-RAN) architecture, with its smart RAN Intelligent Controller (RIC) modules, becomes a crucial solution for real-time network data collection,…

Networking and Internet Architecture · Computer Science 2024-10-08 Fatemeh Lotfi , Fatemeh Afghah

Precise robot manipulation is critical for fine-grained applications such as chemical and biological experiments, where even small errors (e.g., reagent spillage) can invalidate an entire task. Existing approaches often rely on…

Robotics · Computer Science 2026-02-13 Xiangyu Chen , Chuhao Zhou , Yuxi Liu , Jianfei Yang

Reinforcement Learning (RL), one of the core paradigms in machine learning, learns to make decisions based on real-world experiences. This approach has significantly advanced AI applications across various domains, notably in smart grid…

Cryptography and Security · Computer Science 2024-02-27 Zheyu Zhang

Flexible and efficient wireless resource sharing across heterogeneous services is a key objective for future wireless networks. In this context, we investigate the performance of a system where latency-constrained internet-of-things (IoT)…

Signal Processing · Electrical Eng. & Systems 2025-06-19 Anup Mishra , Čedomir Stefanović , Xiuqiang Xu , Petar Popovski , Israel Leyva-Mayorga

Compared with model-based control and optimization methods, reinforcement learning (RL) provides a data-driven, learning-based framework to formulate and solve sequential decision-making problems. The RL framework has become promising due…

Systems and Control · Electrical Eng. & Systems 2024-07-29 Pouria Razzaghi , Amin Tabrizian , Wei Guo , Shulu Chen , Abenezer Taye , Ellis Thompson , Alexis Bregeon , Ali Baheri , Peng Wei