中文
相关论文

相关论文: SALE-Based Offline Reinforcement Learning with Ens…

200 篇论文

The offline reinforcement learning (RL) paradigm provides a general recipe to convert static behavior datasets into policies that can perform better than the policy that collected the data. While policy constraints, conservatism, and other…

人工智能 · 计算机科学 2023-10-19 Jianlan Luo , Perry Dong , Jeffrey Wu , Aviral Kumar , Xinyang Geng , Sergey Levine

We consider an offline reinforcement learning (RL) setting where the agent need to learn from a dataset collected by rolling out multiple behavior policies. There are two challenges for this setting: 1) The optimal trade-off between…

机器学习 · 统计学 2022-12-06 Yuanying Cai , Chuheng Zhang , Li Zhao , Wei Shen , Xuyun Zhang , Lei Song , Jiang Bian , Tao Qin , Tieyan Liu

Offline reinforcement learning (RL) has garnered significant attention for its ability to learn effective policies from pre-collected datasets without the need for further environmental interactions. While promising results have been…

机器学习 · 计算机科学 2024-10-04 The Viet Bui , Thanh Hong Nguyen , Tien Mai

Offline reinforcement learning (RL) presents distinct challenges as it relies solely on observational data. A central concern in this context is ensuring the safety of the learned policy by quantifying uncertainties associated with various…

机器学习 · 计算机科学 2025-07-03 Xiaocong Chen , Siyu Wang , Tong Yu , Lina Yao

A key problem in off-policy Reinforcement Learning (RL) is the mismatch, or distribution shift, between the dataset and the distribution over states and actions visited by the learned policy. This problem is exacerbated in the fully offline…

机器学习 · 计算机科学 2023-11-28 Melrose Roderick , Gaurav Manek , Felix Berkenkamp , J. Zico Kolter

Reinforcement learning (RL) in low-data and risk-sensitive domains requires performant and flexible deployment policies that can readily incorporate constraints during deployment. One such class of policies are the semi-parametric H-step…

机器学习 · 计算机科学 2021-10-07 Harshit Sikchi , Wenxuan Zhou , David Held

Inspired by the recent successes of Inverse Optimization (IO) across various application domains, we propose a novel offline Reinforcement Learning (ORL) algorithm for continuous state and action spaces, leveraging the convex loss function…

机器学习 · 计算机科学 2026-03-19 Ioannis Dimanidis , Tolga Ok , Peyman Mohajerin Esfahani

Learning to coordinate many agents in partially observable and highly dynamic environments requires both informative representations and data-efficient training. To address this challenge, we present a novel model-based multi-agent…

机器学习 · 计算机科学 2026-02-16 Zhizun Wang , David Meger

Reinforcement learning agents in complex game environments often suffer from sparse rewards, training instability, and poor sample efficiency. This paper presents a hybrid training approach that combines offline imitation learning with…

机器学习 · 计算机科学 2025-09-19 Thomas Ackermann , Moritz Spang , Hamza A. A. Gardi

Model-based offline reinforcement learning (RL) is a compelling approach that addresses the challenge of learning from limited, static data by generating imaginary trajectories using learned models. However, these approaches often struggle…

机器学习 · 计算机科学 2024-12-04 Kwanyoung Park , Youngwoon Lee

The Network Slicing (NS) paradigm enables the partition of physical and virtual resources among multiple logical networks, possibly managed by different tenants. In such a scenario, network resources need to be dynamically allocated…

多智能体系统 · 计算机科学 2024-08-22 Federico Mason , Gianfranco Nencioni , Andrea Zanella

Offline reinforcement learning (RL) shows promise of applying RL to real-world problems by effectively utilizing previously collected data. Most existing offline RL algorithms use regularization or constraints to suppress extrapolation…

机器学习 · 计算机科学 2021-10-20 Xiaoteng Ma , Yiqin Yang , Hao Hu , Qihan Liu , Jun Yang , Chongjie Zhang , Qianchuan Zhao , Bin Liang

Deploying reinforcement learning (RL) in robotics, industry, and health care is blocked by two obstacles: the difficulty of specifying accurate rewards and the risk of unsafe, data-hungry exploration. We address this by proposing a…

人工智能 · 计算机科学 2025-10-14 Maël Macuglia , Paul Friedrich , Giorgia Ramponi

Offline reinforcement learning (RL) aims to infer sequential decision policies using only offline datasets. This is a particularly difficult setup, especially when learning to achieve multiple different goals or outcomes under a given…

机器学习 · 计算机科学 2024-05-17 Mianchu Wang , Yue Jin , Giovanni Montana

Actor-critic deep reinforcement learning (DRL) algorithms have recently achieved prominent success in tackling various challenging reinforcement learning (RL) problems, particularly complex control tasks with high-dimensional continuous…

机器学习 · 计算机科学 2023-05-04 Gang Chen , Victoria Huang

Many reinforcement learning (RL) applications have combinatorial action spaces, where each action is a composition of sub-actions. A standard RL approach ignores this inherent factorization structure, resulting in a potential failure to…

机器学习 · 计算机科学 2023-05-04 Shengpu Tang , Maggie Makar , Michael W. Sjoding , Finale Doshi-Velez , Jenna Wiens

In this paper, we propose a distributed off-policy actor critic method to solve multi-agent reinforcement learning problems. Specifically, we assume that all agents keep local estimates of the global optimal policy parameter and update…

机器学习 · 计算机科学 2019-03-25 Yan Zhang , Michael M. Zavlanos

Offline reinforcement learning (RL) aims to find optimal policies in dynamic environments in order to maximize the expected total rewards by leveraging pre-collected data. Learning from heterogeneous data is one of the fundamental…

机器学习 · 统计学 2026-03-10 Rui Miao , Babak Shahbaba , Annie Qu

In 5G networks, network slicing has emerged as a pivotal paradigm to address diverse user demands and service requirements. To meet the requirements, reinforcement learning (RL) algorithms have been utilized widely, but this method has the…

网络与互联网体系结构 · 计算机科学 2024-08-21 Shavbo Salehi , Pedro Enrique Iturria-Rivera , Medhat Elsayed , Majid Bavand , Raimundas Gaigalas , Yigit Ozcan , Melike Erol-Kantarci

We consider the offline reinforcement learning (RL) setting where the agent aims to optimize the policy solely from the data without further environment interactions. In offline RL, the distributional shift becomes the primary source of…

机器学习 · 计算机科学 2021-06-22 Jongmin Lee , Wonseok Jeon , Byung-Jun Lee , Joelle Pineau , Kee-Eung Kim