中文
相关论文

相关论文: Bayes Adaptive Monte Carlo Tree Search for Offline…

200 篇论文

Offline reinforcement learning (RL) aims at learning policies from previously collected static trajectory data without interacting with the real environment. Recent works provide a novel perspective by viewing offline RL as a generic…

机器学习 · 计算机科学 2022-10-19 Kerong Wang , Hanye Zhao , Xufang Luo , Kan Ren , Weinan Zhang , Dongsheng Li

We consider a Bayesian approach to offline model-based inverse reinforcement learning (IRL). The proposed framework differs from existing offline model-based IRL approaches by performing simultaneous estimation of the expert's reward…

机器学习 · 计算机科学 2024-04-09 Ran Wei , Siliang Zeng , Chenliang Li , Alfredo Garcia , Anthony McDonald , Mingyi Hong

Model-based offline Reinforcement Learning (RL) constructs environment models from offline datasets to perform conservative policy optimization. Existing approaches focus on learning state transitions through ensemble models, rollouting…

机器学习 · 计算机科学 2025-03-27 Hongye Cao , Fan Feng , Jing Huo , Shangdong Yang , Meng Fang , Tianpei Yang , Yang Gao

Model-based offline reinforcement learning (RL), which builds a supervised transition model with logging dataset to avoid costly interactions with the online environment, has been a promising approach for offline policy optimization. As the…

机器学习 · 计算机科学 2023-09-06 Junming Yang , Xingguo Chen , Shengyuan Wang , Bolei Zhang

The problem of offline reinforcement learning focuses on learning a good policy from a log of environment interactions. Past efforts for developing algorithms in this area have revolved around introducing constraints to online reinforcement…

机器学习 · 计算机科学 2022-04-27 Ian Char , Viraj Mehta , Adam Villaflor , John M. Dolan , Jeff Schneider

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

机器人学 · 计算机科学 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

In this paper, we present a Model-Based Reinforcement Learning (MBRL) algorithm named \emph{Monte Carlo Probabilistic Inference for Learning COntrol} (MC-PILCO). The algorithm relies on Gaussian Processes (GPs) to model the system dynamics…

We study the offline meta-reinforcement learning (OMRL) problem, a paradigm which enables reinforcement learning (RL) algorithms to quickly adapt to unseen tasks without any interactions with the environments, making RL truly practical in…

机器学习 · 计算机科学 2021-05-07 Lanqing Li , Rui Yang , Dijun Luo

We study offline-online reinforcement learning in linear mixture Markov decision processes (MDPs) under environment shift. In the offline phase, data are collected by an unknown behavior policy and may come from a mismatched environment,…

机器学习 · 计算机科学 2026-04-15 Zhongjun Zhang , Sean R. Sinclair

Model-based offline reinforcement Learning (RL) is a promising approach that leverages existing data effectively in many real-world applications, especially those involving high-dimensional inputs like images and videos. To alleviate the…

计算机视觉与模式识别 · 计算机科学 2024-06-17 Shenghua Wan , Ziyuan Chen , Le Gan , Shuai Feng , De-Chuan Zhan

Offline reinforcement learning (RL) aims to find an optimal policy for Markov decision processes (MDPs) using a pre-collected dataset. In this work, we revisit the linear programming (LP) reformulation of Markov decision processes for…

机器学习 · 计算机科学 2024-12-11 Asuman Ozdaglar , Sarath Pattathil , Jiawei Zhang , Kaiqing Zhang

Offline reinforcement learning (RL) aims at learning an optimal strategy using a pre-collected dataset without further interactions with the environment. While various algorithms have been proposed for offline RL in the previous literature,…

机器学习 · 计算机科学 2023-03-02 Wei Xiong , Han Zhong , Chengshuai Shi , Cong Shen , Liwei Wang , Tong Zhang

Offline reinforcement learning (RL) aims to find optimal policies in dynamic environments in order to maximize the expected total rewards by leveraging pre-collected data. Learning from heterogeneous data is one of the fundamental…

机器学习 · 统计学 2026-03-10 Rui Miao , Babak Shahbaba , Annie Qu

In offline reinforcement learning (RL), the absence of active exploration calls for attention on the model robustness to tackle the sim-to-real gap, where the discrepancy between the simulated and deployed environments can significantly…

机器学习 · 计算机科学 2024-06-28 He Wang , Laixi Shi , Yuejie Chi

Offline Reinforcement Learning (RL) is structured to derive policies from static trajectory data without requiring real-time environment interactions. Recent studies have shown the feasibility of framing offline RL as a sequence modeling…

机器学习 · 计算机科学 2023-09-01 Abdelghani Ghanem , Philippe Ciblat , Mounir Ghogho

Planning in stochastic and partially observable environments is a central issue in artificial intelligence. One commonly used technique for solving such a problem is by constructing an accurate model firstly. Although some recent approaches…

人工智能 · 计算机科学 2019-04-08 Yunlong Liu , Jianyang Zheng

In this paper, we study the problem of transferring the available Markov Decision Process (MDP) models to learn and plan efficiently in an unknown but similar MDP. We refer to it as \textit{Model Transfer Reinforcement Learning (MTRL)}…

机器学习 · 计算机科学 2023-02-21 Hannes Eriksson , Debabrota Basu , Tommy Tram , Mina Alibeigi , Christos Dimitrakakis

Offline reinforcement learning (RL) defines the task of learning from a fixed batch of data. Due to errors in value estimation from out-of-distribution actions, most offline RL algorithms take the approach of constraining or regularizing…

机器学习 · 计算机科学 2021-12-06 Scott Fujimoto , Shixiang Shane Gu

Learning and planning with latent space dynamics has been shown to be useful for sample efficiency in model-based reinforcement learning (MBRL) for discrete and continuous control tasks. In particular, recent work, for discrete action…

机器学习 · 计算机科学 2020-10-21 Anurag Koul , Varun V. Kumar , Alan Fern , Somdeb Majumdar

Reinforcement learning (RL) provides a principled framework for decision-making in partially observable environments, which can be modeled as Markov decision processes and compactly represented through dynamic decision Bayesian networks.…