中文
相关论文

相关论文: Real-World Offline Reinforcement Learning from Vis…

200 篇论文

Natural agents can effectively learn from multiple data sources that differ in size, quality, and types of measurements. We study this heterogeneity in the context of offline reinforcement learning (RL) by introducing a new, practically…

机器学习 · 计算机科学 2023-06-23 Qinqing Zheng , Mikael Henaff , Brandon Amos , Aditya Grover

The ability of reinforcement learning algorithms to learn effective policies is determined by the rewards available during training. However, for practical problems, obtaining large quantities of reward labels is often infeasible due to…

机器学习 · 计算机科学 2025-10-02 Shreyas Chaudhari , Renhao Zhang , Philip S. Thomas , Bruno Castro da Silva

With the widespread adoption of deep learning, reinforcement learning (RL) has experienced a dramatic increase in popularity, scaling to previously intractable problems, such as playing complex games from pixel observations, sustaining…

机器学习 · 计算机科学 2023-04-20 Rafael Figueiredo Prudencio , Marcos R. O. A. Maximo , Esther Luna Colombini

Deep reinforcement learning algorithms require large amounts of experience to learn an individual task. While in principle meta-reinforcement learning (meta-RL) algorithms enable agents to learn new skills from small amounts of experience,…

机器学习 · 计算机科学 2019-03-21 Kate Rakelly , Aurick Zhou , Deirdre Quillen , Chelsea Finn , Sergey Levine

Modern decision-making systems, from robots to web recommendation engines, are expected to adapt: to user preferences, changing circumstances or even new tasks. Yet, it is still uncommon to deploy a dynamically learning agent (rather than a…

Reinforcement Learning (RL)-based control system has received considerable attention in recent decades. However, in many real-world problems, such as Batch Process Control, the environment is uncertain, which requires expensive interaction…

机器学习 · 计算机科学 2022-11-03 Peng Zhang , Yawen Huang , Bingzhang Hu , Shizheng Wang , Haoran Duan , Noura Al Moubayed , Yefeng Zheng , Yang Long

Designing effective reward functions remains a fundamental challenge in reinforcement learning (RL), as it often requires extensive human effort and domain expertise. While RL from human feedback has been successful in aligning agents with…

机器学习 · 计算机科学 2025-06-17 Tung Minh Luu , Younghwan Lee , Donghoon Lee , Sunho Kim , Min Jun Kim , Chang D. Yoo

Offline reinforcement learning (RL) presents distinct challenges as it relies solely on observational data. A central concern in this context is ensuring the safety of the learned policy by quantifying uncertainties associated with various…

机器学习 · 计算机科学 2025-07-03 Xiaocong Chen , Siyu Wang , Tong Yu , Lina Yao

In safe offline reinforcement learning (RL), the objective is to develop a policy that maximizes cumulative rewards while strictly adhering to safety constraints, utilizing only offline data. Traditional methods often face difficulties in…

机器学习 · 计算机科学 2026-02-11 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Recent advances in batch (offline) reinforcement learning have shown promising results in learning from available offline data and proved offline reinforcement learning to be an essential toolkit in learning control policies in a model-free…

机器学习 · 计算机科学 2022-12-19 Ashish Kumar , Ilya Kuzovkin

Reinforcement learning plays a crucial role in vehicle control by guiding agents to learn optimal control strategies through designing or learning appropriate reward signals. However, in vehicle control applications, rewards typically need…

机器学习 · 计算机科学 2025-04-21 Jielong Yang , Daoyuan Huang

Most reinforcement learning (RL) methods for training large language models (LLMs) require ground-truth labels or task-specific verifiers, limiting scalability when correctness is ambiguous or expensive to obtain. We introduce Reinforcement…

神经与进化计算 · 计算机科学 2026-01-30 Micah Rentschler , Jesse Roberts

A practical approach to robot reinforcement learning is to first collect a large batch of real or simulated robot interaction data, using some data collection policy, and then learn from this data to perform various tasks, using offline…

机器人学 · 计算机科学 2021-06-02 Shadi Endrawis , Gal Leibovich , Guy Jacob , Gal Novik , Aviv Tamar

In a sequential decision-making problem, off-policy evaluation estimates the expected cumulative reward of a target policy using logged trajectory data generated from a different behavior policy, without execution of the target policy.…

机器学习 · 计算机科学 2022-11-04 Jie Wang , Rui Gao , Hongyuan Zha

Offline reinforcement learning (RL) methods can generally be categorized into two types: RL-based and Imitation-based. RL-based methods could in principle enjoy out-of-distribution generalization but suffer from erroneous off-policy…

机器学习 · 计算机科学 2023-04-06 Haoran Xu , Li Jiang , Jianxiong Li , Xianyuan Zhan

Offline Preference-based Reinforcement Learning (PbRL) learns rewards and policies aligned with human preferences without the need for extensive reward engineering and direct interaction with human annotators. However, ensuring safety…

人工智能 · 计算机科学 2025-12-24 Ze Gong , Pradeep Varakantham , Akshat Kumar

Large language models (LLMs) have achieved strong performance in language-centric tasks. However, in agentic settings, LLMs often struggle to anticipate action consequences and adapt to environment dynamics, highlighting the need for…

计算与语言 · 计算机科学 2026-02-10 Xiao Yu , Baolin Peng , Ruize Xu , Yelong Shen , Pengcheng He , Suman Nath , Nikhil Singh , Jiangfeng Gao , Zhou Yu

Learning from Demonstrations (LfD) and Reinforcement Learning (RL) have enabled robot agents to accomplish complex tasks. Reward Machines (RMs) enhance RL's capability to train policies over extended time horizons by structuring high-level…

机器人学 · 计算机科学 2024-12-16 Mattijs Baert , Sam Leroux , Pieter Simoens

Offline policy learning is aimed at learning decision-making policies using existing datasets of trajectories without collecting additional data. The primary motivation for using reinforcement learning (RL) instead of supervised learning…

Offline reinforcement learning (RL) offers a powerful paradigm for data-driven control. Compared to model-free approaches, offline model-based RL (MBRL) explicitly learns a world model from a static dataset and uses it as a surrogate…

机器学习 · 计算机科学 2026-02-02 Jiayu Chen , Le Xu , Aravind Venugopal , Jeff Schneider