中文
相关论文

相关论文: Expressive Value Learning for Scalable Offline Rei…

200 篇论文

Constraint-based offline reinforcement learning (RL) involves policy constraints or imposing penalties on the value function to mitigate overestimation errors caused by distributional shift. This paper focuses on a limitation in existing…

机器学习 · 计算机科学 2024-10-25 Junghyuk Yeom , Yonghyeon Jo , Jungmo Kim , Sanghyeon Lee , Seungyul Han

Reinforcement learning (RL) has shown significant promise for sequential portfolio optimization tasks, such as stock trading, where the objective is to maximize cumulative returns while minimizing risks using historical data. However,…

机器学习 · 计算机科学 2025-05-20 Haochen Yuan , Minting Pan , Yunbo Wang , Siyu Gao , Philip S. Yu , Xiaokang Yang

Offline reinforcement learning (RL), also known as batch RL, aims to optimize policy from a large pre-recorded dataset without interaction with the environment. This setting offers the promise of utilizing diverse, pre-collected datasets to…

机器学习 · 计算机科学 2021-01-05 Qiang He , Xinwen Hou

The ability to learn from large batches of autonomously collected data for policy improvement -- a paradigm we refer to as batch online reinforcement learning -- holds the promise of enabling truly scalable robot learning by significantly…

机器人学 · 计算机科学 2025-05-14 Perry Dong , Suvir Mirchandani , Dorsa Sadigh , Chelsea Finn

Offline reinforcement learning (RL) aims to learn optimal policies from previously collected datasets. Recently, due to their powerful representational capabilities, diffusion models have shown significant potential as policy models for…

机器学习 · 计算机科学 2024-05-30 Tianle Zhang , Jiayi Guan , Lin Zhao , Yihang Li , Dongjiang Li , Zecui Zeng , Lei Sun , Yue Chen , Xuelong Wei , Lusong Li , Xiaodong He

The field of Offline Reinforcement Learning (RL) aims to derive effective policies from pre-collected datasets without active environment interaction. While traditional offline RL algorithms like Conservative Q-Learning (CQL) and Implicit…

机器学习 · 计算机科学 2025-11-21 Ali Murtaza Caunhye , Asad Jeewa

Learning-based vehicle planning is receiving increasing attention with the emergence of diverse driving simulators and large-scale driving datasets. While offline reinforcement learning (RL) is well suited for these safety-critical tasks,…

机器人学 · 计算机科学 2023-11-20 Zenan Li , Fan Nie , Qiao Sun , Fang Da , Hang Zhao

Policy evaluation is a core component of many reinforcement learning (RL) algorithms and a critical tool for ensuring safe deployment of RL policies. However, existing policy evaluation methods often suffer from high variance or bias. To…

人工智能 · 计算机科学 2026-03-23 Shripad Vilasrao Deshmukh , Will Schwarzer , Scott Niekum

In response to the limitations of reinforcement learning and evolutionary algorithms (EAs) in complex problem-solving, Evolutionary Reinforcement Learning (EvoRL) has emerged as a synergistic solution. EvoRL integrates EAs and reinforcement…

神经与进化计算 · 计算机科学 2024-02-22 Yuanguo Lin , Fan Lin , Guorong Cai , Hong Chen , Lixin Zou , Pengcheng Wu

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

机器学习 · 计算机科学 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

Offline-to-online reinforcement learning (RL), by combining the benefits of offline pretraining and online finetuning, promises enhanced sample efficiency and policy performance. However, existing methods, effective as they are, suffer from…

机器学习 · 计算机科学 2023-05-26 Jianxiong Li , Xiao Hu , Haoran Xu , Jingjing Liu , Xianyuan Zhan , Ya-Qin Zhang

Reinforcement learning (RL) has emerged as a promising strategy for finetuning small language models (SLMs) to solve targeted tasks such as math and coding. However, RL algorithms tend to be resource-intensive, taking a significant amount…

机器学习 · 计算机科学 2025-10-07 Lianghuan Huang , Sagnik Anupam , Insup Lee , Shuo Li , Osbert Bastani

Reinforcement Learning with Verifiable Rewards (RLVR) has been an effective approach for improving Large Language Models' reasoning in domains such as coding and mathematics. Here, we apply RLVR methods towards forecasting future real-world…

机器学习 · 计算机科学 2025-12-02 Benjamin Turtel , Danny Franklin , Kris Skotheim , Luke Hewitt , Philipp Schoenegger

The recent development of reinforcement learning (RL) has boosted the adoption of online RL for wireless radio resource management (RRM). However, online RL algorithms require direct interactions with the environment, which may be…

信息论 · 计算机科学 2023-11-21 Kun Yang , Cong Shen , Jing Yang , Shu-ping Yeh , Jerry Sydir

Supervised imitation-based approaches are often favored over off-policy reinforcement learning approaches for learning policies offline, since their straightforward optimization objective makes them computationally efficient and stable to…

机器学习 · 计算机科学 2025-12-30 Adam Jelley , Trevor McInroe , Sam Devlin , Amos Storkey

The success of deep reinforcement learning (DRL) hinges on the availability of training data, which is typically obtained via a large number of environment interactions. In many real-world scenarios, costs and risks are associated with…

机器学习 · 计算机科学 2022-05-20 Amir Abolfazli , Gregory Palmer , Daniel Kudenko

Offline Safe Reinforcement Learning (RL) seeks to address safety constraints by learning from static datasets and restricting exploration. However, these approaches heavily rely on the dataset and struggle to generalize to unseen scenarios…

机器人学 · 计算机科学 2025-03-04 Chenyang Cao , Yucheng Xin , Silang Wu , Longxiang He , Zichen Yan , Junbo Tan , Xueqian Wang

The goal of robust reinforcement learning (RL) is to learn a policy that is robust against the uncertainty in model parameters. Parameter uncertainty commonly occurs in many real-world RL applications due to simulator modeling errors,…

机器学习 · 计算机科学 2022-10-19 Kishan Panaganti , Zaiyan Xu , Dileep Kalathil , Mohammad Ghavamzadeh

Diffusion models have emerged as powerful generative tools across various domains, yet tailoring pre-trained models to exhibit specific desirable properties remains challenging. While reinforcement learning (RL) offers a promising…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Fengyuan Dai , Zifeng Zhuang , Yufei Huang , Siteng Huang , Bangyan Liao , Donglin Wang , Fajie Yuan

The goal of offline reinforcement learning (RL) is to find an optimal policy given prerecorded trajectories. Many current approaches customize existing off-policy RL algorithms, especially actor-critic algorithms in which policy evaluation…

机器学习 · 计算机科学 2021-10-07 Wonjoon Goo , Scott Niekum