中文
相关论文

相关论文: OPAL: Offline Primitive Discovery for Accelerating…

200 篇论文

Offline safe reinforcement learning (RL) has emerged as a promising approach for learning safe behaviors without engaging in risky online interactions with the environment. Most existing methods in offline safe RL rely on cost constraints…

机器学习 · 计算机科学 2025-04-22 Ze Gong , Akshat Kumar , Pradeep Varakantham

A popular paradigm for offline Reinforcement Learning (RL) tasks is to first fit the offline trajectories to a sequence model, and then prompt the model for actions that lead to high expected return. In addition to obtaining accurate…

机器学习 · 计算机科学 2025-02-07 Xuejie Liu , Anji Liu , Guy Van den Broeck , Yitao Liang

Despite recent progress in offline learning, these methods are still trained and tested on the same environment. In this paper, we compare the generalization abilities of widely used online and offline learning methods such as online…

机器学习 · 计算机科学 2024-03-18 Ishita Mediratta , Qingfei You , Minqi Jiang , Roberta Raileanu

Distributionally robust offline reinforcement learning (RL) aims to find a policy that performs the best under the worst environment within an uncertainty set using an offline dataset collected from a nominal model. While recent advances in…

机器学习 · 计算机科学 2025-01-07 Ruiquan Huang , Yingbin Liang , Jing Yang

Reinforcement learning (RL) makes an agent learn from trial-and-error experiences gathered during the interaction with the environment. Recently, offline RL has become a popular RL paradigm because it saves the interactions with…

机器学习 · 计算机科学 2024-03-21 Chen Gong , Zhou Yang , Yunpeng Bai , Junda He , Jieke Shi , Kecen Li , Arunesh Sinha , Bowen Xu , Xinwen Hou , David Lo , Tianhao Wang

Intelligent agents rely heavily on prior experience when learning a new task, yet most modern reinforcement learning (RL) approaches learn every task from scratch. One approach for leveraging prior knowledge is to transfer skills learned on…

机器学习 · 计算机科学 2020-10-23 Karl Pertsch , Youngwoon Lee , Joseph J. Lim

Current Reinforcement Learning (RL) is often limited by the large amount of data needed to learn a successful policy. Offline RL aims to solve this issue by using transitions collected by a different behavior policy. We address a novel…

机器学习 · 计算机科学 2024-05-29 Johannes Ackermann , Takayuki Osa , Masashi Sugiyama

Offline reinforcement learning (RL) has increasingly become the focus of the artificial intelligent research due to its wide real-world applications where the collection of data may be difficult, time-consuming, or costly. In this paper, we…

机器学习 · 计算机科学 2021-05-13 Chenyang Xi , Bo Tang , Jiajun Shen , Xinfu Liu , Feiyu Xiong , Xueying Li

Offline reinforcement learning (RL) is a challenging setting where existing off-policy actor-critic methods perform poorly due to the overestimation of out-of-distribution state-action pairs. Thus, various additional augmentations are…

机器学习 · 计算机科学 2023-02-23 Zifeng Zhuang , Kun Lei , Jinxin Liu , Donglin Wang , Yilang Guo

Offline learning is a key part of making reinforcement learning (RL) useable in real systems. Offline RL looks at scenarios where there is data from a system's operation, but no direct access to the system when learning a policy. Recent…

机器学习 · 计算机科学 2021-03-18 Arthur Argenson , Gabriel Dulac-Arnold

Offline reinforcement learning (RL) is an effective tool for real-world recommender systems with its capacity to model the dynamic interest of users and its interactive nature. Most existing offline RL recommender systems focus on…

信息检索 · 计算机科学 2025-05-13 Yi Zhang , Ruihong Qiu , Jiajun Liu , Sen Wang

Efficient numerical optimization methods can improve performance and reduce the environmental impact of computing in many applications. This work presents a proof-of-concept study combining primitive state representations and…

机器学习 · 计算机科学 2025-01-30 R. Sala

A compelling use case of offline reinforcement learning (RL) is to obtain a policy initialization from existing datasets followed by fast online fine-tuning with limited interaction. However, existing offline RL methods tend to behave…

Offline reinforcement learning (offline RL) offers a promising framework for developing control strategies in chemical process systems using historical data, without the risks or costs of online experimentation. This work investigates the…

系统与控制 · 电气工程与系统科学 2025-07-31 Alex Durkin , Jasper Stolte , Matthew Jones , Raghuraman Pitchumani , Bei Li , Christian Michler , Mehmet Mercangöz

We hypothesize that empirically studying the sample complexity of offline reinforcement learning (RL) is crucial for the practical applications of RL in the real world. Several recent works have demonstrated the ability to learn policies…

机器学习 · 计算机科学 2022-01-03 Samin Yeasar Arnob , Riashat Islam , Doina Precup

The rapid growth of heterogeneous and massive wireless connectivity in 6G networks demands intelligent solutions to ensure scalability, reliability, privacy, ultra-low latency, and effective control. Although artificial intelligence (AI)…

机器学习 · 计算机科学 2025-04-08 Eslam Eldeeb , Hirley Alves

Reinforcement learning algorithms typically utilize an interactive simulator (i.e., environment) with a predefined reward function for policy training. Developing such simulators and manually defining reward functions, however, is often…

机器学习 · 计算机科学 2026-03-26 Woo-Jin Ahn , Sang-Ryul Baek , Yong-Jun Lee , Hyun-Duck Choi , Myo-Taeg Lim

End-to-end learning robotic manipulation with high data efficiency is one of the key challenges in robotics. The latest methods that utilize human demonstration data and unsupervised representation learning has proven to be a promising…

机器人学 · 计算机科学 2021-10-22 Jin Li , Xianyuan Zhan , Zixu Xiao , Guyue Zhou

We study offline-online reinforcement learning in linear mixture Markov decision processes (MDPs) under environment shift. In the offline phase, data are collected by an unknown behavior policy and may come from a mismatched environment,…

机器学习 · 计算机科学 2026-04-15 Zhongjun Zhang , Sean R. Sinclair

Recent advance in deep offline reinforcement learning (RL) has made it possible to train strong robotic agents from offline datasets. However, depending on the quality of the trained agents and the application being considered, it is often…

机器人学 · 计算机科学 2021-11-02 Seunghyun Lee , Younggyo Seo , Kimin Lee , Pieter Abbeel , Jinwoo Shin