中文
相关论文

相关论文: Using Offline Data to Speed Up Reinforcement Learn…

200 篇论文

Most offline reinforcement learning (RL) algorithms return a target policy maximizing a trade-off between (1) the expected performance gain over the behavior policy that collected the dataset, and (2) the risk stemming from the…

机器学习 · 计算机科学 2023-06-23 Zhang-Wei Hong , Pulkit Agrawal , Rémi Tachet des Combes , Romain Laroche

Pretraining is a common technique in deep learning for increasing performance and reducing training time, with promising experimental results in deep reinforcement learning (RL). However, pretraining requires a relevant dataset for…

机器学习 · 计算机科学 2021-10-07 Saurav Kadavath , Samuel Paradis , Brian Yao

In recent years, data-driven reinforcement learning (RL), also known as offline RL, have gained significant attention. However, the role of data sampling techniques in offline RL has been overlooked despite its potential to enhance online…

机器学习 · 计算机科学 2025-03-24 Jinyi Liu , Yi Ma , Jianye Hao , Yujing Hu , Yan Zheng , Tangjie Lv , Changjie Fan

Offline reinforcement learning leverages previously-collected offline datasets to learn optimal policies with no necessity to access the real environment. Such a paradigm is also desirable for multi-agent reinforcement learning (MARL)…

机器学习 · 计算机科学 2022-06-13 Linghui Meng , Muning Wen , Yaodong Yang , Chenyang Le , Xiyun Li , Weinan Zhang , Ying Wen , Haifeng Zhang , Jun Wang , Bo Xu

Distributionally robust offline reinforcement learning (RL), which seeks robust policy training against environment perturbation by modeling dynamics uncertainty, calls for function approximations when facing large state-action spaces.…

机器学习 · 计算机科学 2025-11-03 Zhishuai Liu , Pan Xu

It is desirable for policies to optimistically explore new states and behaviors during online reinforcement learning (RL) or fine-tuning, especially when prior offline data does not provide enough state coverage. However, exploration…

机器学习 · 计算机科学 2023-10-13 Max Sobol Mark , Archit Sharma , Fahim Tajwar , Rafael Rafailov , Sergey Levine , Chelsea Finn

Offline reinforcement learning (RL) defines a sample-efficient learning paradigm, where a policy is learned from static and previously collected datasets without additional interaction with the environment. The major obstacle to offline RL…

机器学习 · 计算机科学 2022-11-16 Yunfan Zhou , Xijun Li , Qingyu Qu

Offline reinforcement learning often requires a quality dataset that we can train a policy on. However, in many situations, it is not possible to get such a dataset, nor is it easy to train a policy to perform well in the actual environment…

机器学习 · 计算机科学 2025-11-04 Jonathan Light , Yuanzhe Liu , Ziniu Hu

Energy efficiency has become an integral aspect of modern computing infrastructure design, impacting the performance, cost, scalability, and durability of production systems. The incorporation of power actuation and sensing capabilities in…

机器学习 · 计算机科学 2026-01-19 Akhilesh Raj , Swann Perarnau , Aniruddha Gokhale , Solomon Bekele Abera

We study the offline meta-reinforcement learning (OMRL) problem, a paradigm which enables reinforcement learning (RL) algorithms to quickly adapt to unseen tasks without any interactions with the environments, making RL truly practical in…

机器学习 · 计算机科学 2021-05-07 Lanqing Li , Rui Yang , Dijun Luo

Implementing an autonomous vehicle that is able to output feasible, smooth and efficient trajectories is a long-standing challenge. Several approaches have been considered, roughly falling under two categories: rule-based and learning-based…

机器人学 · 计算机科学 2022-03-22 Branka Mirchevska , Moritz Werling , Joschka Boedecker

Reinforcement learning has been applied to a wide variety of robotics problems, but most of such applications involve collecting data from scratch for each new task. Since the amount of robot data we can collect for any single task is…

机器学习 · 计算机科学 2020-10-28 Avi Singh , Albert Yu , Jonathan Yang , Jesse Zhang , Aviral Kumar , Sergey Levine

Informative path planning (IPP) is a crucial task in robotics, where agents must design paths to gather valuable information about a target environment while adhering to resource constraints. Reinforcement learning (RL) has been shown to be…

机器人学 · 计算机科学 2024-09-26 Srikar Babu Gadipudi , Srujan Deolasee , Siva Kailas , Wenhao Luo , Katia Sycara , Woojun Kim

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

机器学习 · 计算机科学 2021-11-24 Lihua Zhang

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

机器学习 · 计算机科学 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

We investigate reinforcement learning (RL) in the presence of distributional mismatch between training and deployment, where policies trained in simulators often underperform in practice due to mismatches between training and deployment…

机器学习 · 计算机科学 2025-11-12 Debamita Ghosh , George K. Atia , Yue Wang

Reinforcement learning (RL) trains an agent from experiences interacting with the environment. In scenarios where online interactions are impractical, offline RL, which trains the agent using pre-collected datasets, has become popular.…

机器学习 · 计算机科学 2024-09-04 Chen Gong , Kecen Li , Jin Yao , Tianhao Wang

Recent studies on online reinforcement learning (RL) have demonstrated the advantages of learning multiple behaviors from a single task, as in the case of few-shot adaptation to a new environment. Although this approach is expected to yield…

机器学习 · 计算机科学 2024-06-11 Takayuki Osa , Tatsuya Harada

Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent…

机器人学 · 计算机科学 2022-05-31 Haochen Liu , Zhiyu Huang , Jingda Wu , Chen Lv

Reinforcement learning (RL) and causal modelling naturally complement each other. The goal of causal modelling is to predict the effects of interventions in an environment, while the goal of reinforcement learning is to select interventions…

机器学习 · 计算机科学 2024-07-12 Oliver Schulte , Pascal Poupart