中文
相关论文

相关论文: RvS: What is Essential for Offline RL via Supervis…

200 篇论文

The paradigm of decision-making has been revolutionised by reinforcement learning and deep learning. Although this has led to significant progress in domains such as robotics, healthcare, and finance, the use of RL in practice is…

机器学习 · 计算机科学 2026-02-23 Daqian Shao

In a recent study, Reinforcement Learning (RL) used in combination with many-objective search, has been shown to outperform alternative techniques (random search and many-objective search) for online testing of Deep Neural Network-enabled…

软件工程 · 计算机科学 2024-03-21 Luca Giamattei , Matteo Biagiola , Roberto Pietrantuono , Stefano Russo , Paolo Tonella

While reinforcement learning (RL) has the potential to enable robots to autonomously acquire a wide range of skills, in practice, RL usually requires manual, per-task engineering of reward functions, especially in real world settings where…

机器人学 · 计算机科学 2019-02-15 Tianhe Yu , Gleb Shevchuk , Dorsa Sadigh , Chelsea Finn

This paper studies tabular reinforcement learning (RL) in the hybrid setting, which assumes access to both an offline dataset and online interactions with the unknown environment. A central question boils down to how to efficiently utilize…

机器学习 · 计算机科学 2023-05-18 Gen Li , Wenhao Zhan , Jason D. Lee , Yuejie Chi , Yuxin Chen

Scaling up self-supervised learning has driven breakthroughs in language and vision, yet comparable progress has remained elusive in reinforcement learning (RL). In this paper, we study building blocks for self-supervised RL that unlock…

机器学习 · 计算机科学 2026-02-03 Kevin Wang , Ishaan Javali , Michał Bortkiewicz , Tomasz Trzciński , Benjamin Eysenbach

Unsupervised visual representation learning offers the opportunity to leverage large corpora of unlabeled trajectories to form useful visual representations, which can benefit the training of reinforcement learning (RL) algorithms. However,…

机器学习 · 计算机科学 2024-06-04 Wancong Zhang , Anthony GX-Chen , Vlad Sobal , Yann LeCun , Nicolas Carion

Offline reinforcement learning has shown great promise in leveraging large pre-collected datasets for policy learning, allowing agents to forgo often-expensive online data collection. However, offline reinforcement learning from visual…

机器学习 · 计算机科学 2023-07-07 Cong Lu , Philip J. Ball , Tim G. J. Rudner , Jack Parker-Holder , Michael A. Osborne , Yee Whye Teh

Offline-to-online reinforcement learning (RL) improves sample efficiency by leveraging pre-collected datasets prior to online interaction. A key challenge, however, is learning an accurate critic in large state--action spaces with limited…

人工智能 · 计算机科学 2026-05-21 Andrew Choi , Wei Xu

Interacting with the actual environment to acquire data is often costly and time-consuming in robotic tasks. Model-based offline reinforcement learning (RL) provides a feasible solution. On the one hand, it eliminates the requirements of…

机器学习 · 计算机科学 2023-10-17 Pengqin Wang , Meixin Zhu , Shaojie Shen

Reinforcement learning (RL) has shown great success in estimating sequential treatment strategies which take into account patient heterogeneity. However, health-outcome information, which is used as the reward for reinforcement learning…

机器学习 · 计算机科学 2021-02-24 Aaron Sonabend-W , Nilanjana Laha , Ashwin N. Ananthakrishnan , Tianxi Cai , Rajarshi Mukherjee

Deep research agents have shown remarkable potential in handling long-horizon tasks. However, state-of-the-art performance typically relies on online reinforcement learning (RL), which is financially expensive due to extensive API calls.…

人工智能 · 计算机科学 2026-02-24 Yuhang Zhou , Kai Zheng , Qiguang Chen , Mengkang Hu , Qingfeng Sun , Can Xu , Jingjing Chen

Reinforcement learning (RL) is not yet competitive for many cyber-physical systems, such as robotics, process automation, and power systems, as training on a system with physical components cannot be accelerated, and simulation models do…

机器学习 · 计算机科学 2024-11-01 Philipp Gassert , Matthias Althoff

Offline reinforcement learning (RL) allows agents to learn effective, return-maximizing policies from a static dataset. Three popular algorithms for offline RL are Conservative Q-Learning (CQL), Behavior Cloning (BC), and Decision…

机器学习 · 计算机科学 2024-03-13 Prajjwal Bhargava , Rohan Chitnis , Alborz Geramifard , Shagun Sodhani , Amy Zhang

Modern decision-making systems, from robots to web recommendation engines, are expected to adapt: to user preferences, changing circumstances or even new tasks. Yet, it is still uncommon to deploy a dynamically learning agent (rather than a…

Data collection is crucial for learning robust world models in model-based reinforcement learning. The most prevalent strategies are to actively collect trajectories by interacting with the environment during online training or training on…

机器学习 · 计算机科学 2025-09-09 Jiaqi Chen , Ji Shi , Cansu Sancaktar , Jonas Frey , Georg Martius

In many reinforcement learning (RL) applications one cannot easily let the agent act in the world; this is true for autonomous vehicles, healthcare applications, and even some recommender systems, to name a few examples. Offline RL provides…

机器学习 · 计算机科学 2024-07-02 Ori Linial , Guy Tennenholtz , Uri Shalit

We consider the problem of learning useful robotic skills from previously collected offline data without access to manually specified rewards or additional online exploration, a setting that is becoming increasingly important for scaling…

Offline reinforcement-learning (RL) algorithms learn to make decisions using a given, fixed training dataset without online data collection. This problem setting is captivating because it holds the promise of utilizing previously collected…

机器学习 · 计算机科学 2022-12-07 Dan Elbaz , Gal Novik , Oren Salzman

Multi-task learning (MTL) enables simultaneous training across related tasks, leveraging shared information to improve generalization, efficiency, and robustness, especially in data-scarce or high-dimensional scenarios. While deep learning…

机器学习 · 计算机科学 2025-10-31 Fatemeh Bazikar , Hossein Moosaei , Atefeh Hemmati , Panos M. Pardalos

Pre-training has been a useful method for learning implicit transferable knowledge and it shows the benefit of offering complementary features across different modalities. Recent work mainly focuses on the modalities such as image and text,…

计算与语言 · 计算机科学 2022-12-09 Ziqi Zhang , Yile Wang , Yue Zhang , Donglin Wang