中文
相关论文

相关论文: Real-World Offline Reinforcement Learning from Vis…

200 篇论文

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

机器学习 · 计算机科学 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng

Reinforcement learning (RL) offers significant promise for machinery fault detection (MFD). However, most existing RL-based MFD approaches do not fully exploit RL's sequential decision-making strengths, often treating MFD as a simple…

机器学习 · 计算机科学 2026-02-27 Dhiraj Neupane , Richard Dazeley , Mohamed Reda Bouadjenek , Sunil Aryal

Reinforcement learning (RL) requires either manually specifying a reward function, which is often infeasible, or learning a reward model from a large amount of human feedback, which is often very expensive. We study a more sample-efficient…

机器学习 · 计算机科学 2024-03-15 Juan Rocamonde , Victoriano Montesinos , Elvis Nava , Ethan Perez , David Lindner

Reinforcement learning (RL) is an effective approach to motion planning in autonomous driving, where an optimal driving policy can be automatically learned using the interaction data with the environment. Nevertheless, the reward function…

机器人学 · 计算机科学 2023-08-28 Lin-Chi Wu , Zengjie Zhang , Sofie Haesaert , Zhiqiang Ma , Zhiyong Sun

Vision-Language-Action (VLA) models have demonstrated potential in autonomous driving. However, two critical challenges hinder their development: (1) Existing VLA architectures are typically based on imitation learning in open-loop setup…

Offline reinforcement learning aims to train a policy on a pre-recorded and fixed dataset without any additional environment interactions. There are two major challenges in this setting: (1) extrapolation error caused by approximating the…

机器学习 · 计算机科学 2023-01-31 Dmitriy Akimov , Vladislav Kurenkov , Alexander Nikulin , Denis Tarasov , Sergey Kolesnikov

We introduce ReWiND, a framework for learning robot manipulation tasks solely from language instructions without per-task demonstrations. Standard reinforcement learning (RL) and imitation learning methods require expert supervision through…

Offline reinforcement learning (RL) learns effective policies from pre-collected datasets, offering a practical solution for applications where online interactions are risky or costly. Model-based approaches are particularly advantageous…

机器学习 · 计算机科学 2026-05-14 Xuyang Chen , Keyu Yan , Guojian Wang , Lin Zhao

Learning policies from previously recorded data is a promising direction for real-world robotics tasks, as online learning is often infeasible. Dexterous manipulation in particular remains an open problem in its general form. The…

Online reinforcement learning in complex tasks is time-consuming, as massive interaction steps are needed to learn the optimal Q-function.Vision-language action (VLA) policies represent a promising direction for solving diverse tasks;…

机器学习 · 计算机科学 2025-09-26 Xiefeng Wu , Jing Zhao , Shu Zhang , Mingyu Hu

Offline reinforcement learning methods hold the promise of learning policies from pre-collected datasets without the need to query the environment for new transitions. This setting is particularly well-suited for continuous control robotic…

机器学习 · 计算机科学 2022-03-18 Xi Chen , Ali Ghadirzadeh , Tianhe Yu , Yuan Gao , Jianhao Wang , Wenzhe Li , Bin Liang , Chelsea Finn , Chongjie Zhang

LLMs are often trained with RL from human or AI feedback, yet such methods typically compress nuanced feedback into scalar rewards, discarding much of their richness and inducing scale imbalance. We propose treating verbal feedback as a…

计算与语言 · 计算机科学 2025-09-29 Renjie Luo , Zichen Liu , Xiangyan Liu , Chao Du , Min Lin , Wenhu Chen , Wei Lu , Tianyu Pang

Supervised imitation-based approaches are often favored over off-policy reinforcement learning approaches for learning policies offline, since their straightforward optimization objective makes them computationally efficient and stable to…

机器学习 · 计算机科学 2025-12-30 Adam Jelley , Trevor McInroe , Sam Devlin , Amos Storkey

Reinforcement learning (RL) provides an appealing formalism for learning control policies from experience. However, the classic active formulation of RL necessitates a lengthy active exploration process for each behavior, making it…

机器学习 · 计算机科学 2021-04-27 Ashvin Nair , Abhishek Gupta , Murtaza Dalal , Sergey Levine

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

机器学习 · 计算机科学 2021-02-12 Mengjiao Yang , Ofir Nachum

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

机器人学 · 计算机科学 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

Reinforcement learning (RL) in the real world necessitates the development of procedures that enable agents to explore without causing harm to themselves or others. The most successful solutions to the problem of safe RL leverage offline…

机器学习 · 计算机科学 2025-01-09 Alexander Quessy , Thomas Richardson , Sebastian East

Reinforcement learning from human feedback (RLHF) has emerged as an effective approach to aligning large language models (LLMs) to human preferences. RLHF contains three steps, i.e., human preference collecting, reward learning, and policy…

计算与语言 · 计算机科学 2024-03-29 Hao Lang , Fei Huang , Yongbin Li

The complexity of designing reward functions has been a major obstacle to the wide application of deep reinforcement learning (RL) techniques. Describing an agent's desired behaviors and properties can be difficult, even for experts. A new…

机器学习 · 计算机科学 2024-05-09 Wanqi Xue , Bo An , Shuicheng Yan , Zhongwen Xu

The pre-train and fine-tune paradigm in machine learning has had dramatic success in a wide range of domains because the use of existing data or pre-trained models on the internet enables quick and easy learning of new tasks. We aim to…

机器人学 · 计算机科学 2023-10-24 Jingyun Yang , Max Sobol Mark , Brandon Vu , Archit Sharma , Jeannette Bohg , Chelsea Finn