English
Related papers

Related papers: Offline Reinforcement Learning from Human Feedback…

200 papers

Leveraging offline data is a promising way to improve the sample efficiency of online reinforcement learning (RL). This paper expands the pool of usable data for offline-to-online RL by leveraging abundant non-curated data that is…

Machine Learning · Computer Science 2025-05-20 Yi Zhao , Aidan Scannell , Wenshuai Zhao , Yuxin Hou , Tianyu Cui , Le Chen , Dieter Büchler , Arno Solin , Juho Kannala , Joni Pajarinen

Imitation learning has proven effective for training robots to perform complex tasks from expert human demonstrations. However, it remains limited by its reliance on high-quality, task-specific data, restricting adaptability to the diverse…

In practical applications, we can rarely assume full observability of a system's environment, despite such knowledge being important for determining a reactive control system's precise interaction with its environment. Therefore, we propose…

Machine Learning · Computer Science 2022-06-24 Edi Muskardin , Martin Tappler , Bernhard K. Aichernig , Ingo Pill

In recent years some researchers have explored the use of reinforcement learning (RL) algorithms as key components in the solution of various natural language processing tasks. For instance, some of these algorithms leveraging deep neural…

Computation and Language · Computer Science 2026-04-29 Victor Uc-Cetina , Nicolas Navarro-Guerrero , Anabel Martin-Gonzalez , Cornelius Weber , Stefan Wermter

Offline reinforcement learning, which learns solely from datasets without environmental interaction, has gained attention. This approach, similar to traditional online deep reinforcement learning, is particularly promising for robot control…

Robotics · Computer Science 2025-07-21 Shingo Ayabe , Takuto Otomo , Hiroshi Kera , Kazuhiko Kawamoto

Reinforcement learning (RL) has experienced a second wind in the past decade. While incredibly successful in images and videos, these systems still operate within the realm of propositional tasks ignoring the inherent structure that exists…

Machine Learning · Computer Science 2025-10-21 Fateme Golivand Darvishvand , Hikaru Shindo , Sahil Sidheekh , Kristian Kersting , Sriraam Natarajan

Offline Safe Reinforcement Learning (RL) seeks to address safety constraints by learning from static datasets and restricting exploration. However, these approaches heavily rely on the dataset and struggle to generalize to unseen scenarios…

Robotics · Computer Science 2025-03-04 Chenyang Cao , Yucheng Xin , Silang Wu , Longxiang He , Zichen Yan , Junbo Tan , Xueqian Wang

Training offline RL models using visual inputs poses two significant challenges, i.e., the overfitting problem in representation learning and the overestimation bias for expected future rewards. Recent work has attempted to alleviate the…

Machine Learning · Computer Science 2024-10-30 Qi Wang , Junming Yang , Yunbo Wang , Xin Jin , Wenjun Zeng , Xiaokang Yang

Recent advancements in Large Language Models (LLMs) have garnered wide attention and led to successful products such as ChatGPT and GPT-4. Their proficiency in adhering to instructions and delivering harmless, helpful, and honest (3H)…

Machine Learning · Computer Science 2023-10-11 Hao Sun

Learning to act from observational data without active environmental interaction is a well-known challenge in Reinforcement Learning (RL). Recent approaches involve constraints on the learned policy or conservative updates, preventing…

Machine Learning · Computer Science 2021-10-28 Georg Ostrovski , Pablo Samuel Castro , Will Dabney

Compared with model-based control and optimization methods, reinforcement learning (RL) provides a data-driven, learning-based framework to formulate and solve sequential decision-making problems. The RL framework has become promising due…

Systems and Control · Electrical Eng. & Systems 2024-07-29 Pouria Razzaghi , Amin Tabrizian , Wei Guo , Shulu Chen , Abenezer Taye , Ellis Thompson , Alexis Bregeon , Ali Baheri , Peng Wei

Offline reinforcement learning (RL) learns policies entirely from static datasets, thereby avoiding the challenges associated with online data collection. Practical applications of offline RL will inevitably require learning from datasets…

Machine Learning · Computer Science 2022-11-22 Anikait Singh , Aviral Kumar , Quan Vuong , Yevgen Chebotar , Sergey Levine

We study the problem of representation transfer in offline Reinforcement Learning (RL), where a learner has access to episodic data from a number of source tasks collected a priori, and aims to learn a shared representation to be used in…

Machine Learning · Computer Science 2024-02-21 Avinandan Bose , Simon Shaolei Du , Maryam Fazel

Fine-tuning reinforcement learning (RL) models has been challenging because of a lack of large scale off-the-shelf datasets as well as high variance in transferability among different environments. Recent work has looked at tackling offline…

Machine Learning · Computer Science 2022-07-26 Machel Reid , Yutaro Yamada , Shixiang Shane Gu

Reinforcement Learning (RL) is a learning paradigm concerned with learning to control a system so as to maximize an objective over the long term. This approach to learning has received immense interest in recent times and success manifests…

Artificial Intelligence · Computer Science 2018-07-26 Sanyam Kapoor

Deep reinforcement learning algorithms have succeeded in several challenging domains. Classic Online RL job schedulers can learn efficient scheduling strategies but often takes thousands of timesteps to explore the environment and adapt…

Machine Learning · Computer Science 2022-12-05 Vanamala Venkataswamy , Jake Grigsby , Andrew Grimshaw , Yanjun Qi

Energy efficiency has become an integral aspect of modern computing infrastructure design, impacting the performance, cost, scalability, and durability of production systems. The incorporation of power actuation and sensing capabilities in…

Machine Learning · Computer Science 2026-01-19 Akhilesh Raj , Swann Perarnau , Aniruddha Gokhale , Solomon Bekele Abera

Offline reinforcement learning (RL) has emerged as a prevalent and effective methodology for real-world recommender systems, enabling learning policies from historical data and capturing user preferences. In offline RL, reward shaping…

Information Retrieval · Computer Science 2025-07-01 Wenzheng Shu , Yanxiang Zeng , Yongxiang Tang , Teng Sha , Ning Luo , Yanhua Cheng , Xialong Liu , Fan Zhou , Peng Jiang

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

Machine Learning · Computer Science 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

The large-scale integration of intermittent renewable energy resources introduces increased uncertainty and volatility to the supply side of power systems, thereby complicating system operation and control. Recently, data-driven approaches,…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Peipei Yu , Zhenyi Wang , Hongcai Zhang , Yonghua Song