English
Related papers

Related papers: Integrating Human Feedback into a Reinforcement Le…

200 papers

Large language models have paved the way to powerful and flexible AI agents, assisting humans by increasingly integrating into their daily life. This flexibility, potential, and growing adoption demands a holistic and cross-disciplinary…

Artificial Intelligence · Computer Science 2025-07-23 Pierluca D'Oro , Caley Drooff , Joy Chen , Joseph Tighe

Controlling artificial agents from visual sensory data is an arduous task. Reinforcement learning (RL) algorithms can succeed but require large amounts of interactions between the agent and the environment. To alleviate the issue,…

Artificial Intelligence · Computer Science 2023-05-26 Sai Rajeswar , Pietro Mazzaglia , Tim Verbelen , Alexandre Piché , Bart Dhoedt , Aaron Courville , Alexandre Lacoste

Aligning large language models (LLMs) with human preferences is critical to recent advances in generative artificial intelligence. Reinforcement learning from human feedback (RLHF) is widely applied to achieve this objective. A key step in…

Machine Learning · Statistics 2025-01-03 Pangpang Liu , Chengchun Shi , Will Wei Sun

Language systems have been of great interest to the research community and have recently reached the mass market through various assistant platforms on the web. Reinforcement Learning methods that optimize dialogue policies have seen…

Machine Learning · Computer Science 2024-02-09 Floris den Hengst , Mark Hoogendoorn , Frank van Harmelen , Joost Bosman

Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn…

Artificial Intelligence · Computer Science 2023-10-11 Noah Shinn , Federico Cassano , Edward Berman , Ashwin Gopinath , Karthik Narasimhan , Shunyu Yao

Online reinforcement learning (RL) is increasingly used for realizing adaptive systems in the presence of design time uncertainty. Online RL facilitates learning from actual operational data and thereby leverages feedback only available at…

Software Engineering · Computer Science 2023-07-11 Andreas Metzger , Jan Laufer , Felix Feit , Klaus Pohl

Reinforcement Learning (RL), a subfield of Artificial Intelligence (AI), focuses on training agents to make decisions by interacting with their environment to maximize cumulative rewards. This paper provides an overview of RL, covering its…

Artificial Intelligence · Computer Science 2024-12-04 Majid Ghasemi , Dariush Ebrahimi

Digitization and remote connectivity have enlarged the attack surface and made cyber systems more vulnerable. As attackers become increasingly sophisticated and resourceful, mere reliance on traditional cyber protection, such as intrusion…

Cryptography and Security · Computer Science 2021-12-08 Yunhan Huang , Linan Huang , Quanyan Zhu

The use of reinforcement learning (RL) methods to support health behavior change via personalized and just-in-time adaptive interventions is of significant interest to health and behavioral science researchers focused on problems such as…

Machine Learning · Computer Science 2025-07-08 Karine Karine , Benjamin M. Marlin

Advances in artificial intelligence (AI) have led to its application in many areas of everyday life. In the context of control engineering, reinforcement learning (RL) represents a particularly promising approach as it is centred around the…

Machine Learning · Computer Science 2024-06-28 Kevin Badalian , Lucas Koch , Tobias Brinkmann , Mario Picerno , Marius Wegener , Sung-Yong Lee , Jakob Andert

Conventional online surveys provide limited personalization, often resulting in low engagement and superficial responses. Although AI survey chatbots improve convenience, most are still reactive: they rely on fixed dialogue trees or static…

Human-Computer Interaction · Computer Science 2025-11-10 Jinwen Tang , Yi Shang

Reinforcement Learning from Human Feedback (RLHF) is a powerful paradigm for aligning foundation models to human values and preferences. However, current RLHF techniques cannot account for the naturally occurring differences in individual…

Machine Learning · Computer Science 2024-08-20 Sriyash Poddar , Yanming Wan , Hamish Ivison , Abhishek Gupta , Natasha Jaques

With the recent rapid advancement of Agentic Intelligence, agentic tool use in LLMs has become increasingly important. During multi-turn interactions between agents and users, the dynamic, uncertain, and stochastic nature of user demands…

Artificial Intelligence · Computer Science 2025-08-27 Weikang Zhao , Xili Wang , Chengdi Ma , Lingbin Kong , Zhaohua Yang , Mingxiang Tuo , Xiaowei Shi , Yitao Zhai , Xunliang Cai

Reinforcement learning from human feedback (RLHF) has emerged as a key enabling technology for aligning AI behaviour with human preferences. The traditional way to collect data in RLHF is via pairwise comparisons: human raters are asked to…

Machine Learning · Computer Science 2025-12-01 Jan Kompatscher , Danqing Shi , Giovanna Varni , Tino Weinkauf , Antti Oulasvirta

Human behavior expression and experience are inherently multi-modal, and characterized by vast individual and contextual heterogeneity. To achieve meaningful human-computer and human-robot interactions, multi-modal models of the users…

Machine Learning · Computer Science 2019-06-10 Ognjen Rudovic , Meiru Zhang , Bjorn Schuller , Rosalind W. Picard

Reinforcement learning (RL) is a promising approach for aligning large language models (LLMs) knowledge with sequential decision-making tasks. However, few studies have thoroughly investigated the impact on LLM agents capabilities of…

Reinforcement Learning (RL) agents often exhibit learning behaviors that are not intuitively interpretable by human observers, which can result in suboptimal feedback in collaborative teaching settings. Yet, how humans perceive and…

Human-Computer Interaction · Computer Science 2025-06-17 Bernhard Hilpert , Muhan Hou , Kim Baraka , Joost Broekens

The field of Reinforcement Learning (RL) has garnered increasing attention for its ability of optimizing user retention in recommender systems. A primary obstacle in this optimization process is the environment non-stationarity stemming…

Information Retrieval · Computer Science 2025-02-27 Zhenghai Xue , Qingpeng Cai , Bin Yang , Lantao Hu , Peng Jiang , Kun Gai , Bo An

Aligning agent behaviors with diverse human preferences remains a challenging problem in reinforcement learning (RL), owing to the inherent abstractness and mutability of human preferences. To address these issues, we propose AlignDiff, a…

Artificial Intelligence · Computer Science 2024-02-06 Zibin Dong , Yifu Yuan , Jianye Hao , Fei Ni , Yao Mu , Yan Zheng , Yujing Hu , Tangjie Lv , Changjie Fan , Zhipeng Hu

Reinforcement Learning (RL)-based recommender systems have demonstrated promising performance in meeting user expectations by learning to make accurate next-item recommendations from historical user-item interactions. However, existing…

Information Retrieval · Computer Science 2024-03-26 Jie Wang , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose