中文
相关论文

相关论文: Active Query Selection for Crowd-Based Reinforceme…

200 篇论文

Actively inferring user preferences, for example by asking good questions, is important for any human-facing decision-making system. Active inference allows such systems to adapt and personalize themselves to nuanced individual preferences.…

计算与语言 · 计算机科学 2024-06-27 Wasu Top Piriyakulkij , Volodymyr Kuleshov , Kevin Ellis

Machine learning with artificial neural networks is revolutionizing science. The most advanced challenges require discovering answers autonomously. This is the domain of reinforcement learning, where control strategies are improved…

量子物理 · 物理学 2018-10-03 Thomas Fösel , Petru Tighineanu , Talitha Weiss , Florian Marquardt

In human-in-the-loop reinforcement learning or environments where calculating a reward is expensive, the costly rewards can make learning efficiency challenging to achieve. The cost of obtaining feedback from humans or calculating expensive…

机器学习 · 计算机科学 2025-03-03 Muhammed Yusuf Satici , David L. Roberts

Reinforcement learning (RL) -- algorithms that teach artificial agents to interact with environments by maximising reward signals -- has achieved significant success in recent years. These successes have been facilitated by advances in…

机器学习 · 计算机科学 2025-04-03 Llewyn Salt , Marcus Gallagher

Reinforcement learning (RL) faces challenges in evaluating policy trajectories within intricate game tasks due to the difficulty in designing comprehensive and precise reward functions. This inherent difficulty curtails the broader…

人工智能 · 计算机科学 2024-07-02 Zichao Shen , Tianchen Zhu , Qingyun Sun , Shiqi Gao , Jianxin Li

In the one-class recommendation problem, it's required to make recommendations basing on users' implicit feedback, which is inferred from their action and inaction. Existing works obtain representations of users and items by encoding…

信息检索 · 计算机科学 2024-01-22 Chu-Jen Shao , Hao-Ming Fu , Pu-Jen Cheng

In this paper we investigate the use of model-based reinforcement learning to assist people with Type 1 Diabetes with insulin dose decisions. The proposed architecture consists of multiple Echo State Networks to predict blood glucose levels…

Reinforcement learning agents can learn to solve sequential decision tasks by interacting with the environment. Human knowledge of how to solve these tasks can be incorporated using imitation learning, where the agent learns to imitate…

人工智能 · 计算机科学 2019-09-24 Ruohan Zhang , Faraz Torabi , Lin Guan , Dana H. Ballard , Peter Stone

For sophisticated reinforcement learning (RL) systems to interact usefully with real-world environments, we need to communicate complex goals to these systems. In this work, we explore goals defined in terms of (non-expert) human…

机器学习 · 统计学 2023-02-20 Paul Christiano , Jan Leike , Tom B. Brown , Miljan Martic , Shane Legg , Dario Amodei

Designing an effective reward function has long been a challenge in reinforcement learning, particularly for complex tasks in unstructured environments. To address this, various learning paradigms have emerged that leverage different forms…

机器学习 · 计算机科学 2025-04-29 Muhammad Qasim Elahi , Somtochukwu Oguchienti , Maheed H. Ahmed , Mahsa Ghasemi

The use of interactive advice in reinforcement learning scenarios allows for speeding up the learning process for autonomous agents. Current interactive reinforcement learning research has been limited to real-time interactions that offer…

人工智能 · 计算机科学 2022-10-12 Francisco Cruz , Adam Bignold , Hung Son Nguyen , Richard Dazeley , Peter Vamplew

Preference-based reinforcement learning (PbRL) is emerging as a promising approach to teaching robots through human comparative feedback, sidestepping the need for complex reward engineering. However, the substantial volume of feedback…

机器人学 · 计算机科学 2025-01-09 Ruiqi Wang , Dezhong Zhao , Ziqin Yuan , Ike Obi , Byung-Cheol Min

Active learning from demonstration allows a robot to query a human for specific types of input to achieve efficient learning. Existing work has explored a variety of active query strategies; however, to our knowledge, none of these…

机器学习 · 计算机科学 2019-06-05 Daniel S. Brown , Yuchen Cui , Scott Niekum

Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL methods are able to learn a more flexible reward model based on human preferences by actively incorporating…

机器学习 · 计算机科学 2022-05-26 Xinran Liang , Katherine Shu , Kimin Lee , Pieter Abbeel

A promising approach to improve the robustness and exploration in Reinforcement Learning is collecting human feedback and that way incorporating prior knowledge of the target environment. It is, however, often too expensive to obtain enough…

机器学习 · 计算机科学 2021-11-17 Taku Yamagata , Ryan McConville , Raul Santos-Rodriguez

For summarization, human preference is critical to tame outputs of the summarizer in favor of human interests, as ground-truth summaries are scarce and ambiguous. Practical settings require dynamic exchanges between human and AI agent…

Reward models (RMs) are crucial for the training and inference-time scaling up of large language models (LLMs). However, existing reward models primarily focus on human preferences, neglecting verifiable correctness signals which have shown…

计算与语言 · 计算机科学 2025-02-27 Hao Peng , Yunjia Qi , Xiaozhi Wang , Zijun Yao , Bin Xu , Lei Hou , Juanzi Li

Preference-based reward learning is a popular technique for teaching robots and autonomous systems how a human user wants them to perform a task. Previous works have shown that actively synthesizing preference queries to maximize…

机器人学 · 计算机科学 2024-03-12 Evan Ellis , Gaurav R. Ghosal , Stuart J. Russell , Anca Dragan , Erdem Bıyık

Preference-based Reinforcement Learning (PbRL) methods provide a solution to avoid reward engineering by learning reward models based on human preferences. However, poor feedback- and sample- efficiency still remain the problems that hinder…

机器人学 · 计算机科学 2026-05-22 Hexian Ni , Tao Lu , Haoyuan Hu , Yinghao Cai , Shuo Wang

The design of recommendations strategies in the adaptive learning system focuses on utilizing currently available information to provide individual-specific learning instructions for learners. As a critical motivate for human behaviors,…

计算机与社会 · 计算机科学 2019-10-29 Ruijian Han , Kani Chen , Chunxi Tan