中文
相关论文

相关论文: CANDERE-COACH: Reinforcement Learning from Noisy F…

200 篇论文

This paper addresses the problem of multiclass classification with corrupted or noisy bandit feedback. In this setting, the learner may not receive true feedback. Instead, it receives feedback that has been flipped with some non-zero…

机器学习 · 计算机科学 2021-06-08 Mudit Agarwal , Naresh Manwani

Deep reinforcement learning agents have achieved state-of-the-art results by directly maximising cumulative reward. However, environments contain a much wider variety of possible training signals. In this paper, we introduce an agent that…

Current reinforcement learning algorithms train an agent using forward-generated trajectories, which provide little guidance so that the agent can explore as much as possible. While realizing the value of reinforcement learning results from…

人工智能 · 计算机科学 2023-09-06 KyungMin Ko

Reinforcement learning (RL) is crucial for data science decision-making but suffers from sample inefficiency, particularly in real-world scenarios with costly physical interactions. This paper introduces a novel human-inspired framework to…

机器学习 · 计算机科学 2024-03-13 Ali Beikmohammadi , Sindri Magnússon

Model-free reinforcement learning (RL) is inherently a reactive method, operating under the assumption that it starts with no prior knowledge of the system and entirely depends on trial-and-error for learning. This approach faces several…

Human guidance has emerged as a powerful tool for enhancing reinforcement learning (RL). However, conventional forms of guidance such as demonstrations or binary scalar feedback can be challenging to collect or have low information content,…

机器人学 · 计算机科学 2025-07-08 Giulio Schiavi , Andrei Cramariuc , Lionel Ott , Roland Siegwart

Deep reinforcement learning can learn effective policies for a wide range of tasks, but is notoriously difficult to use due to instability and sensitivity to hyperparameters. The reasons for this remain unclear. When using standard…

机器学习 · 计算机科学 2020-03-17 Aviral Kumar , Abhishek Gupta , Sergey Levine

Extrinsic rewards can effectively guide reinforcement learning (RL) agents in specific tasks. However, extrinsic rewards frequently fall short in complex environments due to the significant human effort needed for their design and…

机器学习 · 计算机科学 2025-04-28 Mingqi Yuan , Roger Creus Castanyer , Bo Li , Xin Jin , Wenjun Zeng , Glen Berseth

Offline reinforcement learning (RL) is an effective tool for real-world recommender systems with its capacity to model the dynamic interest of users and its interactive nature. Most existing offline RL recommender systems focus on…

信息检索 · 计算机科学 2025-05-13 Yi Zhang , Ruihong Qiu , Jiajun Liu , Sen Wang

In many reinforcement learning (RL) problems, it takes some time until a taken action by the agent reaches its maximum effect on the environment and consequently the agent receives the reward corresponding to that action by a delay called…

机器学习 · 计算机科学 2020-10-30 Hamid Radmard Rahmani , Carsten Koenke , Marco A. Wiering

Residual reinforcement learning (RL) has been proposed as a way to solve challenging robotic tasks by adapting control actions from a conventional feedback controller to maximize a reward signal. We extend the residual formulation to learn…

机器学习 · 计算机科学 2021-06-16 Minttu Alakuijala , Gabriel Dulac-Arnold , Julien Mairal , Jean Ponce , Cordelia Schmid

Reinforcement learning (RL) has shown great promise with algorithms learning in environments with large state and action spaces purely from scalar reward signals. A crucial challenge for current deep RL algorithms is that they require a…

机器学习 · 计算机科学 2023-11-23 Shivakanth Sujit , Pedro H. M. Braga , Jorg Bornschein , Samira Ebrahimi Kahou

This study investigates a counterintuitive phenomenon in adversarial machine learning: the potential for noise-based defenses to inadvertently aid evasion attacks in certain scenarios. While randomness is often employed as a defensive…

密码学与安全 · 计算机科学 2024-11-01 Steve Bakos , Pooria Madani , Heidar Davoudi

Reinforcement Learning from Human Feedback (RLHF) has become the standard approach for aligning Large Language Models (LLMs) with human preferences, allowing LLMs to demonstrate remarkable abilities in various tasks. Existing methods work…

Interactive reinforcement learning can effectively facilitate the agent training via human feedback. However, such methods often require the human teacher to know what is the correct action that the agent should take. In other words, if the…

机器学习 · 计算机科学 2022-10-18 Zhaori Guo , Timothy J. Norman , Enrico H. Gerding

Reinforcement learning (RL) has shown promise for decision-making tasks in real-world applications. One practical framework involves training parameterized policy models from an offline dataset and subsequently deploying them in an online…

机器学习 · 计算机科学 2023-03-14 Ziniu Li , Ke Xu , Liu Liu , Lanqing Li , Deheng Ye , Peilin Zhao

Inverse reinforcement learning (IRL) is the problem of learning the preferences of an agent from the observations of its behavior on a task. While this problem has been well investigated, the related problem of {\em online} IRL---where the…

机器学习 · 计算机科学 2020-11-19 Saurabh Arora , Prashant Doshi , Bikramjit Banerjee

We introduce a control-tutored reinforcement learning (CTRL) algorithm. The idea is to enhance tabular learning algorithms by means of a control strategy with limited knowledge of the system model. By tutoring the learning process, the…

最优化与控制 · 数学 2022-04-14 Francesco De Lellis , Giovanni Russo , Mario di Bernardo

Deep reinforcement learning (RL) methods have significant potential for dialogue policy optimisation. However, they suffer from a poor performance in the early stages of learning. This is especially problematic for on-line learning with…

计算与语言 · 计算机科学 2017-07-06 Pei-Hao Su , Pawel Budzianowski , Stefan Ultes , Milica Gasic , Steve Young

Recent advancements in \textit{Learning from Human Feedback} present an effective way to train robot agents via inputs from non-expert humans, without a need for a specially designed reward function. However, this approach needs a human to…

机器人学 · 计算机科学 2020-08-12 Zizhao Wang , Junyao Shi , Iretiayo Akinola , Peter Allen