English
Related papers

Related papers: Scalable agent alignment via reward modeling: a re…

200 papers

Reinforcement learning involves agents interacting with an environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the quality of actions that they take, thereby…

Multiagent Systems · Computer Science 2022-02-22 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

This paper examines the effect of real-time, personalized alignment of a robot's reward function to the human's values on trust and team performance. We present and compare three distinct robot interaction strategies: a non-learner strategy…

Robotics · Computer Science 2023-11-28 Shreyas Bhat , Joseph B. Lyons , Cong Shi , X. Jessie Yang

As humans interact with autonomous agents to perform increasingly complicated, potentially risky tasks, it is important to be able to efficiently evaluate an agent's performance and correctness. In this paper we formalize and theoretically…

Machine Learning · Computer Science 2021-06-14 Daniel S. Brown , Jordan Schneider , Anca D. Dragan , Scott Niekum

We study the problem of cooperative multi-agent reinforcement learning with a single joint reward signal. This class of learning problems is difficult because of the often large combined action and observation spaces. In the fully…

When training artificial intelligence (AI) to perform tasks, humans often care not only about whether a task is completed but also how it is performed. As AI agents tackle increasingly complex tasks, aligning their behavior with…

Artificial Intelligence · Computer Science 2026-02-24 Zhiqin Qian , Ryan Diaz , Sangwon Seo , Vaibhav Unhelkar

Reinforcement Learning has emerged as a strong alternative to solve optimization tasks efficiently. The use of these algorithms highly depends on the feedback signals provided by the environment in charge of informing about how good (or…

Machine Learning · Computer Science 2022-12-01 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

Balancing game difficulty in video games is a key task to create interesting gaming experiences for players. Mismatching the game difficulty and a player's skill or commitment results in frustration or boredom on the player's side, and…

Artificial Intelligence · Computer Science 2024-08-14 Ronja Fuchs , Robin Gieseke , Alexander Dockhorn

Advanced agentic intelligence is a prerequisite for deploying Large Language Models in practical, real-world applications. Diverse real-world APIs demand precise, robust function-calling intelligence, which needs agents to develop these…

Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered…

Machine Learning · Computer Science 2021-06-07 Alejandro Daniel Noel , Charel van Hoof , Beren Millidge

We consider the problem of robust multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents, mainly those trained in a centralized way, can be brittle because they can adopt policies that…

Multiagent Systems · Computer Science 2020-12-16 T. van der Heiden , C. Salge , E. Gavves , H. van Hoof

Understanding the emergence of cooperation in systems of computational agents is crucial for the development of effective cooperative AI. Interaction among individuals in real-world settings are often sparse and occur within a broad…

Multiagent Systems · Computer Science 2024-01-24 Nicole Orzan , Erman Acar , Davide Grossi , Roxana Rădulescu

We consider the problem of reinforcement learning using function approximation, where the approximating basis can change dynamically while interacting with the environment. A motivation for such an approach is maximizing the value function…

Machine Learning · Computer Science 2010-05-04 Dotan Di Castro , Shie Mannor

Recommender systems (RS) mediate human experience online. Most RS act to optimize metrics that are imperfectly aligned with the best-interest of users but are easy to measure, like ad-clicks and user engagement. This has resulted in a host…

Artificial Intelligence · Computer Science 2022-08-29 Francisco Carvalho

Reward is the driving force for reinforcement-learning agents. This paper is dedicated to understanding the expressivity of reward as a way to capture tasks that we would want an agent to perform. We frame this study around three new…

Machine Learning · Computer Science 2022-01-19 David Abel , Will Dabney , Anna Harutyunyan , Mark K. Ho , Michael L. Littman , Doina Precup , Satinder Singh

While reinforcement learning algorithms provide automated acquisition of optimal policies, practical application of such methods requires a number of design decisions, such as manually designing reward functions that not only define the…

Machine Learning · Computer Science 2022-12-29 Tim G. J. Rudner , Vitchyr H. Pong , Rowan McAllister , Yarin Gal , Sergey Levine

In artificial intelligence, we often specify tasks through a reward function. While this works well in some settings, many tasks are hard to specify this way. In deep reinforcement learning, for example, directly specifying a reward as a…

Machine Learning · Computer Science 2019-08-09 Matthew Rahtz , James Fang , Anca D. Dragan , Dylan Hadfield-Menell

As AI technology advances, research in playing text-based games with agents has becomeprogressively popular. In this paper, a novel approach to agent design and agent learning ispresented with the context of reinforcement learning. A model…

Computation and Language · Computer Science 2025-09-04 Haonan Wang , Mingjia Zhao , Junfeng Sun , Wei Liu

Real-time control for robotics is a popular research area in the reinforcement learning community. Through the use of techniques such as reward shaping, researchers have managed to train online agents across a multitude of domains. Despite…

Robotics · Computer Science 2023-04-21 Mihai Anca , Jonathan D. Thomas , Dabal Pedamonti , Matthew Studley , Mark Hansen

To learn directed behaviors in complex environments, intelligent agents need to optimize objective functions. Various objectives are known for designing artificial agents, including task rewards and intrinsic motivation. However, it is…

Artificial Intelligence · Computer Science 2022-02-15 Danijar Hafner , Pedro A. Ortega , Jimmy Ba , Thomas Parr , Karl Friston , Nicolas Heess

There exist a number of reinforcement learning algorithms which learnby climbing the gradient of expected reward. Their long-runconvergence has been proved, even in partially observableenvironments with non-deterministic actions, and…

Machine Learning · Computer Science 2013-01-14 Lex Weaver , Nigel Tao
‹ Prev 1 8 9 10 Next ›