English
Related papers

Related papers: Evaluating Agents without Rewards

200 papers

We propose a reinforcement learning agent to solve hard exploration games by learning a range of directed exploratory policies. We construct an episodic memory-based intrinsic reward using k-nearest neighbors over the agent's recent…

Addressing the question of how to achieve optimal decision-making under risk and uncertainty is crucial for enhancing the capabilities of artificial agents that collaborate with or support humans. In this work, we address this question in…

Multiagent Systems · Computer Science 2024-08-02 Nicole Orzan , Erman Acar , Davide Grossi , Patrick Mannion , Roxana Rădulescu

Exploring rich environments and evaluating one's actions without prior knowledge is immensely challenging. In this paper, we propose Motif, a general method to interface such prior knowledge from a Large Language Model (LLM) with an agent.…

Artificial Intelligence · Computer Science 2023-10-03 Martin Klissarov , Pierluca D'Oro , Shagun Sodhani , Roberta Raileanu , Pierre-Luc Bacon , Pascal Vincent , Amy Zhang , Mikael Henaff

An important challenge in reinforcement learning is training agents that can solve a wide variety of tasks. If tasks depend on each other (e.g. needing to learn to walk before learning to run), curriculum learning can speed up learning by…

Traditional reinforcement learning agents learn from experience, past or present, gained through interaction with their environment. Our approach synthesizes experience, without requiring an agent to interact with their environment, by…

Machine Learning · Computer Science 2019-03-01 Chris R. Serrano , Michael A. Warren

I consider motivation and value-alignment in AI systems from the perspective of (constrained) entropy maximization. Though the structures encoding knowledge in any physical system can be understood as energetic constraints, only living…

Neurons and Cognition · Quantitative Biology 2025-08-29 Alex B. Kiefer

In the same way that generative models today conduct most of their training in a self-supervised fashion, how can agentic models conduct their training in a self-supervised fashion, interactively exploring, learning, and preparing to…

Machine Learning · Computer Science 2025-10-21 Kathryn Wantlin , Chongyi Zheng , Benjamin Eysenbach

Human interactions are influenced by emotions, temperament, and affection, often conflicting with individuals' underlying preferences. Without explicit knowledge of those preferences, judging whether behaviour is appropriate becomes…

Computer Science and Game Theory · Computer Science 2025-11-05 Victor Villin , Christos Dimitrakakis

In the realm of multi-agent reinforcement learning, intrinsic motivations have emerged as a pivotal tool for exploration. While the computation of many intrinsic rewards relies on estimating variational posteriors using neural network…

Machine Learning · Computer Science 2023-08-22 Chenghao Li , Tonghan Wang , Chongjie Zhang , Qianchuan Zhao

To handle the sparsity of the extrinsic rewards in reinforcement learning, researchers have proposed intrinsic reward which enables the agent to learn the skills that might come in handy for pursuing the rewards in the future, such as…

Machine Learning · Computer Science 2022-05-31 Chao Chen , Zijian Gao , Kele Xu , Sen Yang , Yiying Li , Bo Ding , Dawei Feng , Huaimin Wang

Biological systems often choose actions without an explicit reward signal, a phenomenon known as intrinsic motivation. The computational principles underlying this behavior remain poorly understood. In this study, we investigate an…

Artificial Intelligence · Computer Science 2023-01-05 Stas Tiomkin , Ilya Nemenman , Daniel Polani , Naftali Tishby

Reinforcement learning is commonly concerned with problems of maximizing accumulated rewards in Markov decision processes. Oftentimes, a certain goal state or a subset of the state space attain maximal reward. In such a case, the…

Artificial Intelligence · Computer Science 2024-08-23 Pavel Osinenko , Grigory Yaremenko , Georgiy Malaniya , Anton Bolychev , Alexander Gepperth

Although there are many approaches to implement intrinsically motivated artificial agents, the combined usage of multiple intrinsic drives remains still a relatively unexplored research area. Specifically, we hypothesize that a mechanism…

Artificial Intelligence · Computer Science 2018-06-19 Ildefons Magrans de Abril , Ryota Kanai

Existing game AI research mainly focuses on enhancing agents' abilities to win games, but this does not inherently make humans have a better experience when collaborating with these agents. For example, agents may dominate the collaboration…

Human-Computer Interaction · Computer Science 2024-01-31 Yiming Gao , Feiyu Liu , Liang Wang , Zhenjie Lian , Dehua Zheng , Weixuan Wang , Wenjin Yang , Siqin Li , Xianliang Wang , Wenhui Chen , Jing Dai , Qiang Fu , Wei Yang , Lanxiao Huang , Wei Liu

In Multi-Goal Reinforcement Learning, an agent learns to achieve multiple goals with a goal-conditioned policy. During learning, the agent first collects the trajectories into a replay buffer, and later these trajectories are selected…

Machine Learning · Computer Science 2020-05-26 Rui Zhao , Xudong Sun , Volker Tresp

In some agent designs like inverse reinforcement learning an agent needs to learn its own reward function. Learning the reward function and optimising for it are typically two different processes, usually performed at different stages. We…

Artificial Intelligence · Computer Science 2020-04-29 Stuart Armstrong , Jan Leike , Laurent Orseau , Shane Legg

Interaction and cooperation with humans are overarching aspirations of artificial intelligence (AI) research. Recent studies demonstrate that AI agents trained with deep reinforcement learning are capable of collaborating with humans. These…

Human-Computer Interaction · Computer Science 2024-05-10 Kevin R. McKee , Xuechunzi Bai , Susan T. Fiske

Finding meaningful and accurate dense rewards is a fundamental task in the field of reinforcement learning (RL) that enables agents to explore environments more efficiently. In traditional RL settings, agents learn optimal policies through…

Artificial Intelligence · Computer Science 2025-12-05 Shuyuan Zhang

Successfully navigating a complex environment to obtain a desired outcome is a difficult task, that up to recently was believed to be capable only by humans. This perception has been broken down over time, especially with the introduction…

Machine Learning · Computer Science 2019-11-12 Joshua Hare

Intelligent agents must pursue their goals in complex environments with partial information and often limited computational capacity. Reinforcement learning methods have achieved great success by creating agents that optimize engineered…

Machine Learning · Computer Science 2021-06-07 Alejandro Daniel Noel , Charel van Hoof , Beren Millidge