English
Related papers

Related papers: Learning from zero: how to make consumption-saving…

200 papers

Decision-making AI agents are often faced with two important challenges: the depth of the planning horizon, and the branching factor due to having many choices. Hierarchical reinforcement learning methods aim to solve the first problem, by…

Machine Learning · Computer Science 2022-01-25 Andrei Nica , Khimya Khetarpal , Doina Precup

Organisms and ecological groups accumulate evidence to make decisions. Classic experiments and theoretical studies have explored this process when the correct choice is fixed during each trial. However, we live in a constantly changing…

Neurons and Cognition · Quantitative Biology 2015-10-01 Alan Veliz-Cuba , Zachary P. Kilpatrick , Kresimir Josic

When robots share the same workspace with other intelligent agents (e.g., other robots or humans), they must be able to reason about the behaviors of their neighboring agents while accomplishing the designated tasks. In practice,…

Robotics · Computer Science 2022-10-18 Junhong Xu , Durgakant Pushp , Kai Yin , Lantao Liu

Traditional interactive environments limit agents' intelligence growth with fixed tasks. Recently, single-agent environments address this by generating new tasks based on agent actions, enhancing task diversity. We consider the…

Multiagent Systems · Computer Science 2025-01-30 Yizhe Huang , Xingbo Wang , Hao Liu , Fanqi Kong , Aoyang Qin , Min Tang , Song-Chun Zhu , Mingjie Bi , Siyuan Qi , Xue Feng

The role of perception in conscious behavior and decision-making is examined. The effect of spatial and temporal stochasticity in the acquisition of beliefs is discussed. The idea of an agent as a locally strongly coupled group of states…

Adaptation and Self-Organizing Systems · Physics 2009-01-27 Fariel Shafee

In the future, artificial learning agents are likely to become increasingly widespread in our society. They will interact with both other learning agents and humans in a variety of complex settings including social dilemmas. We consider the…

Computer Science and Game Theory · Computer Science 2019-11-21 Tobias Baumann , Thore Graepel , John Shawe-Taylor

When deployed, AI agents will encounter problems that are beyond their autonomous problem-solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We…

Machine Learning · Computer Science 2022-06-24 Khanh Nguyen , Yonatan Bisk , Hal Daumé

In this paper, we describe an integrated framework for autonomous decision making in a dynamic and interactive environment. We model the interactions between the ego agent and its operating environment as a two-player dynamic game, and…

Artificial Intelligence · Computer Science 2019-09-19 Sisi Li , Nan Li , Anouck Girard , Ilya Kolmanovsky

Reinforcement learning is a machine learning approach based on behavioral psychology. It is focused on learning agents that can acquire knowledge and learn to carry out new tasks by interacting with the environment. However, a problem…

Artificial Intelligence · Computer Science 2022-12-15 Hugo Muñoz , Ernesto Portugal , Angel Ayala , Bruno Fernandes , Francisco Cruz

Reinforcement learning algorithms use correlations between policies and rewards to improve agent performance. But in dynamic or sparsely rewarding environments these correlations are often too small, or rewarding events are too infrequent…

Machine Learning · Computer Science 2020-01-23 Sebastien Racaniere , Andrew K. Lampinen , Adam Santoro , David P. Reichert , Vlad Firoiu , Timothy P. Lillicrap

Learning to perform activities through demonstration requires extracting meaningful information about the environment from observations. In this research, we investigate the challenge of planning high-level goal-oriented actions in a…

Machine Learning · Computer Science 2025-07-08 Jing Bi , Chenliang Xu

The human intrinsic desire to pursue knowledge, also known as curiosity, is considered essential in the process of skill acquisition. With the aid of artificial curiosity, we could equip current techniques for control, such as Reinforcement…

Machine Learning · Computer Science 2022-02-24 Pietro Mazzaglia , Ozan Catal , Tim Verbelen , Bart Dhoedt

We consider a model where an agent has a repeated decision to make and wishes to maximize their total payoff. Payoffs are influenced by an action taken by the agent, but also an unknown state of the world that evolves over time. Before…

Computer Science and Game Theory · Computer Science 2021-01-20 Nicole Immorlica , Ian Kash , Brendan Lucier

Seamlessly interacting with humans or robots is hard because these agents are non-stationary. They update their policy in response to the ego agent's behavior, and the ego agent must anticipate these changes to co-adapt. Inspired by humans,…

Robotics · Computer Science 2020-11-16 Annie Xie , Dylan P. Losey , Ryan Tolsma , Chelsea Finn , Dorsa Sadigh

Agents that learn to select optimal actions represent a prominent focus of the sequential decision-making literature. In the face of a complex environment or constraints on time and resources, however, aiming to synthesize such an optimal…

Machine Learning · Computer Science 2021-06-23 Dilip Arumugam , Benjamin Van Roy

We study preference learning through recommendations in multi-agent game settings, where a moderator repeatedly interacts with agents whose utility functions are unknown. In each round, the moderator issues action recommendations and…

Computer Science and Game Theory · Computer Science 2026-03-06 Arwa Alanqary , Zakaria Baba , Manxi Wu , Alexandre M. Bayen

We propose an adaptive incentive mechanism that learns the optimal incentives in environments where players continuously update their strategies. Our mechanism updates incentives based on each player's externality, defined as the difference…

Computer Science and Game Theory · Computer Science 2025-03-04 Chinmay Maheshwari , Kshitij Kulkarni , Manxi Wu , Shankar Sastry

Artificial intelligence systems increasingly involve continual learning to enable flexibility in general situations that are not encountered during system training. Human interaction with autonomous systems is broadly studied, but research…

Motivated by the novel paradigm developed by Van Roy and coauthors for reinforcement learning in arbitrary non-Markovian environments, we propose a related formulation and explicitly pin down the error caused by non-Markovianity of…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Siddharth Chandak , Pratik Shah , Vivek S Borkar , Parth Dodhia

We present an active learning architecture that allows a robot to actively learn which data collection strategy is most efficient for acquiring motor skills to achieve multiple outcomes, and generalise over its experience to achieve new…

Machine Learning · Computer Science 2019-02-18 Sao Mai Nguyen , Pierre-Yves Oudeyer