English
Related papers

Related papers: Contracting With a Reinforcement Learning Agent by…

200 papers

The problem of controlling multi-agent systems under different models of information sharing among agents has received significant attention in the recent literature. In this paper, we consider a setup where rather than committing to a…

Optimization and Control · Mathematics 2021-04-23 Sagar Sudhakara , Dhruva Kartik , Rahul Jain , Ashutosh Nayyar

The general picture of game theoretic modeling dealt with here is characterized by a set of big players, also referred to as principals or major agents, acting on the background of large pools of small players, the impact of the behavior of…

Optimization and Control · Mathematics 2019-11-12 Vassili N. Kolokoltsov , Oleg A. Malafeyev

This paper seeks to establish a framework for directing a society of simple, specialized, self-interested agents to solve what traditionally are posed as monolithic single-agent sequential decision problems. What makes it challenging to use…

Machine Learning · Computer Science 2020-08-17 Michael Chang , Sidhant Kaushik , S. Matthew Weinberg , Thomas L. Griffiths , Sergey Levine

Critical sectors of human society are progressing toward the adoption of powerful artificial intelligence (AI) agents, which are trained individually on behalf of self-interested principals but deployed in a shared environment. Short of…

Multiagent Systems · Computer Science 2021-12-22 Jiachen Yang , Ethan Wang , Rakshit Trivedi , Tuo Zhao , Hongyuan Zha

Environments with fixed adjustment costs such as transaction costs or \lq menu costs\rq$ $ are widespread within economic systems. The presence of fixed minimal adjustment costs produces adjustment stickiness so that agents must choose a…

Optimization and Control · Mathematics 2019-10-09 David Mguni

In targeted poisoning attacks, an attacker manipulates an agent-environment interaction to force the agent into adopting a policy of interest, called target policy. Prior work has primarily focused on attacks that modify standard MDP…

Machine Learning · Computer Science 2023-02-28 Mohammad Mohammadi , Jonathan Nöther , Debmalya Mandal , Adish Singla , Goran Radanovic

We study the problem of designing autonomous agents that can learn to cooperate effectively with a potentially suboptimal partner while having no access to the joint reward function. This problem is modeled as a cooperative episodic…

Machine Learning · Computer Science 2022-06-14 Thomas Kleine Buening , Anne-Marie George , Christos Dimitrakakis

The hidden-action model provides an optimal sharing rule for situations in which a principal assigns a task to an agent who makes an effort to carry out the task assigned to him. However, the principal can only observe the task outcome but…

General Economics · Economics 2022-10-18 Stephan Leitner , Friederike Wall

Making sophisticated, robust, and safe sequential decisions is at the heart of intelligent systems. This is especially critical for planning in complex multi-agent environments, where agents need to anticipate other agents' intentions and…

Robotics · Computer Science 2020-01-29 Yichuan Charlie Tang

We consider an agent interacting with an environment in a single stream of actions, observations, and rewards, with no reset. This process is not assumed to be a Markov Decision Process (MDP). Rather, the agent has several representations…

Machine Learning · Computer Science 2013-03-19 Odalric-Ambrym Maillard , Phuong Nguyen , Ronald Ortner , Daniil Ryabko

We consider the problem of learning to behave optimally in a Markov Decision Process when a reward function is not specified, but instead we have access to a set of demonstrators of varying performance. We assume the demonstrators are…

Machine Learning · Computer Science 2019-08-01 Pablo Samuel Castro , Shijian Li , Daqing Zhang

In reinforcement learning (RL), an agent learns to perform a task by interacting with an environment and receiving feedback (a numerical reward) for its actions. However, the assumption that rewards are always observable is often not…

Machine Learning · Computer Science 2024-02-15 Simone Parisi , Montaser Mohammedalamen , Alireza Kazemipour , Matthew E. Taylor , Michael Bowling

We study the problem of learning a good set of policies, so that when combined together, they can solve a wide variety of unseen reinforcement learning tasks with no or very little new data. Specifically, we consider the framework of…

Machine Learning · Computer Science 2022-03-16 Safa Alver , Doina Precup

We study a decision-maker's problem of finding optimal monetary incentive schemes for retention when faced with agents whose participation decisions (stochastically) depend on the incentive they receive. Our focus is on policies constrained…

Computer Science and Game Theory · Computer Science 2024-07-31 Daniel Freund , Chamsi Hssaine

Markov Decision Processes (MDPs), the mathematical framework underlying most algorithms in Reinforcement Learning (RL), are often used in a way that wrongfully assumes that the state of an agent's environment does not change during action…

Machine Learning · Computer Science 2019-12-13 Simon Ramstedt , Christopher Pal

We tackle the Online 3D Bin Packing Problem, a challenging yet practically useful variant of the classical Bin Packing Problem. In this problem, the items are delivered to the agent without informing the full sequence information. Agent…

Robotics · Computer Science 2023-06-05 Hang Zhao , Chenyang Zhu , Xin Xu , Hui Huang , Kai Xu

Agents that learn to select optimal actions represent a prominent focus of the sequential decision-making literature. In the face of a complex environment or constraints on time and resources, however, aiming to synthesize such an optimal…

Machine Learning · Computer Science 2021-06-23 Dilip Arumugam , Benjamin Van Roy

We propose a framework for ensuring safe behavior of a reinforcement learning agent when the reward function may be difficult to specify. In order to do this, we rely on the existence of demonstrations from expert policies, and we provide a…

Machine Learning · Computer Science 2018-11-22 Jessie Huang , Fa Wu , Doina Precup , Yang Cai

A rich class of mechanism design problems can be understood as incomplete-information games between a principal who commits to a policy and an agent who responds, with payoffs determined by an unknown state of the world. Traditionally,…

Theoretical Economics · Economics 2020-09-14 Modibo Camara , Jason Hartline , Aleck Johnsen

This article studies the problem of evaluating the information that a Principal lacks when establishing an incentive contract with an Agent whose effort is not observable. The Principal ("she") pays a continuous rent to the Agent ("he"),…

Optimization and Control · Mathematics 2023-04-10 Ishak Hajjej , Caroline Hillairet , Mohamed Mnif