English
Related papers

Related papers: Stochastic Principal-Agent Problems: Efficient Com…

200 papers

We study the principal-agent problem with a third party that we call social planner, whose responsibility is to reconcile the conflicts of interest between the two players and induce socially optimal outcome in terms of some given social…

Computer Science and Game Theory · Computer Science 2024-11-07 Shiyun Lin , Zhihua Zhang

Autonomous agents operating in continuous environments must decide not only what to do, but when to act. We introduce a lightweight adaptive temporal control system that learns the optimal interval between cognitive ticks from experience,…

Machine Learning · Computer Science 2026-03-27 Davide Di Gioia

We study a dynamic stopping game between a principal and an agent. The agent is privately informed about his type. The principal learns about the agent's type from a noisy performance measure, which can be manipulated by the agent via a…

Theoretical Economics · Economics 2021-08-03 Mehmet Ekmekci , Leandro Gorno , Lucas Maestri , Jian Sun , Dong Wei

This paper considers social learning amongst rational agents (for example, sensors in a network). We consider three models of social learning in increasing order of sophistication. In the first model, based on its private observation of a…

Information Theory · Computer Science 2011-05-17 Vikram Krishnamurthy

This paper studies delegation in a model of discrete choice. In the delegation problem, an uninformed principal must consult an informed agent to make a decision. Both the agent and principal have preferences over the decided-upon action…

Computer Science and Game Theory · Computer Science 2024-06-25 Ali Khodabakhsh , Emmanouil Pountourakis , Samuel Taggart

This work develops effective distributed strategies for the solution of constrained multi-agent stochastic optimization problems with coupled parameters across the agents. In this formulation, each agent is influenced by only a subset of…

Optimization and Control · Mathematics 2019-03-15 Sulaiman A. Alghunaim , Ali H. Sayed

Covert planning refers to a class of constrained planning problems where an agent aims to accomplish a task with minimal information leaked to a passive observer to avoid detection. However, existing methods of covert planning often…

Multiagent Systems · Computer Science 2023-11-02 Haoxiang Ma , Chongyang Shi , Shuo Han , Michael R. Dorothy , Jie Fu

Seamlessly interacting with humans or robots is hard because these agents are non-stationary. They update their policy in response to the ego agent's behavior, and the ego agent must anticipate these changes to co-adapt. Inspired by humans,…

Robotics · Computer Science 2020-11-16 Annie Xie , Dylan P. Losey , Ryan Tolsma , Chelsea Finn , Dorsa Sadigh

We introduce a methodology for efficiently computing a lower bound to empowerment, allowing it to be used as an unsupervised cost function for policy learning in real-time control. Empowerment, being the channel capacity between actions and…

This paper reconsiders the problem of the absent-minded driver who must choose between alternatives with different payoff with imperfect recall and varying degrees of knowledge of the system. The classical absent-minded driver problem…

Artificial Intelligence · Computer Science 2017-02-21 Subhash Kak

This report investigates the optimal design of event-triggered estimation for first-order linear stochastic systems. The problem is posed as a two-player team problem with a partially nested information pattern. The two players are given by…

Optimization and Control · Mathematics 2012-03-23 Adam Molin , Sandra Hirche

Learning an agent model that behaves like humans-capable of jointly perceiving the environment, predicting the future, and taking actions from a first-person perspective-is a fundamental challenge in computer vision. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Lu Chen , Yizhou Wang , Shixiang Tang , Qianhong Ma , Tong He , Wanli Ouyang , Xiaowei Zhou , Hujun Bao , Sida Peng

In many settings of interest, a policy is set by one party, the leader, in order to influence the action of another party, the follower, where the follower's response is determined by some private information. A natural question to ask is,…

Computer Science and Game Theory · Computer Science 2025-04-23 Michael Albert , Quinlan Dawkins , Minbiao Han , Haifeng Xu

We examine online safe multi-agent reinforcement learning using constrained Markov games in which agents compete by maximizing their expected total rewards under a constraint on expected total utilities. Our focus is confined to an episodic…

Machine Learning · Computer Science 2023-06-02 Dongsheng Ding , Xiaohan Wei , Zhuoran Yang , Zhaoran Wang , Mihailo R. Jovanović

Problem definition: Supply chains are constantly evolving networks. Reinforcement learning is increasingly proposed as a solution to provide optimal control of these networks. Academic/practical: However, learning in continuously varying…

Systems and Control · Electrical Eng. & Systems 2023-12-27 Wan Wang , Haiyan Wang , Adam J. Sobey

The main challenge of multiagent reinforcement learning is the difficulty of learning useful policies in the presence of other simultaneously learning agents whose changing behaviors jointly affect the environment's transition and reward…

We study Reinforcement Learning for partially observable dynamical systems using function approximation. We propose a new \textit{Partially Observable Bilinear Actor-Critic framework}, that is general enough to include models such as…

Machine Learning · Computer Science 2022-06-27 Masatoshi Uehara , Ayush Sekhari , Jason D. Lee , Nathan Kallus , Wen Sun

We study decentralized equilibrium selection in stochastic games under severe information and communication constraints. In such settings, convergence to equilibrium alone is insufficient, as stochastic games typically admit many equilibria…

Computer Science and Game Theory · Computer Science 2026-02-16 Seref Taha Kiremitci , Ahmed Said Donmez , Muhammed O. Sayin

We consider a sequential decision making problem where the agent faces the environment characterized by the stochastic discrete events and seeks an optimal intervention policy such that its long-term reward is maximized. This problem exists…

Machine Learning · Computer Science 2022-12-29 Chao Qu , Xiaoyu Tan , Siqiao Xue , Xiaoming Shi , James Zhang , Hongyuan Mei

In this paper we propose a framework towards achieving two intertwined objectives: (i) equipping reinforcement learning with active exploration and deliberate information gathering, such that it regulates state and parameter uncertainties…

Machine Learning · Computer Science 2024-09-10 Mohammad S. Ramadan , Mahmoud A. Hayajnh , Michael T. Tolley , Kyriakos G. Vamvoudakis