English
Related papers

Related papers: Random horizon principal-agent problems

200 papers

Many decision problems in economics, information technology, and industry can be transformed to an optimal stopping of adapted random vectors with some utility function over the set of Markov times with respect to filtration build by the…

Optimization and Control · Mathematics 2020-11-04 Krzysztof Szajowski

Optimal control problems with a very large time horizon can be tackled with the Receding Horizon Control (RHC) method, which consists in solving a sequence of optimal control problems with small prediction horizon. The main result of this…

Optimization and Control · Mathematics 2020-02-03 Tobias Breiten , Laurent Pfeiffer

We present novel techniques for neuro-symbolic concurrent stochastic games, a recently proposed modelling formalism to represent a set of probabilistic agents operating in a continuous-space environment using a combination of neural network…

Computer Science and Game Theory · Computer Science 2022-06-22 Rui Yan , Gabriel Santos , Xiaoming Duan , David Parker , Marta Kwiatkowska

We consider a sequential decision-making problem where an agent can take one action at a time and each action has a stochastic temporal extent, i.e., a new action cannot be taken until the previous one is finished. Upon completion, the…

Machine Learning · Computer Science 2020-03-26 P Sharoff , Nishant A. Mehta , Ravi Ganti

We study a principal-agent team production model. The principal hires a team of agents to participate in a common production task. The exact effort of each agent is unobservable and unverifiable, but the total production outcome (e.g. the…

Computer Science and Game Theory · Computer Science 2025-05-27 Shiliang Zuo

This paper explores continuous-time and state-space optimal stopping problems from a reinforcement learning perspective. We begin by formulating the stopping problem using randomized stopping times, where the decision maker's control is…

Optimization and Control · Mathematics 2026-03-12 Jodi Dianetti , Giorgio Ferrari , Renyuan Xu

This work considers a repeated principal-agent bandit game, where the principal can only interact with her environment through the agent. The principal and the agent have misaligned objectives and the choice of action is only left to the…

The stability analysis of model predictive control schemes without terminal constraints and/or costs has attracted considerable attention during the last years. We pursue a recently proposed approach which can be used to determine a…

Optimization and Control · Mathematics 2014-01-16 Philipp Braun , Jürgen Pannek , Karl Worthmann

We study time-inconsistent recursive stochastic control problems, i.e., for which the Bellman principle of optimality does not hold. For this class of problems classical optimal controls may fail to exist, or to be relevant in practice, and…

Optimization and Control · Mathematics 2024-03-14 Elisa Mastrogiacomo , Marco Tarsia

In this paper, we consider discrete-time partially observed mean-field games with the risk-sensitive optimality criterion. We introduce risk-sensitivity behaviour for each agent via an exponential utility function. In the game model, each…

Systems and Control · Electrical Eng. & Systems 2022-11-11 Naci Saldi , Tamer Basar , Maxim Raginsky

We study a two-period moral hazard problem; there are two agents, with action sets that are unknown to the principal. The principal contracts with each agent sequentially, and seeks to maximize the worst-case discounted sum of payoffs,…

Theoretical Economics · Economics 2024-02-15 Chang Liu

We provide sufficient conditions for the continuity of the free-boundary in a general class of finite-horizon optimal stopping problems arising for instance in finance and economics. The underlying process is a strong solution of one…

Optimization and Control · Mathematics 2013-05-07 Tiziano De Angelis

We consider the problem of Adverse Selection and optimal derivative design within a Principal-Agent framework. The principal's income is exposed to non-hedgeable risk factors arising, for instance, from weather or climate phenomena. She…

Computational Engineering, Finance, and Science · Computer Science 2007-10-31 U. Horst , S. Moreno

Principal agent games are a growing area of research which focuses on the optimal behaviour of a principal and an agent, with the former contracting work from the latter, in return for providing a monetary award. While this field…

Mathematical Finance · Quantitative Finance 2022-06-28 Dena Firoozi , Arvind V Shrivats , Sebastian Jaimungal

This paper investigates the consensus problem of general linear multi-agent systems under the framework of optimization. A novel distributed receding horizon control (RHC) strategy for consensus is proposed. We show that the consensus…

Optimization and Control · Mathematics 2014-06-25 Huiping Li , Weisheng Yan

We investigate constrained optimal control problems for linear stochastic dynamical systems evolving in discrete time. We consider minimization of an expected value cost over a finite horizon. Hard constraints are introduced first, and then…

Optimization and Control · Mathematics 2011-07-07 Eugenio Cinquemani , Mayank Agarwal , Debasish Chatterjee , John Lygeros

In this article, we consider a receding horizon control of discrete-time state-dependent jump linear systems, particular kind of stochastic switching systems, subject to possibly unbounded random disturbances and probabilistic state…

Systems and Control · Computer Science 2014-07-25 Shaikshavali Chitraganti , Samir Aberkane , Christophe Aubrun , Guillermo Valencia-Palomo , Vasile Dragan

Stochastic games are an important class of problems that generalize Markov decision processes to game theoretic scenarios. We consider finite state two-player zero-sum stochastic games over an infinite time horizon with discounted rewards.…

Optimization and Control · Mathematics 2008-06-17 Parikshit Shah , Pablo A. Parrilo

While deep reinforcement learning has achieved tremendous successes in various applications, most existing works only focus on maximizing the expected value of total return and thus ignore its inherent stochasticity. Such stochasticity is…

Machine Learning · Computer Science 2023-09-19 Han Zhong , Xun Deng , Ethan X. Fang , Zhuoran Yang , Zhaoran Wang , Runze Li

The paper describes a receding horizon control design framework for continuous-time stochastic nonlinear systems subject to probabilistic state constraints. The intention is to derive solutions that are implementable in real-time on…

Systems and Control · Computer Science 2012-11-20 Shridhar K. Shah , Herbert G. Tanner , Chetan D. Pahlajani