English
Related papers

Related papers: Discrete time McKean-Vlasov control problem: a dyn…

200 papers

In this paper, we study the optimal control of a discrete-time stochastic differential equation (SDE) of mean-field type, where the coefficients can depend on both a function of the law and the state of the process. We establish a new…

Optimization and Control · Mathematics 2022-10-05 Arzu Ahmadova , Nazim I. Mahmudov

We consider the control of McKean-Vlasov dynamics (or mean-field control) with probabilistic state constraints. We rely on a level-set approach which provides a representation of the constrained problem in terms of an unconstrained one with…

Optimization and Control · Mathematics 2022-11-03 Maximilien Germain , Huyên Pham , Xavier Warin

We consider covariance control problems for nonlinear stochastic systems. Our objective is to find an optimal control strategy to steer the state from an initial distribution to a terminal one with specified mean and covariance. This…

Systems and Control · Electrical Eng. & Systems 2019-11-22 Zeji Yi , Zhefeng Cao , Evangelos Theodorou , Yongxin Chen

In this paper, we consider a discrete-time stochastic control problem with uncertain initial and target states. We first discuss the connection between optimal transport and stochastic control problems of this form. Next, we formulate a…

We propose a simple and original approach for solving linear-quadratic mean-field stochastic control problems. We study both finite-horizon and infinite-horizon problems, and allow notably some coefficients to be stochastic. Our method is…

Probability · Mathematics 2017-11-28 Matteo Basei , Huyên Pham

This paper is concerned with a discrete-time mean-field stochastic linear-quadratic optimal control problem arose from financial application. Through matrix dynamical optimization method, a group of linear feedback controls is investigated.…

Optimization and Control · Mathematics 2017-06-15 Xun Li , Allen H. Tai , Fei Tian

We analyze a stochastic optimal control problem, where the state process follows a McKean-Vlasov dynamics and the diffusion coefficient can be degenerate. We prove that its value function V admits a nonlinear Feynman-Kac representation in…

Probability · Mathematics 2016-11-15 Erhan Bayraktar , Andrea Cosso , Huyên Pham

The minimum-time control problem consists in finding a control policy that will drive a given dynamic system from a given initial state to a given target state (or a set of states) as quickly as possible. This is a well-known challenging…

Systems and Control · Computer Science 2015-03-19 Laurent Bako , Dulin Chen , Stéphane Lecoeuche

Multi-agent reinforcement learning methods have shown remarkable potential in solving complex multi-agent problems but mostly lack theoretical guarantees. Recently, mean field control and mean field games have been established as a…

Machine Learning · Computer Science 2021-12-20 Kai Cui , Anam Tahir , Mark Sinzger , Heinz Koeppl

Dual control denotes a class of control problems where the parameters governing the system are imperfectly known. The challenge is to find the optimal balance between probing, i.e. exciting the system to understand it more, and caution,…

Optimization and Control · Mathematics 2020-04-29 Martin Péron , Christopher M. Baker , Barry D. Hughes , Iadine Chadès

We study methods for solving stochastic control problems of systems of forward-backward mean-field equations with delay, in finite or infinite horizon. Necessary and sufficient maximum principles under partial information are given. The…

Optimization and Control · Mathematics 2016-10-31 Nacira Agram , Elin Engen Rose

We propose two numerical methods for the optimal control of McKean-Vlasov dynamics in finite time horizon. Both methods are based on the introduction of a suitable loss function defined over the parameters of a neural network. This allows…

Optimization and Control · Mathematics 2021-03-31 René Carmona , Mathieu Laurière

This paper studies the problem of steering the distribution of a discrete-time dynamical system from an initial distribution to a target distribution in finite time. The formulation is fully nonlinear, allowing the use of general control…

Systems and Control · Electrical Eng. & Systems 2024-09-05 George Rapakoulias , Panagiotis Tsiotras

The classical dynamic programming-based optimal stochastic control methods fail to cope with nonseparable dynamic optimization problems as the principle of optimality no longer applies in such situations. Among these notorious nonseparable…

Portfolio Management · Quantitative Finance 2013-03-06 Xiangyu Cui , Xun Li , Duan Li

This paper is devoted to the numerical resolution of McKean-Vlasov control problems via the class of mean-field neural networks introduced in our companion paper [25] in order to learn the solution on the Wasserstein space. We propose…

Optimization and Control · Mathematics 2024-03-20 Huyên Pham , Xavier Warin

The optimal control of epidemic-like stochastic processes is important both historically and for emerging applications today, where it can be especially important to include time-varying parameters that impact viral epidemic-like…

Optimization and Control · Mathematics 2017-10-02 Yingdong Lu , Mark S. Squillante , Chai Wah Wu

A discrete-time method for solving problems in optimal quantum control is presented. Controlling the time discretized markovian dynamics of a quantum system can be reduced to a Markov-decision process. We demonstrate this method in this…

Quantum Physics · Physics 2012-06-05 Jon R. Grice , David A. Meyer

We study a discrete-time portfolio selection problem with partial information and maxi\-mum drawdown constraint. Drift uncertainty in the multidimensional framework is modeled by a prior probability distribution. In this Bayesian framework,…

Portfolio Management · Quantitative Finance 2020-11-02 Carmine De Franco , Johann Nicolle , Huyên Pham

Time change is a powerful technique for generating noises and providing flexible models. In the framework of time changed Brownian and Poisson random measures we study the existence and uniqueness of a solution to a general mean-field…

Probability · Mathematics 2016-08-23 Giulia Di Nunno , Hannes Haferkorn

We consider a general class of mean field control problems described by stochastic delayed differential equations of McKean-Vlasov type. Two numerical algorithms are provided based on deep learning techniques, one is to directly…

Optimization and Control · Mathematics 2019-10-10 Jean-Pierre Fouque , Zhaoyu Zhang