English
Related papers

Related papers: Dynamic Programming in Probability Spaces via Opti…

200 papers

We introduce an alternative approach for the analysis and numerical approximation of the optimal feedback control mapping. It consists in looking at a typical optimal control problem in such a way that feasible controls are mappings…

Optimization and Control · Mathematics 2017-06-09 Pablo Pedregal

Routing problems are a class of combinatorial problems with many practical applications. Recently, end-to-end deep learning methods have been proposed to learn approximate solution heuristics for such problems. In contrast, classical…

Machine Learning · Computer Science 2021-12-06 Wouter Kool , Herke van Hoof , Joaquim Gromicho , Max Welling

We consider both discrete and continuous "uncertain horizon" deterministic control processes, for which the termination time is a random variable. We examine the dynamic programming equations for the value function of such processes,…

Optimization and Control · Mathematics 2016-01-06 June Andrews , Alexander Vladimirsky

We consider a two-road dynamic routing game where the state of one of the roads (the "risky road") is stochastic and may change over time. This generates room for experimentation. A central planner may wish to induce some of the (finite…

Computer Science and Game Theory · Computer Science 2020-01-13 Emily Meigs , Francesca Parise , Asuman Ozdaglar , Daron Acemoglu

Optimal transport is the problem of designing a joint distribution for two random variables with fixed marginals. In virtually the entire literature on this topic, the objective is to minimize expected cost. This paper is the first to study…

Econometrics · Economics 2026-02-13 Yinchu Zhu , Ilya O. Ryzhov

We prove a Pontryagin Maximum Principle for optimal control problems in the space of probability measures, where the dynamics is given by a transport equation with non-local velocity. We formulate this first-order optimality condition using…

Optimization and Control · Mathematics 2020-02-28 Benoît Bonnet , Francesco Rossi

Optimal mass transport, also known as the earth mover's problem, is an optimization problem with important applications in various disciplines, including economics, probability theory, fluid dynamics, cosmology and geophysics to cite a few.…

Numerical Analysis · Mathematics 2022-06-28 Said Kerrache , Yasushi Nakauchi

The paper extends an impulsive control-theoretical framework towards dynamic systems in the space of measures. We consider a transport equation describing the time-evolution of a conservative "mass" (probability measure), which represents…

Optimization and Control · Mathematics 2020-02-17 Nikolay Pogodaev , Maxim Staritsyn

We use martingale and stochastic analysis techniques to study a continuous-time optimal stopping problem, in which the decision maker uses a dynamic convex risk measure to evaluate future rewards. We also find a saddle point for an…

Probability · Mathematics 2009-11-23 Erhan Bayraktar , Ioannis Karatzas , Song Yao

The paper is devoted to the study of a new class of optimal control problems governed by discontinuous constrained differential inclusions of the sweeping type with involving the duration of the dynamic process into optimization. We develop…

Optimization and Control · Mathematics 2023-10-18 Giovanni Colombo , Boris S. Mordukhovich , Dao Nguyen , Trang Nguyen

This paper studies optimal control problems of unknown linear systems subject to stochastic disturbances of uncertain distribution. Uncertainty about the stochastic disturbances is usually described via ambiguity sets of probability…

Systems and Control · Electrical Eng. & Systems 2023-06-30 Guanru Pan , Timm Faulwasser

This paper presents a computationally efficient model predictive control formulation that uses an integral Chebyshev collocation method to enable rapid operations of autonomous agents. By posing the finite-horizon optimal control problem…

Robotics · Computer Science 2025-03-26 Deep Parikh , Thomas L. Ahrens , Manoranjan Majji

Coordination of dynamical routes can alleviate traffic congestion and is essential for the coming era of autonomous self-driving cars. However, dynamical route coordination is difficult and many existing routing protocols are either static…

Statistical Mechanics · Physics 2019-04-24 Chi Ho Yeung

A method is devised for numerically solving a class of finite-horizon optimal control problems subject to cascade linear discrete-time dynamics. It is assumed that the linear state and input inequality constraints, and the quadratic measure…

Optimization and Control · Mathematics 2017-10-13 Michael Cantoni , Farhad Farokhi , Eric C. Kerrigan , Iman Shames

We analyze a power distribution line with high penetration of distributed generation and strong variations of power consumption and generation levels. In the presence of uncertainty the statistical description of the system is required to…

Optimization and Control · Mathematics 2010-06-02 Konstantin S. Turitsyn

In this work, we propose a novel machine learning approach to compute the optimal transport map between two continuous distributions from their unpaired samples, based on the DeepParticle methods. The proposed method leads to a min-min…

Machine Learning · Statistics 2025-07-01 Yingyuan Li , Aokun Wang , Zhongjian Wang

Probabilistic Logic Programming is an effective formalism for encoding problems characterized by uncertainty. Some of these problems may require the optimization of probability values subject to constraints among probability distributions…

Logic in Computer Science · Computer Science 2023-06-22 Damiano Azzolini , Fabrizio Riguzzi

In this work, we study dynamic programming (DP) algorithms for partially observable Markov decision processes with jointly continuous and discrete state-spaces. We consider a class of stochastic systems which have coupled discrete and…

Optimization and Control · Mathematics 2019-03-07 Donghwan Lee , Niao He , Jianghai Hu

The basic optimal transportation problem consists in finding the most effective way of moving masses from one location to another, while minimizing the transportation cost. Such concept has been found to be useful to understand various…

Computer Science and Game Theory · Computer Science 2011-06-10 Alonso Silva , Hamidou Tembine , Eitan Altman , Merouane Debbah

This article addresses the problem of data-driven numerical optimal control for unknown nonlinear systems. In our scenario, we suppose to have the possibility of performing multiple experiments (or simulations) on the system. Experiments…

Systems and Control · Electrical Eng. & Systems 2025-06-19 Marco Borghesi , Lorenzo Sforni , Giuseppe Notarstefano