English
Related papers

Related papers: Optimal control formulation of transition path pro…

200 papers

In this paper, we consider risk-sensitive discounted control problem for continuous-time jump Markov processes taking values in general state space. The transition rates of underlying continuous-time jump Markov processes and the cost rates…

Optimization and Control · Mathematics 2021-04-27 Chandan Pal , Subrata Golui

We propose a numerical method to approximate the value function for the optimal stopping problem of a piecewise deterministic Markov process (PDMP). Our approach is based on quantization of the post jump location---inter-arrival time Markov…

Probability · Mathematics 2016-08-14 Benoîte de Saporta , François Dufour , Karen Gonzalez

Navigating a collision-free and optimal trajectory for a robot is a challenging task, particularly in environments with moving obstacles such as humans. We formulate this problem as a stochastic optimal control problem. Since solving the…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Seyyed Reza Jafari , Anders Hansson , Bo Wahlberg

The paper is devoted to the optimal control of a system with two time-scales, in a regime when the limit equation is not of averaging type but, in the spirit of Wong-Zakai principle, it is a stochastic differential equation for the slow…

Optimization and Control · Mathematics 2024-11-26 Franco Flandoli , Giuseppina Guatteri , Umberto Pappalettera , Gianmario Tessitore

We present some new results on sample path optimality for the ergodic control problem of a class of non-degenerate diffusions controlled through the drift. The hypothesis most often used in the literature to ensure the existence of an a.s.…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis

In this paper, we consider a modified version of the control problem in a model free Markov decision process (MDP) setting with large state and action spaces. The control problem most commonly addressed in the contemporary literature is to…

Artificial Intelligence · Computer Science 2018-02-01 Ajin George Joseph , Shalabh Bhatnagar

Trajectory optimization is a fundamental stochastic optimal control problem. This paper deals with a trajectory optimization approach for dynamical systems subject to measurement noise that can be fitted into linear time-varying stochastic…

Systems and Control · Electrical Eng. & Systems 2021-08-24 Prakash Mallick , Zhiyong Chen

The finite state semi-Markov process is a generalization over the Markov chain in which the sojourn time distribution is any general distribution. In this article we provide a sufficient stochastic maximum principle for the optimal control…

Optimization and Control · Mathematics 2014-07-14 Amogh Deshpande

In this study, we address the central issue of statistical inference for Markov jump processes using discrete time observations. The primary problem at hand is to accurately estimate the infinitesimal generator of a Markov jump process, a…

Methodology · Statistics 2024-12-19 F. Baltazar-Larios , Luz Judith R. Esparza

Many processes in nature such as conformal changes in biomolecules and clusters of interacting particles, genetic switches, mechanical or electromechanical oscillators with added noise, and many others are modeled using stochastic…

Optimization and Control · Mathematics 2023-10-13 Jiaxin Yuan , Amar Shah , Channing Bentz , Maria Cameron

In this paper we present a dynamic programing approach to stochastic optimal control problems with dynamic, time-consistent risk constraints. Constrained stochastic optimal control problems, which naturally arise when one has to consider…

Optimization and Control · Mathematics 2015-11-24 Yin-Lam Chow , Marco Pavone

This paper considers the relaxed version of the transport problem for general nonlinear control systems, where the objective is to design time-varying feedback laws that transport a given initial probability measure to a target probability…

Systems and Control · Computer Science 2018-07-27 Karthik Elamvazhuthi , Piyush Grover , Spring Berman

We propose a method for approximating solutions to optimization problems involving the global stability properties of parameter-dependent continuous-time autonomous dynamical systems. The method relies on an approximation of the…

Optimization and Control · Mathematics 2013-08-12 Péter Koltai , Alexander Volf

This paper examines a Markovian model for the optimal irreversible investment problem of a firm aiming at minimizing total expected costs of production. We model market uncertainty and the cost of investment per unit of production capacity…

Probability · Mathematics 2017-01-10 Tiziano De Angelis , Salvatore Federico , Giorgio Ferrari

In this work, we investigate the optimal control problem for continuous-time Markov decision processes with the random impact of the environment. We provide conditions to show the existence of optimal controls under finite-horizon criteria.…

Optimization and Control · Mathematics 2020-06-23 Jinghai Shao , Kun Zhao

For systems in an externally controllable time-dependent potential, the optimal protocol minimizes the mean work spent in a finite-time transition between two given equilibrium states. For overdamped dynamics which ignores inertia effects,…

Statistical Mechanics · Physics 2008-07-23 Alex Gomez-Marin , Tim Schmiedl , Udo Seifert

We consider stochastic control with discretionary stopping for the drift of a diffusion process over an infinite time horizon. The objective is to choose a control process and a stopping time to minimize the expectation of a convex terminal…

Optimization and Control · Mathematics 2025-06-24 Václav E. Beneš , Georgy Gaitsgori , Ioannis Karatzas

In this paper we prove a necessary condition of the optimal control problem for a class of general mean-field forward-backward stochastic systems with jumps in the case where the diffusion coefficients depend on control, the control set…

Optimization and Control · Mathematics 2019-02-20 Tao Hao , Qingxin Meng

In this work, we focus on an infinite horizon mean-field linear-quadratic stochastic control problem with jumps. Firstly, the infinite horizon linear mean-field stochastic differential equations and backward stochastic differential…

Optimization and Control · Mathematics 2023-11-14 Qingmeng Wei , Yaqi Xu , Zhiyong Yu

This article introduces a formation shape control algorithm, in the optimal control framework, for steering an initial population of agents to a desired configuration via employing the Gromov-Wasserstein distance. The underlying dynamical…

Optimization and Control · Mathematics 2025-03-28 Haruto Nakashima , Siddhartha Ganguly , Kohei Morimoto , Kenji Kashima