English
Related papers

Related papers: Discrete-time approximation for stochastic optimal…

200 papers

We consider stochastic optimal control of linear dynamical systems with additive non-Gaussian disturbance. We propose a novel, sampling-free approach, based on Fourier transformations and convex optimization, to cast the stochastic optimal…

Optimization and Control · Mathematics 2020-10-06 Vignesh Sivaramakrishnan , Abraham P. Vinod , Meeko M. K. Oishi

We consider a class of discretionary stopping problems within the $G$-framework. We first establish the well-definedness of the stopping problem under the $G$-expectation, by showing the quasi-continuity of the stopped process. We then…

Probability · Mathematics 2013-05-10 Xin Guo , Chen Pan , Shige Peng

In this paper, we consider a class of time-optimal control problems governed by linear parabolic equations with mixed control-state constraints and end-point constraints, and without Tikhonov regularization term in the objective function.…

Optimization and Control · Mathematics 2025-09-04 Huynh Khanh , Bui Trong Kien

We study methods for solving stochastic control problems of systems of forward-backward mean-field equations with delay, in finite or infinite horizon. Necessary and sufficient maximum principles under partial information are given. The…

Optimization and Control · Mathematics 2016-10-31 Nacira Agram , Elin Engen Rose

In N.V. Krylov, Approximating value functions for controlled degenerate diffusion processes by using piece-wise constant policies, Electron. J. Probab., 4(2), 1999, it is proved under standard assumptions that the value functions of…

Probability · Mathematics 2019-01-07 Espen R. Jakobsen , Athena Picarelli , Christoph Reisinger

The main contributions of this paper are three fold. First, our primary concern is to investigate a class of stochastic recursive delayed control problems which arise naturally with sound backgrounds but have not been well-studied yet. For…

Optimization and Control · Mathematics 2011-12-06 Li Chen , Jianhui Huang

The paper is devoted to the optimal control of a system with two time-scales, in a regime when the limit equation is not of averaging type but, in the spirit of Wong-Zakai principle, it is a stochastic differential equation for the slow…

Optimization and Control · Mathematics 2024-11-26 Franco Flandoli , Giuseppina Guatteri , Umberto Pappalettera , Gianmario Tessitore

An optimal control problem driven by an ordinary differential equation under continuous state constraints is considered in this study. From an operational point of view, we introduce a discrete state constraints optimal control problem and…

Optimization and Control · Mathematics 2018-12-04 Shuzhen Yang

This paper addresses the optimal covariance steering problem for stochastic discrete-time linear systems subject to probabilistic state and control constraints. A method is presented for efficiently attaining the exact solution of the…

Systems and Control · Electrical Eng. & Systems 2023-10-06 George Rapakoulias , Panagiotis Tsiotras

We propose a comprehensive framework for policy gradient methods tailored to continuous time reinforcement learning. This is based on the connection between stochastic control problems and randomised problems, enabling applications across…

Optimization and Control · Mathematics 2024-05-01 Robert Denkert , Huyên Pham , Xavier Warin

In this paper we provide a rigorous mathematical foundation for continuous approximations of a class of systems with piece-wise continuous functions. By using techniques from the theory of differential inclusions, the underlying piece-wise…

Chaotic Dynamics · Physics 2014-08-20 Marius-F. Danca

Discrete-time robust optimal control problems generally take a min-max structure over continuous variable spaces, which can be difficult to solve in practice. In this paper, we extend the class of such problems that can be solved through a…

Optimization and Control · Mathematics 2024-04-30 Jad Wehbeh , Eric C. Kerrigan

Sequential Convex Programming (SCP) has recently gained significant popularity as an effective method for solving optimal control problems and has been successfully applied in several different domains. However, the theoretical analysis of…

Optimization and Control · Mathematics 2022-09-07 Riccardo Bonalli , Thomas Lew , Marco Pavone

Distributionally robust control is a well-studied framework for optimal decision making under uncertainty, with the objective of minimizing an expected cost function over control actions, assuming the most adverse probability distribution…

Systems and Control · Electrical Eng. & Systems 2025-08-12 Alexandros E. Tzikas , Lukas Fiechtner , Arec Jamgochian , Mykel J. Kochenderfer

The main goal of this paper is developing the method of discrete approximations to derive necessary optimality conditions for a class of constrained sweeping processes with nonsmooth perturbations. Optimal control problems for sweeping…

Optimization and Control · Mathematics 2020-05-13 Boris S. Mordukhovich , Dao Nguyen

This paper considers risk-sensitive model predictive control for stochastic systems with a decision-dependent distribution. This class of systems is commonly found in human-robot interaction scenarios. We derive computationally tractable…

Optimization and Control · Mathematics 2025-06-02 Renzi Wang , Mathijs Schuurmans , Panagiotis Patrinos

This paper develops a unified methodology for probabilistic analysis and optimal control design for jump diffusion processes defined by polynomials. For such systems, the evolution of the moments of the state can be described via a system…

Optimization and Control · Mathematics 2017-02-03 Andrew Lamperski , Khem Raj Ghusinga , Abhyudai Singh

In this paper, we propose stochastic structure-preserving schemes to compute the effective diffusivity for particles moving in random flows. We first introduce the motion of particles using the Lagrangian formulation, which is modeled by…

Numerical Analysis · Mathematics 2020-08-24 Junlong Lyu , Zhongjian Wang , Jack Xin , Zhiwen Zhang

In this paper, the optimal strong error estimates for stochastic parabolic optimal control problem with additive noise and integral state constraint are derived based on time-implicit and finite element discretization. The continuous and…

Optimization and Control · Mathematics 2025-05-13 Qiming Wang , Wanfang Shen , Wenbin Liu

We provide an overview on how to use the measurable selection techniques to derive the dynamic programming principle for a general stochastic optimal control/stopping problem. By considering its martingale problem formulation on the…

Optimization and Control · Mathematics 2024-10-03 Nicole El Karoui , Xiaolu Tan