English
Related papers

Related papers: The maximum principle for discrete-time control sy…

200 papers

We consider a team game reward, and we derive a stochastic Pontryagin's maximum principle for distributed stochastic differential systems with decentralized noisy information structures. Our methodology utilizes the semi martingale…

Optimization and Control · Mathematics 2013-04-12 Charalambos D. Charalambous , N. U. Ahmed

We shall consider a stochastic maximum principle of optimal control for a control problem associated with a stochastic partial differential equations of the following type: d x(t) = (A(t) x(t) + a (t, u(t)) x(t) + b(t, u(t)) dt +…

Probability · Mathematics 2012-02-20 AbdulRahman Al-Hussein

We present a Pontryagin maximum principle for discrete time optimal control problems with (a) pointwise constraints on the control actions and the states, (b) frequency constraints on the control and the state trajectories, and (c)…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Shruti Kotpalliwar , Pradyumna Paruchuri , Debasish Chatterjee , Ravi Banavar

A general maximum principle (necessary and sufficient conditions) for an optimal control problem governed by a stochastic differential equation driven by an infinite dimensional martingale is established. The solution of this equation takes…

Probability · Mathematics 2012-03-21 AbdulRahman Al-Hussein

This paper considers a new class of deterministic finite-time horizon, two-player, zero-sum differential games (DGs) in which the maximizing player is allowed to take continuous and impulse controls whereas the minimizing player is allowed…

Optimization and Control · Mathematics 2022-12-21 Brahim El Asri , Hafid Lalioui

In this paper we prove necessary conditions for optimality of a stochastic control problem for a class of stochastic partial differential equations that is controlled through the boundary. This kind of problems can be interpreted as a…

Probability · Mathematics 2016-12-05 Giuseppina Guatteri

In this paper we study a discrete-time semidiscretization and a fully discretization (discrete-time, discrete-state) of an infinite time horizon noncooperative $N$-player differential game. We prove that as either the discretization time…

Optimization and Control · Mathematics 2026-05-12 Javier de Frutos , Víctor Gatón , Julia Novo

We study a control problem where the state equation is a nonlinear partial differential equation of the calculus of variation in a bounded domain, perturbed by noise. We allow the control to act on the boundary and set stochastic boundary…

Probability · Mathematics 2025-11-26 Stefano Bonaccorsi , Adrian Zalinescu

We study time-inconsistent recursive stochastic control problems, i.e., for which the Bellman principle of optimality does not hold. For this class of problems classical optimal controls may fail to exist, or to be relevant in practice, and…

Optimization and Control · Mathematics 2024-03-14 Elisa Mastrogiacomo , Marco Tarsia

We establish a Pontryagin maximum principle for discrete time optimal control problems under the following three types of constraints: a) constraints on the states pointwise in time, b) constraints on the control actions pointwise in time,…

Optimization and Control · Mathematics 2019-05-27 Pradyumna Paruchuri , Debasish Chatterjee

This paper deals with partially-observed optimal control problems for the state governed by stochastic differential equation with delay. We develop a stochastic maximum principle for this kind of optimal control problems using a variational…

Optimization and Control · Mathematics 2020-10-15 Shuaiqi Zhang , Xun Li , Jie Xiong

The paper is devoted to deriving necessary optimality conditions in a general optimal control problem for dynamical systems governed by controlled sweeping processes with hard-constrained control actions entering both polyhedral moving sets…

Optimization and Control · Mathematics 2021-03-17 Tan H. Cao , Giovanni Colombo , Boris S. Mordukhovich , Dao Nguyen

We develop a necessary stochastic maximum principle for a finite-dimensional stochastic control problem in infinite horizon under a polynomial growth and joint monotonicity assumption on the coefficients. The second assumption generalizes…

Probability · Mathematics 2017-03-14 Carlo Orrieri , Petr Veverka

We investigate a stochastic optimal control problem where the controlled system is depicted as a stochastic differential delayed equation; however, at the terminal time, the state is constrained in a convex set. We firstly introduce an…

Probability · Mathematics 2017-05-12 Jiaqiang Wen , Yufeng Shi

We present stability conditions for deterministic time-varying nonlinear discrete-time systems whose inputs aim to minimize an infinite-horizon time-dependent cost. Global asymptotic and exponential stability properties for general…

Systems and Control · Electrical Eng. & Systems 2023-08-28 Sifeddine Benahmed , Romain Postoyan , Mathieu Granzotto , Lucian Buşoniu , Jamal Daafouz , Dragan Nešić

In this paper we develop necessary conditions for optimality, in the form of the stochastic Pontryagin maximum principle, for controlled equation with delay in the state and with control dependent noise, in the general case of controls $u…

Probability · Mathematics 2023-06-14 Giuseppina Guatteri , Federica Masiero

This paper firstly presents the necessary and sufficient conditions for a kind of discrete-time robust stochastic optimal control problem with convex control domains. As it is an "inf sup problem", the classical variational method is…

Optimization and Control · Mathematics 2025-08-26 Wei He

This paper deals with N-person nonzero-sum discrete-time Markov games under a probability criterion, in which the transition probabilities and reward functions are allowed to vary with time. Differing from the existing works on the expected…

Probability · Mathematics 2025-05-16 Xin Guo , Xin Wen

This paper establishes a stochastic maximum principle for optimal control problems governed by time-changed forward-backward stochastic differential equations with L\'evy noise. The system incorporates a random, non-decreasing operational…

Optimization and Control · Mathematics 2026-03-27 Jingwei Chen , Jun Ye , Feng Chen

We reconsider the variational integration of optimal control problems for mechanical systems based on a direct discretization of the Lagrange-d'Alembert principle. This approach yields discrete dynamical constraints which by construction…

Optimization and Control · Mathematics 2012-04-30 C. M. Campos , O. Junge , S. Ober-Blöbaum