English
Related papers

Related papers: Control problems on infinite horizon subject to ti…

200 papers

We study optimal control of Markov processes with age-dependent transition rates. The control policy is chosen continuously over time based on the state of the process and its age. We study infinite horizon discounted cost and infinite…

Optimization and Control · Mathematics 2014-09-16 Mrinal K. Ghosh , Subhamay Saha

We consider deterministic infinite horizon optimal control problems with nonnegative stage costs. We draw inspiration from learning model predictive control scheme designed for continuous dynamics and iterative tasks, and propose a rollout…

Optimization and Control · Mathematics 2021-09-30 Yuchao Li , Karl H. Johansson , Jonas Mårtensson , Dimitri P. Bertsekas

This note re-visits the rolling-horizon control approach to the problem of a Markov decision process (MDP) with infinite-horizon discounted expected reward criterion. Distinguished from the classical value-iteration approach, we develop an…

Optimization and Control · Mathematics 2022-06-07 Hyeong Soo Chang

In this paper we give feedback laws for a class of parametrized infinite horizon control problems under state constraints. We provide a two-player representation assuming time dependent dynamics and Lagrangian and the set constraints merely…

Optimization and Control · Mathematics 2020-03-03 Vincenzo Basco , Peter M. Dower

This paper is concerned with a discounted stochastic optimal control problem for regime switching diffusion in an infinite horizon. First, as a preliminary with particular interests in its own right, the global well-posedness of infinite…

Optimization and Control · Mathematics 2026-02-06 Kai Ding , Xun Li , Siyu Lv , Xin Zhang

Predictive control is frequently used for control problems involving constraints. Being an optimization based technique utilizing a user specified so-called stage cost, performance properties, i.e., bounds on the infinite horizon…

Systems and Control · Electrical Eng. & Systems 2022-09-09 Lukas Beckenbach , Stefan Streif

We propose a Model Predictive Control (MPC) with a single-step prediction horizon to approximate the solution of infinite horizon optimal control problems with the expected sum of convex stage costs for constrained linear uncertain systems.…

Optimization and Control · Mathematics 2025-04-24 Eunhyek Joa , Francesco Borrelli

The naive application of Reinforcement Learning algorithms to continuous control problems -- such as locomotion and manipulation -- often results in policies which rely on high-amplitude, high-frequency control signals, known colloquially…

Robotics · Computer Science 2019-02-14 Steven Bohez , Abbas Abdolmaleki , Michael Neunert , Jonas Buchli , Nicolas Heess , Raia Hadsell

We consider the linear quadratic Gaussian control problem with a discounted cost functional for descriptor systems on the infinite time horizon. Based on recent results from the deterministic framework, we characterize the feasibility of…

Optimization and Control · Mathematics 2020-04-21 Hermann Mena , Lena-Maria Pfurtscheller , Matthias Voigt

We present a dynamic programming-based solution to a stochastic optimal control problem up to a hitting time for a discrete-time Markov control process. Firstly, we determine an optimal control policy to steer the process toward a compact…

Optimization and Control · Mathematics 2009-09-28 Debasish Chatterjee , Eugenio Cinquemani , Giorgos Chaloulos , John Lygeros

This paper characterizes the solution to a finite horizon min-max optimal control problem where the system is linear and discrete-time with control and state constraints, and the cost quadratic; the disturbance is negatively costed, as in…

Optimization and Control · Mathematics 2017-10-13 D. Q. Mayne , S. V. Rakovic , R. B. Vinter , E. C. Kerrigan

We consider the Lagrange problem of optimal control with unrestricted controls and address the question: under what conditions we can assure optimal controls are bounded? This question is related to the one of Lipschitzian regularity of…

Optimization and Control · Mathematics 2007-05-23 Delfim F. M. Torres

Optimality conditions in the form of a variational inequality are proved for a class of constrained optimal control problems of stochastic differential equations. The cost function and the inequality constraints are functions of the…

Optimization and Control · Mathematics 2018-02-13 Laurent Pfeiffer

We revisit the linear programming approach to deterministic, continuous time, infinite horizon discounted optimal control problems. In the first part, we relax the original problem to an infinite-dimensional linear program over a measure…

Optimization and Control · Mathematics 2017-06-08 Angeliki Kamoutsi , Tobias Sutter , Peyman Mohajerin Esfahani , John Lygeros

This paper investigates the necessary optimality conditions for uniformly overtaking optimal control on infinite horizon in the free end case. %with free right endpoint. In the papers of S.M.Aseev, A.V.Kryazhimskii, V.M.Veliov, K.O.Besov…

Optimization and Control · Mathematics 2012-07-24 Dmitry Khlopin

This paper addresses an open problem in the area of linear quadratic optimal control. We consider the regular, infinite-horizon, stability-modulo-a-subspace, indefinite linear quadratic problem under the assumption that the dynamics are…

Optimization and Control · Mathematics 2019-05-03 Marijan Vukosavljev , Angela P. Schoellig , Mireille E. Broucke

We investigate a limit value of an optimal control problem when the horizon converges to infinity. For this aim, we suppose suitable nonexpansive-like assumptions which does not imply that the limit is independent of the initial state as it…

Optimization and Control · Mathematics 2009-10-21 Marc Quincampoix , Jérôme Renault

We study global optimization of non-convex functions through optimal control theory. Our main result establishes that (quasi-)optimal trajectories of a discounted control problem converge globally and practically asymptotically to the set…

Optimization and Control · Mathematics 2025-11-17 Yuyang Huang , Dante Kalise , Hicham Kouhkouh

For an infinite-horizon continuous-time optimal stopping problem under non-exponential discounting, we look for an optimal equilibrium, which generates larger values than any other equilibrium does on the entire state space. When the…

Optimization and Control · Mathematics 2021-07-15 Yu-Jui Huang , Zhou Zhou

We study infinite horizon control of continuous-time non-linear branching processes with almost sure extinction for general (positive or negative) discount. Our main goal is to study the link between infinite horizon control of these…

Probability · Mathematics 2016-07-28 Julien Claisse , Nicolas Champagnat