English
Related papers

Related papers: Stochastic Approximation for Nonlinear Discrete St…

200 papers

The paper deals with the problem of the sampled data feedback stabilization for autonomous nonlinear systems. The corresponding results extend those obtained in earlier works by the same authors. The sufficient conditions we establish are…

Optimization and Control · Mathematics 2023-07-24 John Tsinias , Dionysis Theodosis

Stochastic Approximation (SA) is a popular approach for solving fixed-point equations where the information is corrupted by noise. In this paper, we consider an SA involving a contraction mapping with respect to an arbitrary norm, and show…

Machine Learning · Computer Science 2021-07-01 Zaiwei Chen , Siva Theja Maguluri , Sanjay Shakkottai , Karthikeyan Shanmugam

We study stochastic optimal control problems for (possibly degenerate) McKean-Vlasov controlled diffusions and obtain discrete-time as well as finite interacting particle approximations. (i) Under mild assumptions, we first prove the…

Optimization and Control · Mathematics 2025-10-27 Somnath Pradhan , Serdar Yuksel

This paper investigates the finite-time adaptive fuzzy tracking control problem for a class of pure-feedback system with full-state constraints. With the help of Mean-Value Theorem, the pure-feedback nonlinear system is transformed into…

Systems and Control · Electrical Eng. & Systems 2024-12-31 Ju Wu , Tong Wang , Min Ma

This article presents a constrained policy optimization approach for the optimal control of systems under nonstationary uncertainties. We introduce an assumption that we call Markov embeddability that allows us to cast the stochastic…

Optimization and Control · Mathematics 2026-05-11 Sungho Shin , François Pacaud , Emil Contantinescu , Mihai Anitescu

We present existence and discrete-time approximation results on optimal control policies for continuous-time stochastic control problems under a variety of information structures. These include fully observed models, partially observed…

Optimization and Control · Mathematics 2025-03-13 Somnath Pradhan , Serdar Yüksel

Control Lyapunov function is a central tool in stabilization. It generalizes an abstract energy function -- a Lyapunov function -- to the case of controlled systems. It is a known fact that most control Lyapunov functions are non-smooth --…

Optimization and Control · Mathematics 2022-11-08 Pavel Osinenko , Grigory Yaremenko , Georgiy Malaniya

This paper presents an algorithm to apply nonlinear control design approaches in the case of stochastic systems with partial state observation. Deterministic nonlinear control approaches are formulated under the assumption of full state…

Systems and Control · Electrical Eng. & Systems 2023-09-19 Mohammad S. Ramadan , Mohammad Alsuwaidan , Ahmed Atallah , Sylvia Herbert

Stochastic dynamical systems are fundamental in state estimation, system identification and control. System models are often provided in continuous time, while a major part of the applied theory is developed for discrete-time systems.…

Dynamical Systems · Mathematics 2014-02-07 Niklas Wahlström , Patrix Axelsson , Fredrik Gustafsson

For mechanical systems we present a controller able to track an unknown smooth signal, converging in finite time and by means of a continuous control signal. The control scheme is insensitive against unknown perturbations with bounded…

Systems and Control · Computer Science 2015-12-01 Jaime A. Moreno

A new formulation of Stochastic Model Predictive Output Feedback Control is presented and analyzed as a translation of Stochastic Optimal Output Feedback Control into a receding horizon setting. This requires lifting the design into a…

Optimization and Control · Mathematics 2020-05-01 Martin A Sehr , Robert R Bitmead

Despite its popularity in the reinforcement learning community, a provably convergent policy gradient method for continuous space-time control problems with nonlinear state dynamics has been elusive. This paper proposes proximal gradient…

Optimization and Control · Mathematics 2022-12-27 Christoph Reisinger , Wolfgang Stockinger , Yufei Zhang

Model Predictive Control (MPC) is well understood in the deterministic setting, yet rigorous stability and performance guarantees for stochastic MPC remain limited to the consideration of terminal constraints and penalties. In contrast,…

Optimization and Control · Mathematics 2025-10-24 Jonas Schießl , Hannah Selder , Ruchuan Ou , Michael Heinrich Baumann , Timm Faulwasser , Lars Grüne

This paper extends the deterministic Lyapunov-based stabilization framework to random hyperbolic systems of conservation laws, where uncertainties arise in boundary controls and initial data. Building on the finite volume discretization…

Numerical Analysis · Mathematics 2025-10-10 Shaoshuai Chu , Michael Herty , Alexander Kurganov

This survey paper deals with the stabilization of nonlinear systems by analyzing the controlling method in terms of state feedback and output feedback. A brief overview of some literature on how the feedback controller of some dynamic…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Demelash Abiye Deguale

We explicitly construct global strict Lyapunov functions for rapidly time-varying nonlinear control systems. The Lyapunov functions we construct are expressed in terms of oftentimes more readily available Lyapunov functions for the limiting…

Optimization and Control · Mathematics 2007-05-23 Frederic Mazenc , Michael Malisoff , Marcio S. de Queiroz

A boundary feedback stabilisation problem of non-uniform linear hyperbolic systems of balance laws with additive disturbance is discussed. A continuous and a corresponding discrete Lyapunov function is defined. Using an…

Optimization and Control · Mathematics 2020-06-09 Mapundi Kondwani Banda , Gediyon Weldegiyorgis

This paper is concerned with the problem of Model Predictive Control and Rolling Horizon Control of discrete-time systems subject to possibly unbounded random noise inputs, while satisfying hard bounds on the control inputs. We use a…

Optimization and Control · Mathematics 2010-09-08 Peter Hokayem , Debasish Chatterjee , John Lygeros

In this work, we develop a method based on robust control techniques to synthesize robust time-varying state-feedback policies for finite, infinite, and receding horizon control problems subject to convex quadratic state and input…

Optimization and Control · Mathematics 2023-10-19 Dennis Gramlich , Carsten W. Scherer , Hannah Häring , Christian Ebenbauer

It is known that state-dependent, multi-step Lyapunov bounds lead to greatly simplified verification theorems for stability for large classes of Markov chain models. This is one component of the "fluid model" approach to stability of…

Optimization and Control · Mathematics 2012-05-18 Serdar Yüksel , Sean P. Meyn