English
Related papers

Related papers: Discrete-time Mean-Field Stochastic Control with P…

200 papers

Temporal point processes have been widely applied to model event sequence data generated by online users. In this paper, we consider the problem of how to design the optimal control policy for point processes, such that the stochastic…

Machine Learning · Computer Science 2017-11-13 Yichen Wang , Grady Williams , Evangelos Theodorou , Le Song

In this paper, we propose a class of discrete-time approximation schemes for stochastic optimal control problems under the $G$-expectation framework. The proposed schemes are constructed recursively based on piecewise constant policy. We…

Optimization and Control · Mathematics 2021-10-05 Lianzi Jiang

This paper considers the problem of state tracking with observation control for a particular class of dynamical systems. The system state evolution is described by a discrete-time, finite-state Markov chain, while the measurement process is…

Systems and Control · Computer Science 2014-08-20 Daphney-Stavroula Zois , Urbashi Mitra

This paper studies the problem of steering the distribution of a discrete-time dynamical system from an initial distribution to a target distribution in finite time. The formulation is fully nonlinear, allowing the use of general control…

Systems and Control · Electrical Eng. & Systems 2024-09-05 George Rapakoulias , Panagiotis Tsiotras

Safety-critical cyber-physical systems require control strategies whose worst-case performance is robust against adversarial disturbances and modeling uncertainties. In this paper, we present a framework for approximate control and learning…

Optimization and Control · Mathematics 2023-04-04 Aditya Dave , Ioannis Faros , Nishanth Venkatesh , Andreas A. Malikopoulos

This paper presents a novel methodology to tackle feedback optimal control problems in scenarios where the exact state of the controlled process is unknown. It integrates data assimilation techniques and optimal control solvers to manage…

Optimization and Control · Mathematics 2024-04-10 Siming Liang , Ruoyu Hu , Feng Bao , Richard Archibald , Guannan Zhang

We propose a new method for the problem of controlling linear dynamical systems under partial observation and adversarial disturbances. Our new algorithm, Double Spectral Control (DSC), matches the best known regret guarantees while…

Machine Learning · Computer Science 2025-05-28 Anand Brahmbhatt , Gon Buzaglo , Sofiia Druchyna , Elad Hazan

Mean field approximation is a popular method to study the behaviour of stochastic models composed of a large number of interacting objects. When the objects are asynchronous, the mean field approximation of a population model can be…

Performance · Computer Science 2018-07-24 Nicolas Gast , Diego Latella , Mieke Massink

Though switched dynamical systems have shown great utility in modeling a variety of physical phenomena, the construction of an optimal control of such systems has proven difficult since it demands some type of optimal mode scheduling. In…

Optimization and Control · Mathematics 2014-02-04 Ramanarayan Vasudevan , Humberto Gonzalez , Ruzena Bajcsy , S. Shankar Sastry

By a memory mean-field process we mean the solution $X(\cdot)$ of a stochastic mean-field equation involving not just the current state $X(t)$ and its law $\mathcal{L}(X(t))$ at time $t$, but also the state values $X(s)$ and its law…

Optimization and Control · Mathematics 2017-11-03 Nacira Agram , Bernt Øksendal

This paper considers the problem of partially observed optimal control for forward stochastic systems which are driven by Brownian motions and an independent Poisson random measure with a feature that the cost functional is of mean-field…

Probability · Mathematics 2014-03-19 Yaozhong Hu , David Nualart , Qing Zhou

This work recasts time-dependent optimal control problems governed by partial differential equations in a Dynamic Mode Decomposition with control framework. Indeed, since the numerical solution of such problems requires a lot of…

Optimization and Control · Mathematics 2022-03-25 Eleonora Donadini , Maria Strazzullo , Marco Tezzele , Gianluigi Rozza

The paper is devoted to deriving necessary optimality conditions in a general optimal control problem for dynamical systems governed by controlled sweeping processes with hard-constrained control actions entering both polyhedral moving sets…

Optimization and Control · Mathematics 2021-03-17 Tan H. Cao , Giovanni Colombo , Boris S. Mordukhovich , Dao Nguyen

This paper studies the optimal control problem for discrete-time nonlinear systems and an approximate dynamic programming-based Model Predictive Control (MPC) scheme is proposed for minimizing a quadratic performance measure. In the…

Systems and Control · Electrical Eng. & Systems 2023-12-12 Keerthi Chacko , Midhun T. Augustine , S. Janardhanan , Deepak U. Patil , I. N. Kar

This article gives an overview of the developments in controlled diffusion processes, emphasizing key results regarding existence of optimal controls and their characterization via dynamic programming for a variety of cost criteria and…

Probability · Mathematics 2007-05-23 Vivek S. Borkar

In this article, we consider a stochastic linear quadratic control problem with partial observation. A near optimal control in the weak formulation is characterized. The main features of this paper are the presence of the control in the…

Optimization and Control · Mathematics 2026-02-27 Jingrui Sun , Jiaqiang Wen , Jie Xiong , Wen Xu

This paper studies the partially observed stochastic optimal control problem for systems with state dynamics governed by partial differential equations (PDEs) that leads to an extremely large problem. First, an open-loop deterministic…

Optimization and Control · Mathematics 2017-11-06 Dan Yu , Mohammadhussein Rafieisakhaei , Suman Chakravorty

A stochastic procedure is developed which allows one to express Pontryagin's maximum principle for dissipative quantum system solely in terms of stochastic wave functions. Time-optimal controls can be efficiently computed without computing…

Quantum Physics · Physics 2020-11-09 Chungwei Lin , Dries Sels , Yanting Ma , Yebin Wang

IIn this paper, we study a partially observed progressive optimal control problem of forward-backward stochastic differential equations with random jumps, where the control domain is not necessarily convex, and the control variable enter…

Optimization and Control · Mathematics 2022-06-27 Yueyang Zheng , Jingtao Shi

The optimal control problem of stochastic systems is commonly solved via robust or scenario-based optimization methods, which are both challenging to scale to long optimization horizons. We cast the optimal control problem of a stochastic…

Machine Learning · Computer Science 2025-09-17 Etienne Buehrle , Christoph Stiller