English
Related papers

Related papers: Risk aware minimum principle for optimal control o…

200 papers

In this paper, we consider a varying terminal time structure for the stochastic optimal control problem under state constraints, in which the terminal time varies with the mean value of the state. In this new stochastic optimal control…

Optimization and Control · Mathematics 2024-09-05 Jin Shi , Shuzhen Yang

In this paper we study the stochastic control problem of partially observed (multi-dimensional) stochastic system driven by both Brownian motions and fractional Brownian motions. In the absence of the powerful tool of Girsanov…

Optimization and Control · Mathematics 2023-08-22 Yueyang Zheng , Yaozhong Hu

We study the feasibility and noise sensitivity of portfolio optimization under some downside risk measures (Value-at-Risk, Expected Shortfall, and semivariance) when they are estimated by fitting a parametric distribution on a finite sample…

Risk Management · Quantitative Finance 2008-12-10 Istvan Varga-Haszonits , Imre Kondor

We propose a novel class of risk-aware control barrier functions (RA-CBFs) for the control of stochastic safety-critical systems. Leveraging a result from the stochastic level-crossing literature, we deviate from the martingale theory that…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Mitchell Black , Georgios Fainekos , Bardh Hoxha , Danil Prokhorov , Dimitra Panagou

Stochastic dominance serves as a general framework for modeling a broad spectrum of decision preferences under uncertainty, with risk aversion as one notable example, as it naturally captures the intrinsic structure of the underlying…

Machine Learning · Computer Science 2026-01-06 Shicong Cen , Jincheng Mei , Hanjun Dai , Dale Schuurmans , Yuejie Chi , Bo Dai

This work concerns controlled Markov chains with finite state and action spaces. The transition law satisfies the simultaneous Doeblin condition, and the performance of a control policy is measured by the (long-run) risk-sensitive average…

Probability · Mathematics 2007-05-23 Rolando Cavazos-Cadena , Daniel Hernandez-Hernandez

This paper considers risk-sensitive model predictive control for stochastic systems with a decision-dependent distribution. This class of systems is commonly found in human-robot interaction scenarios. We derive computationally tractable…

Optimization and Control · Mathematics 2025-06-02 Renzi Wang , Mathijs Schuurmans , Panagiotis Patrinos

The optimal control problem of stochastic systems is commonly solved via robust or scenario-based optimization methods, which are both challenging to scale to long optimization horizons. We cast the optimal control problem of a stochastic…

Machine Learning · Computer Science 2025-09-17 Etienne Buehrle , Christoph Stiller

The classical approach to system identification is based on stochastic assumptions about the measurement error, and provides estimates that have random nature. Worst-case identification, on the other hand, only assumes the knowledge of…

Systems and Control · Computer Science 2013-06-07 Fabrizio Dabbene , Mario Sznaier , Roberto Tempo

This paper is concerned with a discounted stochastic optimal control problem for regime switching diffusion in an infinite horizon. First, as a preliminary with particular interests in its own right, the global well-posedness of infinite…

Optimization and Control · Mathematics 2026-02-06 Kai Ding , Xun Li , Siyu Lv , Xin Zhang

We prove a version of the maximum principle, in the sense of Pontryagin, for the optimal control of a stochastic partial differential equation driven by a finite dimensional Wiener process. The equation is formulated in a semi-abstract form…

Optimization and Control · Mathematics 2013-02-05 Marco Fuhrman , Ying Hu , Gianmario Tessitore

In this paper, we consider a modified version of the control problem in a model free Markov decision process (MDP) setting with large state and action spaces. The control problem most commonly addressed in the contemporary literature is to…

Artificial Intelligence · Computer Science 2018-02-01 Ajin George Joseph , Shalabh Bhatnagar

We study Spectral Measures of Risk from the perspective of portfolio optimization. We derive exact results which extend to general Spectral Measures M_phi the Pflug--Rockafellar--Uryasev methodology for the minimization of alpha--Expected…

Statistical Mechanics · Physics 2008-12-02 Acerbi Carlo , Simonetti Prospero

In this paper, we consider optimal control of stochastic differential equations subject to an expected path constraint. The stochastic maximum principle is given for a general optimal stochastic control in terms of constrained FBSDEs. In…

Optimization and Control · Mathematics 2022-08-16 Ying Hu , Shanjian Tang , Zuo Quan Xu

We develop a framework for convexifying a fairly general class of optimization problems. Under additional assumptions, we analyze the suboptimality of the solution to the convexified problem relative to the original nonconvex problem and…

Systems and Control · Computer Science 2014-06-04 Krishnamurthy Dvijotham , Maryam Fazel , Emanuel Todorov

This work addresses the problem of risk-sensitive control for nonlinear systems with imperfect state observations, extending results for the linear case. In particular, we derive an algorithm that can compute local solutions with…

Optimization and Control · Mathematics 2021-10-22 Bilal Hammoud , Armand Jordana , Ludovic Righetti

The problem of continuous inverse optimal control (over finite time horizon) is to learn the unknown cost function over the sequence of continuous control variables from expert demonstrations. In this article, we study this fundamental…

Machine Learning · Computer Science 2022-04-20 Yifei Xu , Jianwen Xie , Tianyang Zhao , Chris Baker , Yibiao Zhao , Ying Nian Wu

In this paper, we derive sufficient and necessary maximum principles for a stochastic optimal control problem where the system state is given by a controlled stochastic differential equation with default. We prove existence of a unique…

Optimization and Control · Mathematics 2021-05-26 Khalida Bachir Cherif , Nacira Agram , Kristina Dahl

This paper deals with shape optimization for elastic materials under stochastic loads. It transfers the paradigm of stochastic dominance, which allows for flexible risk aversion via comparison with benchmark random variables, from…

Numerical Analysis · Mathematics 2016-07-01 Sergio Conti , Martin Rumpf , Rüdiger Schultz , Sascha Tölkes

Optimal scheduling of batteries has significant potential to reduce electricity costs and to enhance grid resilience. However, effective battery scheduling must account for both physical constraints as well as uncertainties in consumption…

Optimization and Control · Mathematics 2026-04-01 Janik Pinter , Maximilian Beichter , Ralf Mikut , Veit Hagenmeyer , Frederik Zahn