Related papers: Ergodic Risk-sensitive control -- A survey
In this paper we present a dynamic programing approach to stochastic optimal control problems with dynamic, time-consistent risk constraints. Constrained stochastic optimal control problems, which naturally arise when one has to consider…
We study the problem of safe learning and exploration in sequential control problems. The goal is to safely collect data samples from operating in an environment, in order to learn to achieve a challenging control goal (e.g., an agile…
Answering an open question affirmatively it is shown that every ergodic invariant measure of a mean equicontinuous (i.e. mean-L-stable) system has discrete spectrum. Dichotomy results related to mean equicontinuity and mean sensitivity are…
Although a number of solutions exist for the problems of coverage, search and target localization---commonly addressed separately---whether there exists a unified strategy that addresses these objectives in a coherent manner without being…
Robust control theory studies the effect of noise, disturbances, and other uncertainty on system performance. Despite growing recognition across science and engineering that robustness and efficiency tradeoffs dominate the evolution and…
We study ergodic properties of partially hyperbolic systems whose central direction is mostly contracting. Earlier work of Bonatti, Viana about existence and finitude of physical measures is extended to the case of local diffeomorphisms.…
For a class of linear switched systems in continuous time a controllability condition implies that state feedbacks allow to achieve almost sure stabilization with arbitrary exponential decay rates. This is based on the Multiplicative…
In this paper, we obtain the exact controllability for a refined stochastic wave equation with three controls by establishing a novel Carleman estimate for a backward hyperbolic-like operator. Compared with the known result, the novelty of…
An optimal ergodic control problem (EC problem, for short) is investigated for a linear stochastic differential equation with quadratic cost functional. Constant nonhomogeneous terms, not all zero, appear in the state equation, which lead…
The aim of this survey is to present some aspects of multifractal analysis around the recently developed subject of multiple ergodic averages. Related topics include dimensions of measures, oriented walks, Riesz products etc.
U-statistics play central roles in many statistical learning tools but face the haunting issue of scalability. Significant efforts have been devoted into accelerating computation by U-statistic reduction. However, existing results almost…
In this paper we present a sensitivity analysis for the so-called fully probabilistic control scheme. This scheme attempts to control a system modeled via a probability density function (pdf) and does so by computing a probabilistic control…
A multiplicative relative value iteration algorithm for solving the dynamic programming equation for the risk-sensitive control problem is studied for discrete time controlled Markov chains with a compact Polish state space, and controlled…
In this paper we discuss how the notion of subgeometric ergodicity in Markov chain theory can be exploited to study stationarity and ergodicity of nonlinear time series models. Subgeometric ergodicity means that the transition probability…
We develop a robust linear-quadratic mean-field control framework for systemic risk under model uncertainty, in which a central bank jointly optimizes interest rate policy and supervisory monitoring intensity against adversarial…
Ergodicity and output controllability have been shown to be fundamental concepts for the analysis and synthetic design of closed-loop stochastic reaction networks, as exemplified by the use of antithetic integral feedback controllers. In…
We present a heuristic policy and performance bound for risk-sensitive convex stochastic control that generalizes linear-exponential-quadratic regulator (LEQR) theory. Our heuristic policy extends standard, risk-neutral model predictive…
In this paper we present a framework for risk-averse model predictive control (MPC) of linear systems affected by multiplicative uncertainty. Our key innovation is to consider time-consistent, dynamic risk metrics as objective functions to…
The "value" of infinite horizon risk-sensitive control is the principal eigenvalue of a certain positive operator. This facilitates the use of Chang's extension of the Collatz-Wielandt formula to derive a variational characterization…
This paper studies the income fluctuation problem with capital income risk (i.e., dispersion in the rate of return to wealth). Wealth returns and labor earnings are allowed to be serially correlated and mutually dependent. Rewards can be…