Related papers: Almost sure convergence of maxima for chaotic dyna…
This paper derives a somewhat surprising but interesting enough result on the stabilizability of discrete-time parameterized uncertain systems. Contrary to an intuition, it shows that the growth rate of a discrete-time stabilizable system…
In this review/tutorial article, we present recent progress on optimal control of partially observed Markov Decision Processes (POMDPs). We first present regularity and continuity conditions for POMDPs and their belief-MDP reductions, where…
Consider $M_n$ the maximal position at generation $n$ of a supercritical branching random walk. A\"id\'ekon (2013) obtained and described the convergence in law, as time $n$ goes to infinity, of $M_n-m_n$, where $m_n$ is an explicit…
Maxima of moving maxima of continuous functions (CM3) are max-stable processes aimed at modeling extremes of continuous phenomena over time. They are defined as Smith and Weissman's M4 processes with continuous functions rather than…
Let $E$ be a space of observables in a sequence of trials $\xi_n$ and define $m_n$ to be the empirical distributions of the outcomes. We discuss the almost sure convergence of the sequence $m_n$ in terms of the $\psi$-weak topology of…
We investigate the convergence to (quasi--)equilibrium of a density dependent Markov chain in~${\mathbb Z}^d$, whose drift satisfies a system of ordinary differential equations having an attractive fixed point. For a sequence of such…
We study an approximation method for partially observed Markov decision processes (POMDPs) with continuous spaces. Belief MDP reduction, which has been the standard approach to study POMDPs requires rigorous approximation methods for…
This work proposes a decision-making framework for partially observable systems in continuous time with discrete state and action spaces. As optimal decision-making becomes intractable for large state spaces we employ approximation methods…
We prove an almost sure invariance principle that is valid for general classes of nonuniformly expanding and nonuniformly hyperbolic dynamical systems. Discrete time systems and flows are covered by this result. In particular, the result…
We consider stationary stochastic processes arising from dynamical systems by evaluating a given observable along the orbits of the system. We focus on the extremal behaviour of the process, which is related to the entrance in certain…
We study the optimal control of discrete time mean filed dynamical systems under partial observations. We express the global law of the filtered process as a controlled system with its own dynamics. Following a dynamic programming approach,…
This work is devoted to the almost sure stabilization of adaptive control systems that involve an unknown Markov chain. The control system displays continuous dynamics represented by differential equations and discrete events given by a…
We establish quantitative results for the statistical be\-ha\-vi\-our of \emph{infinite systems}. We consider two kinds of infinite system: i) a conservative dynamical system $(f,X,\mu)$ preserving a $\sigma$-finite measure $\mu$ such that…
Max-stable processes play an important role as models for spatial extreme events. Their complex structure as the pointwise maximum over an infinite number of random functions makes simulation highly nontrivial. Algorithms based on finite…
Maximal regularity is a fundamental concept in the theory of partial differential equations. In this paper, we establish a fully discrete version of maximal regularity for a parabolic equation. We derive various stability results in…
We study the generalized synchronization and its stability using master stability function (MSF), in a network of coupled nearly identical dynamical systems. We extend the MSF approach for the case of degenerate eigenvalues of the coupling…
In the setting where we have $n$ independent observations of a random variable $X$, we derive explicit error bounds in total variation distance when approximating the number of observations equal to the maximum of the sample (in the case…
We analyse the infinite-dimensional limit of the maximally chaotic dynamical systems that are defined on N-dimensional tori. These hyperbolic systems found successful application in computer algorithms that generate high-quality…
We consider a one-dimensional stationary time series of fixed duration $T$. We investigate the time $t_{\rm m}$ at which the process reaches the global maximum within the time interval $[0,T]$. By using a path-decomposition technique, we…
"Sticky" motion in mixed phase space of conservative systems is difficult to detect and to characterize, in particular for high dimensional phase spaces. Its effect on quasi-regular motion is quantified here with four different measures,…