Related papers: Fixed-delay Events in Generalized Semi-Markov Proc…
On the basis of an analysis of previous research, we present a generalized approach for measuring the difference of plans with an exemplary application to machine scheduling. Our work is motivated by the need for such measures, which are…
A continuous-time random walk in the quarter plane with homogeneous transition rates is considered. Given a non-negative reward function on the state space, we are interested in the expected stationary performance. Since a direct derivation…
Semi-Markov processes generalize Markov processes by adding temporal memory effects as expressed by a semi-Markov kernel. We recall the path weight for a semi-Markov trajectory and the fact that thermodynamic consistency in equilibrium…
This article is concerned with stability analysis and stabilization of randomly switched nonlinear systems. These systems may be regarded as piecewise deterministic stochastic systems: the discrete switches are triggered by a stochastic…
This paper addresses the stability analysis and state estimation of generalized Persidskii systems subject to time-varying delays and external disturbances. The generalized Persidskii class, which couples linear dynamics with sector-bounded…
Limit theorems for the time average of some observation functions in an infinite measure dynamical system are studied. It is known that intermittent phenomena, such as the Rayleigh-Benard convection and Belousov-Zhabotinsky reaction, are…
We investigate ergodic-theoretical quantities and large deviation properties of one-dimensional intermittent maps, that have not only an indifferent fixed point but also a singular structure such that the uniform measure is invariant under…
Asymptotic properties of Markov Processes, such as steady state probabilities or hazard rate for absorbing states can be efficiently calculated by means of linear algebra even for large-scale problems. This paper discusses the methods for…
We propose an analytic approach for the steady-state dynamics of Markov processes on locally tree-like graphs. It is based on time-translation invariant probability distributions for edge trajectories, which we encode in terms of infinite…
The existence of generalized steady states (GSSs) in nonlinear mechanical systems under moderate temporally aperiodic forcing has only been shown recently. Here we derive systematic expansions for such GSSs and construct a numerical…
This note studies stability of event-triggered control systems with the event-triggered control algorithm proposed in [1]. We construct a novel Halanay-type inequality, which is used to show that sufficient conditions of the main results in…
We consider Markov decision processes (MDP) as generators of sequences of probability distributions over states. A probability distribution is p-synchronizing if the probability mass is at least p in a single state, or in a given set of…
We address the problem of detecting an anomalous process among a large number of processes. At each time t, normal processes are in state zero (normal state), while the abnormal process may be in either state zero (normal state) or state…
In biomedical settings, multitype recurrent events such as stroke and heart failure occur frequently, often concluding with a terminal event such as death. Understanding the links between these recurring and terminal events is fundamental…
We study a class of dissipative PDE's perturbed by a bounded random kick force. It is assumed that the random force is non-degenerate, so that the Markov process obtained by the restriction of solutions to integer times has a unique…
We develop a new generalized coupling approach to the study of stochastic delay equations with H\"older continuous coefficients, for which analytical PDE-based methods are not available. We prove that such equations possess unique weak…
In this paper we study a family of nonlinear (conditional) expectations that can be understood as a semimartingale with uncertain local characteristics. Here, the differential characteristics are prescribed by a time and path-dependent…
We are interested in understanding stability (almost sure boundedness) of stochastic approximation algorithms (SAs) driven by a `controlled Markov' process. Analyzing this class of algorithms is important, since many reinforcement learning…
We investigate the stability of quantum Markov processes with respect to perturbations of their transition maps. In the first part, we introduce a condition number that measures the sensitivity of fixed points of a quantum channel to…
In this paper, we present new results on finite- and fixed-time convergence for dynamical systems using LaSalle-like invariance principles. In particular, we provide first and second-order non-smooth Lyapunov-like results for finite- and…