Related papers: Mean residual life processes and associated submar…
Let {X_{t_1,t_2}: t_1,t_2 >= 0} be a two-parameter L\'evy process on R^d. We study basic properties of the one-parameter process {X_{x(t),y(t)}: t \in T} where x and y are, respectively, nondecreasing and nonincreasing nonnegative…
We present the PML 2 language, which provides a uniform environment for programming, and for proving properties of programs in an ML-like setting. The language is Curry-style and call-by-value, it provides a control operator (interpreted in…
Considering a broad class of steady-state nonequilibrium systems for which some additive quantities are conserved by the dynamics, we introduce from a statistical approach intensive thermodynamic parameters (ITPs) conjugated to the…
We study Markov decision processes (MDPs) with multiple limit-average (or mean-payoff) functions. We consider two different objectives, namely, expectation and satisfaction objectives. Given an MDP with k limit-average functions, in the…
Self-normalized processes arise naturally in statistical applications. Being unit free, they are not affected by scale changes. Moreover, self-normalization often eliminates or weakens moment assumptions. In this paper we present several…
Classical statistical learning theory predicts a U-shaped relationship between test loss and model capacity, driven by the bias-variance trade-off. Recent advances in modern machine learning have revealed a more complex pattern,…
While run-and-tumble particles are a foundational model for self-propelled particles as bacteria or Janus particles, the analytical derivation of their steady state from the microscopic details is still an open problem. By directly modeling…
Markov decision processes (MDPs) are standard models for probabilistic systems with non-deterministic behaviours. Long-run average rewards provide a mathematically elegant formalism for expressing long term performance. Value iteration (VI)…
We study class of L\'{e}vy processes having distributions being indentifiable by moments. We define system of polynomial martingales \newline $\left\{ M_{n}(X_{t},t),\mathcal{F}_{\leq t}\right\} _{n\geq 1},$ where $% \mathcal{F}_{\leq t}$…
We establish the Subgradient Theorem for monotone correspondences -- a monotone correspondence is equal to the subdifferential of a potential if and only if it is conservative, i.e. its integral along a closed path vanishes irrespective of…
We study evolutionary dynamics on graphs in which each step consists of one birth and one death, also known as the Moran processes. There are two types of individuals: residents with fitness $1$ and mutants with fitness $r$. Two standard…
Machine-learned potentials (MLPs) trained on ab initio data combine the computational efficiency of classical interatomic potentials with the accuracy and generality of the first-principles method used in the creation of the respective…
Novel hidden thermodynamic structures have recently been uncovered during the investigation of nonequilibrium thermodynamics for multiscale stochastic processes. Here we reveal the martingale structure for a general thermodynamic functional…
The entropy rates of the Wright-Fisher process, the Moran process, and generalizations are computed and used to compare these processes and their dependence on standard evolutionary parameters. Entropy rates are measures of the variation…
We are interested in the behaviour of the range and of the first return time to the origin of random walks in random scenery. As a byproduct a precise estimate of the survival probability in the Matheron and de Marsily model is obtained.…
In an earlier paper we introduced a notion of Markov automaton, together with parallel operations which permit the compositional description of Markov processes. We illustrated by showing how to describe a system of n dining philosophers,…
Semi-Markov models are widely used for survival analysis and reliability analysis. In general, there are two competing parameterizations and each entails its own interpretation and inference properties. On the one hand, a semi-Markov…
The canonical form of Matrix Product States (MPS) and the associated fundamental theorem, which relates different MPS representations of a state, are the theoretical framework underlying many of the analytical results derived through MPS,…
Martingale techniques play a fundamental role in the analysis of point processes on the real line. In particular, the compensator of a point process uniquely determines and is determined by its distribution, and an explicit formula…
Repair mechanisms are important within resilient systems to maintain the system in an operational state after an error occurred. Usually, constraints on the repair mechanisms are imposed, e.g., concerning the time or resources required…