Related papers: Functional-integral based perturbation theory for …
We apply the operator approach to a stochastic system belonging to a class of death-birth processes, which we introduce utilizing the master equation approach. By employing Doi- Peliti formalism we recast the master equation in the form of…
The linear fractional stable motion generalizes two prominent classes of stochastic processes, namely stable L\'evy processes, and fractional Brownian motion. For this reason it may be regarded as a basic building block for continuous time…
We focus on a data sequence produced by repetitive quantum measurement on an internal hidden quantum system, and call it a hidden Markovian process. Using a quantum version of the Perron-Frobenius theorem, we derive novel upper and lower…
We consider the semi-parametric estimation of a scale parameter of a one-dimensional Gaussian process with known smoothness. We suggest an estimator based on quadratic variations and on the moment method. We provide asymptotic…
This work is a continuation of [7]. We consider a continuous-time birth-and-death process in which the transition rates have an asymptotical power-law dependence upon the position of the process. We establish rough exponential asymptotic…
We consider a discrete time semi-Markov process where the characteristics defining the process depend on a small perturbation parameter. It is assumed that the state space consists of one finite communicating class of states and, in…
Starting from the notion of multivariate fractional Brownian Motion introduced in [F. Lavancier, A. Philippe, and D. Surgailis. Covariance function of vector self-similar processes. Statistics & Probability Letters, 2009] we define a…
We develop an exhaustive study of Markov decision process (MDP) under mean field interaction both on states and actions in the presence of common noise, and when optimization is performed over open-loop controls on infinite horizon. Such…
We introduce a new variational approach to the stationary state of kinetic Ising-like models. The approach is based on the cluster expansion of the entropy term appearing in a functional which is minimized by the system history. We rederive…
We build on a previous statistical model for distributed systems and formulate it in a way that the deterministic and stochastic processes within the system are clearly separable. We show how internal fluctuations can be analysed in a…
Clustered multistate process data are commonly encountered in multicenter observational studies and clinical trials. A clinically important estimand with such data is the marginal probability of being in a particular transient state as a…
This paper develops asymptotic theory of integrals of empirical quantile functions with respect to random weight functions, which is an extension of classical $L$-statistics. They appear when sample trimming or Winsorization is applied to…
We identify a new variational inference scheme for dynamical systems whose transition function is modelled by a Gaussian process. Inference in this setting has either employed computationally intensive MCMC methods, or relied on…
Asymptotic properties of Markov Processes, such as steady state probabilities or hazard rate for absorbing states can be efficiently calculated by means of linear algebra even for large-scale problems. This paper discusses the methods for…
In this paper we study the Markov-modulated M/M/$\infty$ queue, with a focus on the correlation structure of the number of jobs in the system. The main results describe the system's asymptotic behavior under a particular scaling of the…
A variational Perturbation theory based on the functional integral approach is formulated for many-particle systems. Using the variational action obtained through Jensen-Peierls' inequality, a perturbative expansion scheme for the…
We present an efficient and numerically stable algorithm for calculation of two-particle response functions within the dynamical mean-field theory. The technique is based on inferring the high frequency asymptotic behavior of the…
New algorithms for computing of asymptotic expansions for stationary distributions of nonlinearly perturbed semi-Markov processes are presented. The algorithms are based on special techniques of sequential phase space reduction, which can…
Asymptotic expansions for stationary and conditional quasi-stationary distributions of nonlinearly perturbed birth-death-type semi-Markov models are presented. Applications to models of population growth, epidemic spread and population…
We propose a principled kernel-based policy iteration algorithm to solve the continuous-state Markov Decision Processes (MDPs). In contrast to most decision-theoretic planning frameworks, which assume fully known state transition models, we…