相关论文: A comparison between different cycle decomposition…

Markov processes with stochastic resetting towards the origin generically converge towards non-equilibrium steady-states. Long dynamical trajectories can be thus analyzed via the large deviations at Level 2.5 for the joint probability of…

A comparative analysis of two concepts aimed at microscopic substantiation of thermodynamics and kinetics has been performed. The first concept is based on the idea of microscopic reversibility of the dynamics of a system of particles,…

Markov chain Monte Carlo methods have become standard tools in statistics to sample from complex probability measures. Many available techniques rely on discrete-time reversible Markov chains whose transition kernels build up over the…

Markov Chain Monte Carlo (MCMC) methods are a powerful tool for computation with complex probability distributions. However the performance of such methods is critically dependant on properly tuned parameters, most of which are difficult if…

This paper presents two new approaches to decomposing and solving large Markov decision problems (MDPs), a partial decoupling method and a complete decoupling method. In these approaches, a large, stochastic decision problem is divided into…

An overview of advanced dynamical algorithms capable of spanning the widely disparate time scales that govern the decay of metastable phases in discrete spin models is presented. The algorithms discussed include constrained transfer-matrix,…

We aim at an explicit characterization of the renormalized Hamiltonian after decimation transformation of a one-dimensional Ising-type Hamiltonian with a nearest-neighbor interaction and a magnetic field term. To facilitate a deeper…

Metropolis-Hastings (MH) is a foundational Markov chain Monte Carlo (MCMC) algorithm. In this paper, we ask whether it is possible to formulate and analyse MH in terms of categorical probability, using a recent involutive framework for…

Non-equilibrium steady states (NESS) of Markov processes give rise to non-trivial cyclic probability fluxes. Cycle decompositions of the steady state offer an effective description of such fluxes. Here, we present an iterative cycle…

The conventional perspective on Markov chains considers decision problems concerning the probabilities of temporal properties being satisfied by traces of visited states. However, consider the following query made of a stochastic system…

Pseudo-marginal Markov chain Monte Carlo methods for sampling from intractable distributions have gained recent interest and have been theoretically studied in considerable depth. Their main appeal is that they are exact, in the sense that…

Two approaches to time consistency of risk averse multistage stochastic problems were discussed in the recent literature. In one approach certain properties of the cor-responding risk measure are postulated which imply its decomposability.…

Performing Bayesian inference via Markov chain Monte Carlo (MCMC) can be exceedingly expensive when posterior evaluations invoke the evaluation of a computationally expensive model, such as a system of partial differential equations. In…

We consider continuous-time Markov chains which display a family of wells at the same depth. We provide sufficient conditions which entail the convergence of the finite-dimensional distributions of the order parameter to the ones of a…

We present a general framework to study the metastability of random perturbations of dynamical systems. It integrates techniques from the theory of Markov processes, in particular the resolvent approach to metastability, with the spectral…

For both continuous-time and discrete-time Markov Chains, we provide criteria for inverse problems of classical types of ergodicity: (ordinary) erogodicity, algebraic ergodicity, exponential ergodicity and strong ergodicity. Our criteria…

Non-Markovian dynamics are ubiquitous across physics, biology, and engineering. Yet our understanding of non-Markovian processes significantly lags that of simpler Markovian processes, due largely to a lack of tractable models. In this…

Molecular Dynamics and Statistical Mechanics make possible a particle-based understanding of Thermodynamics and Hydrodynamics, including the fascinating Loschmidt contradiction between time-reversible atomistic mechanics and the…

Recent work in dynamical systems theory has shown that many properties that are associated with irreversible processes in fluids can be understood in terms of the dynamical properties of reversible, Hamiltonian systems. That is,…

Monte Carlo methods, such as Markov chain Monte Carlo (MCMC) algorithms, have become very popular in signal processing over the last years. In this work, we introduce a novel MCMC scheme where parallel MCMC chains interact, adapting…