English
Related papers

Related papers: Moment-Based Variational Inference for Markov Jump…

200 papers

We study the fluctuations of systems modeled by Markov jump processes with periodic generators. We focus on observables defined through time-periodic functions of the system's states or transitions. Using large deviation theory, canonical…

Statistical Mechanics · Physics 2020-04-22 Lydia Chabane , Raphaël Chétrite , Gatien Verley

We investigate the Poisson regression method for Markov and semi-Markov jump processes from a nonparametric angle, allowing the lengths of the time and duration intervals in the partition to vary with the number of observations. Imposing no…

Statistics Theory · Mathematics 2026-05-06 Martin Bladt , Rasmus Frigaard Lemvig

We investigate a piecewise-deterministic Markov process, evolving on a Polish metric space, whose deterministic behaviour between random jumps is governed by some semi-flow, and any state right after the jump is attained by a randomly…

Probability · Mathematics 2020-12-04 Dawid Czapla , Sander C. Hille , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

We consider a hidden Markov model, where the signal process, given by a diffusion, is only indirectly observed through some noisy measurements. The article develops a variational method for approximating the hidden states of the signal…

Optimization and Control · Mathematics 2016-10-26 Tobias Sutter , Arnab Ganguly , Heinz Koeppl

Switching dynamical systems are an expressive model class for the analysis of time-series data. As in many fields within the natural and engineering sciences, the systems under study typically evolve continuously in time, it is natural to…

Machine Learning · Computer Science 2022-05-19 Lukas Köhs , Bastian Alt , Heinz Koeppl

Change-point detection and locally stationary time series modeling are two major approaches for the analysis of non-stationary data. The former aims to identify stationary phases by detecting abrupt changes in the dynamics of a time series…

Methodology · Statistics 2026-01-16 Wai Leong Ng , Xinyi Tang , Mun Lau Cheung , Jiacheng Gao , Chun Yip Yau , Holger Dette

We present a new method for simulating Markovian jump processes with time-dependent transitions rates, which avoids the transformation of random numbers by inverting time integrals over the rates. It relies on constructing a sequence of…

Statistical Mechanics · Physics 2015-05-20 Viktor Holubec , Petr Chvosta , Mario Einax , Philipp Maass

The estimation of absorption time distributions of Markov jump processes is an important task in various branches of statistics and applied probability. While the time-homogeneous case is classic, the time-inhomogeneous case has recently…

Statistics Theory · Mathematics 2022-07-26 Jamaal Ahmad , Martin Bladt , Mogens Bladt

Neyman-Scott processes (NSPs) have been applied across a range of fields to model points or temporal events with a hierarchy of clusters. Markov chain Monte Carlo (MCMC) is typically used for posterior sampling in the model. However, MCMC's…

Machine Learning · Statistics 2023-03-08 Chengkuan Hong , Christian R. Shelton

Markov jump processes are continuous-time stochastic processes which describe dynamical systems evolving in discrete state spaces. These processes find wide application in the natural sciences and machine learning, but their inference is…

Machine Learning · Computer Science 2025-03-05 David Berghaus , Kostadin Cvejoski , Patrick Seifner , Cesar Ojeda , Ramses J. Sanchez

We propose a novel, tractable latent state inference scheme for Markov jump processes, for which exact inference is often intractable. Our approach is based on an entropic matching framework that can be embedded into the well-known…

Machine Learning · Computer Science 2026-02-27 Yannick Eich , Bastian Alt , Heinz Koeppl

The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due the sampling problem. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the…

Mathematical Physics · Physics 2012-12-03 Frank Noé , Feliks Nüske

We study a one-dimensional Markov modulated random walk with jumps. It is assumed that amplitudes of jumps as well as a chosen velocity regime are random and depend on a time spent by the process at a previous state of the underlying Markov…

Probability · Mathematics 2013-03-13 Nikita Ratanov

We consider the problem of detecting jumps in an otherwise smoothly evolving trend whilst the covariance and higher-order structures of the system can experience both smooth and abrupt changes over time. The number of jump points is allowed…

Methodology · Statistics 2023-12-27 Weichi Wu , Zhou Zhou

The conditional moment problem is a powerful formulation for describing structural causal parameters in terms of observables, a prominent example being instrumental variable regression. A standard approach reduces the problem to a finite…

Machine Learning · Computer Science 2023-03-24 Andrew Bennett , Nathan Kallus

Diffusive approximations of Markov jump processes often fail to accurately capture large fluctuations. This is confounding, as the rare events triggered by these large fluctuations, such as the failure of electronic memories, are often the…

Mesoscale and Nanoscale Physics · Physics 2025-12-17 David Roberts , Trevor McCourt , Geremia Massarelli , Jeremy Rothschild , Nahuel Freitas

Inspired by a duration-dependent life insurance model, we consider continuous-time semi-Markov jump processes, initially assumed to have a finite state-space. We develop approximations using jump processes that are time-homogeneous Markov,…

Probability · Mathematics 2025-08-11 Martin Bladt , Andreea Minca , Oscar Peralta

We introduce a novel class of generative models based on piecewise deterministic Markov processes (PDMPs), a family of non-diffusive stochastic processes consisting of deterministic motion and random jumps at random times. Similarly to…

Machine Learning · Statistics 2024-11-06 Andrea Bertazzi , Dario Shariatian , Umut Simsekli , Eric Moulines , Alain Durmus

Markov jump processes (or continuous-time Markov chains) are a simple and important class of continuous-time dynamical systems. In this paper, we tackle the problem of simulating from the posterior distribution over paths in these models,…

Computation · Statistics 2013-10-21 Vinayak Rao , Yee Whye Teh

Statistical inference for stochastic processes based on high-frequency observations has been an active research area for more than a decade. One of the most well-known and widely studied problems is that of estimation of the quadratic…

Econometrics · Economics 2022-02-03 B. Cooper Boniece , José E. Figueroa-López , Yuchen Han