English
Related papers

Related papers: Comparison of Markov processes by the martingale c…

200 papers

We introduce Generator Matching, a modality-agnostic framework for generative modeling using arbitrary Markov processes. Generators characterize the infinitesimal evolution of a Markov process, which we leverage for generative modeling in a…

Machine Learning · Computer Science 2025-02-28 Peter Holderrieth , Marton Havasi , Jason Yim , Neta Shaul , Itai Gat , Tommi Jaakkola , Brian Karrer , Ricky T. Q. Chen , Yaron Lipman

Markov chain Monte Carlo is an inherently serial algorithm. Although likelihood calculations for individual steps can sometimes be parallelized, the serial evolution of the process is widely viewed as incompatible with parallelization,…

Computation · Statistics 2013-12-31 Douglas N. VanDerwerken , Scott C. Schmidler

The paper is devoted to a systematic study of the duality of processes in the sense that $E f(X_t^x,y)=E f (x, Y_t^y)$ for a certain $f$. This classical topic has well known applications in interacting particles, intertwining,…

Probability · Mathematics 2022-05-03 Vassili Kolokoltsov , RuiXin Lee

We study properties of a subclass of Markov processes that have all moments that are continuous functions of the time parameter and more importantly are characterized by the property that say their $n-$th conditional moment given the past…

Probability · Mathematics 2013-10-08 Paweł J. Szabłowski

In this paper we survey and further study partial sums of a stationary process via approximation with a martingale with stationary differences. Such an approximation is useful for transferring from the martingale to the original process the…

Probability · Mathematics 2011-05-24 Magda Peligrad

We prove a martingale analog of van Schaftingen's theorem and give sharp estimates on the lower Hausdorff dimension of measures in martingale shift invariant spaces. We also provide martingale analogs of trace theorems for Sobolev…

Classical Analysis and ODEs · Mathematics 2018-11-21 Rami Ayoush , Dmitriy Stolyarov , Michal Wojciechowski

In this paper, we obtain stability results for martingale representations in a very general framework. More specifically, we consider a sequence of martingales each adapted to its own filtration, and a sequence of random variables…

Probability · Mathematics 2022-06-06 Antonis Papapantoleon , Dylan Possamai , Alexandros Saplaouras

The past two decades have seen a revolution in statistical physics, generalizing it to apply to systems of arbitrary size, evolving while arbitrarily far from equilibrium. Many of these new results are based on analyzing the dynamics of the…

Statistical Mechanics · Physics 2022-08-08 David H. Wolpert

This paper describes a data reduction technique in case of a markov chain of specified order. Instead of observing all the transitions in a markov chain we record only a few of them and treat the remaining part as missing. The decision…

Methodology · Statistics 2018-07-17 Atanu Kumar Ghosh , Arnab Chakraborty

This paper is devoted to studying the average optimality in continuous-time Markov decision processes with fairly general state and action spaces. The criterion to be maximized is expected average rewards. The transition rates of underlying…

Probability · Mathematics 2007-05-23 Xianping Guo , Ulrich Rieder

Focusing on stochastic systems arising in mean-field models, the systems under consideration belong to the class of switching diffusions, in which continuous dynamics and discrete events coexist and interact. The discrete events are modeled…

Probability · Mathematics 2019-01-18 Son L. Nguyen , George Yin , Tuan A. Hoang

In this article almost semi-continuous processes with stationary independent increments on a finite irreducible Markov chain are considered. For these processes the components of matrix factorization identity are concretely defined. On the…

Probability · Mathematics 2009-09-01 D. V. Gusak , E. V. Karnaukh

We present an investigation of stochastic evolution in which a family of evolution equations in $L^1$ are driven by continuous-time Markov processes. These are examples of so-called piecewise deterministic Markov processes (PDMP's) on the…

Probability · Mathematics 2020-12-01 Paweł Klimasara , Michael C. Mackey , Andrzej Tomski , Marta Tyran-Kamińska

This note investigates core properties of martingales, emphasizing the measure-theoretic formulation of conditional expectation, the martingale transform, and the upcrossing lemma. These results lead to the Martingale Convergence Theorem,…

Machine Learning · Computer Science 2026-02-16 Xiandong Zou

This thesis presents a formalization of martingales in arbitrary Banach spaces using Isabelle/HOL. We begin by examining formalizations in prominent proof repositories and extend the definition of the conditional expectation operator from…

Logic in Computer Science · Computer Science 2023-11-13 Ata Keskin

We introduce scalable algorithms for online learning of neural network parameters and Bayesian sequential decision making. Unlike classical Bayesian neural networks, which induce predictive uncertainty through a posterior over model…

Machine Learning · Computer Science 2025-10-10 Gerardo Duran-Martin , Leandro Sánchez-Betancourt , Álvaro Cartea , Kevin Murphy

A Markov evolution of a system of point particles in $\mathbb{R}^d$ is described at micro-and mesoscopic levels. The particles reproduce themselves at distant points (dispersal) and die, independently and under the influence of each other…

Mathematical Physics · Physics 2015-06-11 Dmitri Finkelshtein , Yuri Kondratiev , Yuri Kozitsky , Oleksandr Kutoviy

In this article, we develop a semigroup-theoretic framework for the analytic characterisation of martingales with path-dependent terminal conditions. Our main result establishes that a measurable adapted process of the form \[ V(t) -…

Probability · Mathematics 2025-07-03 Robert Denk , Markus Kunze , Michael Kupper

Invariance principles are obtained for a Markov process on a half-line with continuous paths on the interior. The domains of attraction of the two different types of self-similar processes are investigated. Our approach is to establish…

Probability · Mathematics 2008-11-14 Kouji Yano

This paper studies some analytical properties of weak solutions of 3D stochastic primitive equations with periodic boundary conditions. The martingale problem associated to this model is shown to have a family of solutions satisfying the…

Probability · Mathematics 2017-03-07 Zhao Dong , Rangrang Zhang