English
Related papers

Related papers: The *-Vertex-Reinforced Jump Process

200 papers

Reinforced random walks (RRWs), including vertex-reinforced random walks (VRRWs) and edge-reinforced random walks (ERRWs), model random walks where the transition probabilities evolve based on prior visitation history~\cite{mgr, fmk,…

Machine Learning · Statistics 2026-05-22 Qinghua , Ding , Venkat Anantharam

A continuous time random walk (CTRW) is a random walk in which both spatial changes represented by jumps and waiting times between the jumps are random. The CTRW is coupled if a jump and its preceding or following waiting time are dependent…

Probability · Mathematics 2016-03-14 Adam Barczyk , Peter Kern

Reversible jump Markov chain Monte Carlo (RJMCMC) proposals that achieve reasonable acceptance rates and mixing are notoriously difficult to design in most applications. Inspired by recent advances in deep neural network-based normalizing…

Computation · Statistics 2023-02-28 Laurence Davies , Robert Salomone , Matthew Sutton , Christopher Drovandi

A step-reinforced random walk is a discrete-time stochastic process with long-range dependence. At each step, with a fixed probability $\alpha$, the so-called positively step-reinforced random walk repeats one of its previous steps, chosen…

Probability · Mathematics 2025-05-01 Rafik Aguech , Samir Ben Hariz , Mohamed El Machkouri , Youssef Faouzi

A new integral with respect to an integer-valued random measure is introduced. In contrast to the finite variation integral ubiquitous in semimartingale theory (Jacod and Shiryaev, 2003, II.1.5), the new integral is closed under stochastic…

Probability · Mathematics 2021-08-26 Aleš Černý , Johannes Ruf

We prove that the linearly edge reinforced random walk (LRRW) on any graph with bounded degrees is recurrent for sufficiently small initial weights. In contrast, we show that for non-amenable graphs the LRRW is transient for sufficiently…

Probability · Mathematics 2014-05-08 Omer Angel , Nicholas Crawford , Gady Kozma

A novel version of the Continuous-Time Random Walk (CTRW) model with memory is developed. This memory means the dependence between arbitrary number of successive jumps of the process, while waiting times between jumps are considered as…

Data Analysis, Statistics and Probability · Physics 2016-12-16 Tomasz Gubiec , Ryszard Kutner

Given a random walk $(S_n)$ with typical step distributed according to some fixed law and a fixed parameter $p \in (0,1)$, the associated positively step-reinforced random walk is a discrete-time process which performs at each step, with…

Probability · Mathematics 2022-10-19 Marco Bertenghi , Alejandro Rosales-Ortiz

The edge-reinforced random walk (ERRW) is a random process on the vertices of a graph that is more likely to cross the edges it has visited in the past. Depending on the strength of the reinforcement, the ERRW of a single particle can…

Probability · Mathematics 2025-09-23 Giordano Giambartolomei , Nadia Sidorova

We study Markov Chain Monte Carlo (MCMC) methods operating in primary sample space and their interactions with multiple sampling techniques. We observe that incorporating the sampling technique into the state of the Markov Chain, as done in…

Graphics · Computer Science 2017-04-25 Benedikt Bitterli , Wenzel Jakob , Jan Novák , Wojciech Jarosz

We discuss non-reversible Markov-chain Monte Carlo algorithms that, for particle systems, rigorously sample the positional Boltzmann distribution and that have faster than physical dynamics. These algorithms all feature a non-thermal…

Statistical Mechanics · Physics 2025-10-28 Brune Massoulié , Clément Erignoux , Cristina Toninelli , Werner Krauth

In this paper, we consider random walks in Dirichlet random environment (RWDE) on $\mathbb{Z}^2$. We prove that, if the RWDE is recurrent (which is strongly conjectured when the weights are symmetric), then there does not exist any…

Probability · Mathematics 2025-01-14 Adrien Perrel , Christophe Sabot

The velocity-jump model is a specific type of piecewise deterministic Markov process in which an individual's velocity is constant except at times that form the events of some point process. It represents an interpretable continuous-time…

Methodology · Statistics 2025-09-26 Paul G. Blackwell

The reversible jump algorithm is a useful Markov chain Monte Carlo method introduced by Green (1995) that allows switches between subspaces of differing dimensionality, and therefore, model selection. Although this method is now…

Methodology · Statistics 2019-04-18 Philippe Gagnon , Mylène Bédard , Alain Desgagné

Vertex-reinforced random walk is defined in Pemantle's (1988) thesis; it is a random walk that is biased to visit sites it has already visited a lot. We show that this reinforcement scheme, in contrast to the scheme of edge-reinforcement,…

Probability · Mathematics 2016-09-07 Robin Pemantle , Stanislav Volkov

Piecewise-deterministic Markov processes (PDMPs) offer a powerful stochastic modeling framework that combines deterministic trajectories with random perturbations at random times. Estimating their local characteristics (particularly the…

Methodology · Statistics 2025-12-29 Romain Azaïs , Solune Denis

We establish a recursive representation that fully decouples jumps from a large class of multivariate inhomogeneous stochastic differential equations with jumps of general time-state dependent unbounded intensity, not of L\'evy-driven type…

Probability · Mathematics 2024-09-04 Qinjing Qiu , Reiichiro Kawai

We present the first rigorous quantitative analysis of once-reinforced random walks (ORRW) on general graphs, based on a novel change of measure formula.~This enables us to prove large deviations estimates for the range of the walk to have…

Probability · Mathematics 2025-09-05 Andrea Collevecchio , Pierre Tarrès

The step-reinforced random walk (SRRW), where each step may replicate a randomly chosen past step, exhibits complex dependencies on the history. This paper introduces a generalized SRRW on groups, incorporating arbitrary transformations of…

Probability · Mathematics 2026-04-09 Yuval Peres , Shuo Qin

For a semimartingale with jumps, we propose a new estimation method for integrated volatility, i.e., the quadratic variation of the continuous martingale part, based on the global jump filter proposed by Inatsugu and Yoshida [8]. To decide…

Statistics Theory · Mathematics 2021-02-16 Haruhiko Inatsugu , Nakahiro Yoshida