English
Related papers

Related papers: General Theory of Static Response for Markov Jump …

200 papers

The equilibrium distributions of a Markovian model describing the interaction of several classes of permanent connections in a network are analyzed. It has been introduced by Graham and Robert. For this model each of the connections has a…

Networking and Internet Architecture · Computer Science 2015-05-13 Carl Graham , Philippe Robert , Maaike Verloop

The linear response of a dynamical system refers to changes to properties of the system when small external perturbations are applied. We consider the little-studied question of selecting an optimal perturbation so as to (i) maximise the…

Dynamical Systems · Mathematics 2018-04-04 Fadi Antown , Davor Dragičević , Gary Froyland

We study Markov population processes on large graphs, with the local state transition rates of a single vertex being linear function of its neighborhood. A simple way to approximate such processes is by a system of ODEs called the…

Probability · Mathematics 2021-08-30 Dániel Keliger

Current concepts of neural networks have emerged over two centuries of progress beginning with the neural doctrine to the idea of neural cell assemblies. Presently the model of neural networks involves distributed neural circuits of nodes,…

Neurons and Cognition · Quantitative Biology 2024-07-30 M. Ram Murty , A. Narayan Prasad

Starting at the mesoscopic level with a general formulation of stochastic thermodynamics in terms of Markov jump processes, we identify the scaling conditions that ensure the emergence of a (typically nonlinear) deterministic dynamics and…

Statistical Mechanics · Physics 2025-05-26 Gianmaria Falasco , Massimiliano Esposito

Reaction networks are widely used models to describe biochemical processes. Stochastic fluctuations in the counts of biological macromolecules have amplified consequences due to their small population sizes. This makes it necessary to favor…

Probability · Mathematics 2022-02-28 Daniele Cappelletti , Badal Joshi

Consider a stochastic process $\{X(t)\}$ on a finite state space $ {\sf X}=\{1,\dots, d\}$. It is conditionally Markov, given a real-valued `input process' $\{\zeta(t)\}$. This is assumed to be small, which is modeled through the scaling,…

Performance · Computer Science 2018-09-18 Yue Chen , Ana Bušić , Sean Meyn

We study finite particle systems on the one-dimensional integer lattice, where each particle performs a continuous-time nearest-neighbour random walk, with jump rates intrinsic to each particle, subject to an exclusion interaction which…

Probability · Mathematics 2024-05-07 Vadim Malyshev , Mikhail Menshikov , Serguei Popov , Andrew Wade

We adress the problem of interactions between the longitudinal velocity increment and the energy dissipation rate in fully developed turbulence. The coupling between these two quantities is experimentally investigated by the theory of…

Fluid Dynamics · Physics 2007-05-23 Ch. Renner , J. Peinke , R. Friedrich

We propose a method based on continuous time Markov chain approximation to compute the distribution of Parisian stopping times and price Parisian options under general one-dimensional Markov processes. We prove the convergence of the method…

Computational Finance · Quantitative Finance 2021-07-15 Gongqiu Zhang , Lingfei Li

We study the problem of generating connected random graphs with no self-loops or multiple edges and that, in addition, have a given degree sequence. The generation method we focus on is the edge-switching Markov-chain method, whose…

Discrete Mathematics · Computer Science 2011-07-01 Alexandre O. Stauffer , Valmir C. Barbosa

We describe an exact approach for calculating transition probabilities and waiting times in finite-state discrete-time Markov processes. All the states and the rules for transitions between them must be known in advance. We can then…

Other Condensed Matter · Physics 2009-11-11 Semen A. Trygubenko , David J. Wales

A Markovian single-server queue is studied in an interactive random environment. The arrival and service rates of the queue depend on the environment, while the transition dynamics of the random environment depends on the queue length. We…

Probability · Mathematics 2020-01-10 Yana Belopolskaya , Guodong Pang , Andrey Sarantsev , Yurii Suhov

We derive universal thermodynamic inequalities that bound from below the moments of first-passage times of stochastic currents in nonequilibrium stationary states of Markov jump processes in the limit where the thresholds that define the…

Statistical Mechanics · Physics 2025-02-03 Izaak Neri

We study the local regularity and multifractal nature of the sample paths of jump diffusion processes, which are solutions to a class of stochastic differential equations with jumps. This article extends the recent work of Barral {\it et…

Probability · Mathematics 2017-09-06 Xiaochuan Yang

Maximum entropy (maxEnt) inference of state probabilities using state-dependent constraints is popular in the study of complex systems. In stochastic dynamical systems, the effect of state space topology and path-dependent constraints on…

Statistical Mechanics · Physics 2015-10-28 Purushottam D. Dixit

We define the probability structure of a continuous-time time-homogeneous Markov jump process, on a finite graph, that represents the continuous-time counterpart of the so-called Ruelle-Bowen discrete-time random walk. It constitutes the…

Optimization and Control · Mathematics 2018-02-14 Yongxin Chen , Tryphon T. Georgiou , Michele Pavon

The paper is devoted to studies of perturbed Markov chains commonly used for description of information networks. In such models, the matrix of transition probabilities for the corresponding Markov chain is usually regularised by adding a…

Piecewise-deterministic Markov processes form a general class of non-diffusion stochastic models that involve both deterministic trajectories and random jumps at random times. In this paper, we state a new characterization of the jump rate…

Methodology · Statistics 2017-05-03 Romain Azaïs , Alexandre Genadot

An important problem in applied dynamical systems is to compute the external forcing that provokes the largest response of a desired observable quantity. For this, we investigate the perturbation theory of Markov matrices in connection with…

Dynamical Systems · Mathematics 2025-07-21 Manuel Santos Gutierrez , Niccolo Zagli , Giulia Carigi