English
Related papers

Related papers: Constructions involving interaction of Markov proc…

200 papers

The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a…

Data Analysis, Statistics and Probability · Physics 2013-11-12 A. N. Gorban , P. A. Gorban , G. Judge

In many interesting physical settings, such as the vulcanization of rubber, the introduction of permanent random constraints between the constituents of a homogeneous fluid can cause a phase transition to a random solid state. In this…

Disordered Systems and Neural Networks · Physics 2009-10-31 Paul M. Goldbart

Markov processes are widely used in modeling random phenomena/problems. However, they may not be adequate in some cases where more general processes are needed. The conditionally Markov (CM) process is a generalization of the Markov process…

Probability · Mathematics 2021-03-16 Reza Rezaie , X. Rong Li

A rescaled Markov chain converges uniformly in probability to the solution of an ordinary differential equation, under carefully specified assumptions. The presentation is much simpler than those in the outside literature. The result may be…

Probability · Mathematics 2007-05-23 R. W. R. Darling

Many systems occurring in real-world applications, such as controlling the motions of robots or modeling the spread of diseases, are switched impulsive systems. To ensure that the system state stays in a safe region (e.g., to avoid…

Optimization and Control · Mathematics 2024-09-10 Katharina Bieker , Hugo Tadashi Kussaba , Philipp Scholl , Jaesug Jung , Abdalla Swikir , Sami Haddadin , Gitta Kutyniok

Many regenerative arguments in stochastic processes use random times which are akin to stopping times, but which are determined by the future as well as the past behaviour of the process of interest. Such arguments based on "conditioning on…

Probability · Mathematics 2014-10-09 Sergey Foss , Stan Zachary

In this paper we propose an alternative construction of the self-similar entrance laws for positive self-similar Markov processes. The study of entrance laws has been carried out in previous papers using different techniques, depending on…

Probability · Mathematics 2015-07-21 Víctor Manuel Rivero

In this paper we define the notion of an open Markov process. An open Markov process is a generalization of an ordinary Markov process in which populations are allowed to flow in and out of the system at certain boundary states. We show…

Statistical Mechanics · Physics 2016-11-02 Blake S. Pollard

Processes having the same bridges as a given reference Markov process constitute its {\it reciprocal class}. In this paper we study the reciprocal class of compound Poisson processes whose jumps belong to a finite set $\mathcal{A} \subset…

Probability · Mathematics 2014-07-01 Giovanni Conforti , Paolo Dai Pra , Sylvie Roelly

Periodic structures are a type of metamaterial in which the physical properties depend not only on the details of the unit cell but also on how unit cells are arranged and interact with each other. In conventional engineering structures,…

Applied Physics · Physics 2022-05-27 Sudesh Pathak , Gagan Dangi , Farhad Farzbod

Studying how social contexts shape technology interactions and how we experience them is hard. One challenge is that social contexts are very dynamic and shaped by the situated practices of everyone involved. As a result, the same…

Human-Computer Interaction · Computer Science 2022-05-05 Alarith Uhde , Mena Mesenhöller , Marc Hassenzahl

We estimate the distance in total variation between the law of a finite state Markov process at time t, starting from a given initial measure, and its unique invariant measure. We derive upper bounds for the time to reach the equilibrium.…

Probability · Mathematics 2015-06-26 Pierre MATHIEU , Pierre PICCO

Markov processes are used in a wide range of disciplines, including finance. The transition densities of these processes are often unknown. However, the conditional characteristic functions are more likely to be available, especially for…

Statistics Theory · Mathematics 2013-02-04 Song X. Chen , Liang Peng , Cindy L. Yu

The structure of social relations is fundamental for the construction of plausible simulation scenarios. It shapes the way actors interact and create their identity within overlapping social contexts. Each actor interacts in multiple…

Multiagent Systems · Computer Science 2015-09-14 Davide Nunes , Luis Antunes

This paper generalizes the notion of stochastic order to a relation between probability measures over arbitrary measurable spaces. This generalization is motivated by the observation that for the stochastic ordering of two stationary Markov…

Probability · Mathematics 2008-06-24 Lasse Leskelä

The modeling of natural phenomena via a Markov process --- a process for which the future is independent of the past, given the present--- is ubiquitous in many fields of science. Within this context, it is of foremost importance to develop…

Quantum Physics · Physics 2020-03-24 Matheus Capela , Lucas C. Céleri , Kavan Modi , Rafael Chaves

Detuned systems can spontaneously achieve a synchronous dynamics and display robust quantum correlations in different local and global dissipation regimes. Beyond the Markovian limit, information backflow from the environment becomes a…

In this paper we study the long term evolution of a continuous time Markov chain formed by two interacting birth-and-death processes. The interaction between the processes is modelled by transition rates which are functions with suitable…

Probability · Mathematics 2017-03-23 Mikhail Menshikov , Vadim Shcherbakov

Algorithms increasingly operate within complex physical, social, and engineering systems where they are exposed to disturbances, noise, and interconnections with other dynamical systems. This article extends known convergence guarantees of…

Machine Learning · Computer Science 2025-12-22 Guner Dilsad Er , Sebastian Trimpe , Michael Muehlebach

We construct a large class of non-Markovian master equations that describe the dynamics of open quantum systems featuring strong memory effects, which relies on a quantum generalization of the concept of classical semi-Markov processes.…

Quantum Physics · Physics 2008-10-03 Heinz-Peter Breuer , Bassano Vacchini