English
Related papers

Related papers: The Markov Memory for Generating Rare Events

200 papers

Particle splitting methods are considered for the estimation of rare events. The probability of interest is that a Markov process first enters a set $B$ before another set $A$, and it is assumed that this probability satisfies a large…

Probability · Mathematics 2007-11-14 Thomas Dean , Paul Dupuis

An important class of applications entails a robot monitoring, scrutinizing, or recording the evolution of an uncertain time-extended process. This sort of situation leads an interesting family of planning problems in which the robot is…

Robotics · Computer Science 2021-03-16 Hazhar Rahmani , Dylan A. Shell , Jason M. O'Kane

We consider a class of piecewise-deterministic Markov processes where the state evolves according to a linear dynamical system. This continuous time evolution is interspersed by discrete events that occur at random times and change (reset)…

Systems and Control · Computer Science 2017-11-15 Mohammad Soltani , Abhyudai Singh

Langevin equations are used to model many processes of physical interest, including low-energy nuclear collisions. In this paper we develop a general method for computing probabilities of very rare events (e.g. small fusion cross-sections)…

Nuclear Theory · Physics 2009-10-31 O. Mazonka , C. Jarzynski , J. Blocki

Stochastic processes have found numerous applications in science, as they are broadly used to model a variety of natural phenomena. Due to their intrinsic randomness and uncertainty, they are, however, difficult to characterize. Here, we…

Understanding the generative mechanism of a natural system is a vital component of the scientific method. Here, we investigate one of the fundamental steps toward this goal by presenting the minimal generator of an arbitrary binary Markov…

Statistical Mechanics · Physics 2018-02-14 J. Ruebeck , R. G. James , J. R. Mahoney , J. P. Crutchfield

The concepts of probability, statistics and stochastic theory are being successfully used in structural engineering. Markov Chain modelling is a simple stochastic process model that has found its application in both describing stochastic…

Applications · Statistics 2007-08-14 K. Balaji Rao

The paper deals with a certain class of random evolutions. We develop a construction that yields an invariant measure for a continuous-time Markov process with random transitions. The approach is based on a particular way of constructing…

Probability · Mathematics 2015-10-20 Y. Belopolskaya , Y. Suhov

We review what we call "event-enhanced formalism" of quantum theory. In this approach we explicitly assume classical nature of events. Given a quantum system, that is coupled to a classical one by a suitable coupling, classical events are…

Quantum Physics · Physics 2007-05-23 Ph. Blanchard , A. Jadczyk

Arguably, the largest class of stochastic processes generated by means of a finite memory consists of those that are sequences of observations produced by sequential measurements in a suitable generalized probabilistic theory (GPT). These…

Quantum Physics · Physics 2024-09-25 Marco Fanizza , Josep Lumbreras , Andreas Winter

How stochastic, microscopic events generate deterministic, macroscopic properties is a fundamental question in physics. We address this question by developing a quantum master equation model for concentrated radical solutions, where random…

Chemical Physics · Physics 2026-05-26 Yoshiaki Uchida , Ryohei Kishi

Atypical, rare trajectories of dynamical systems are important: they are often the paths for chemical reactions, the haven of (relative) stability of planetary systems, the rogue waves that are detected in oil platforms, the structures that…

Statistical Mechanics · Physics 2012-04-12 Cristian Giardina , Jorge Kurchan , Vivien Lecomte , Julien Tailleur

Stochastic (Markovian) process algebra extend classical process algebra with probabilistic exponentially distributed time durations denoted by rates (the parameter of the exponential distribution). Defining a semantics for such an algebra,…

Logic in Computer Science · Computer Science 2015-12-23 Mario Bravetti

This paper motivates the use of random-bridges -- stochastic processes conditioned to take target distributions at fixed timepoints -- in the realm of generative modelling. Herein, random-bridges can act as stochastic transports between two…

Machine Learning · Computer Science 2026-04-07 Stefano Goria , Levent A. Mengütürk , Murat C. Mengütürk , Berkan Sesen

Hidden Markov chains are widely applied statistical models of stochastic processes, from fundamental physics and chemistry to finance, health, and artificial intelligence. The hidden Markov processes they generate are notoriously…

Chaotic Dynamics · Physics 2021-05-26 Alexandra M. Jurgens , James P. Crutchfield

A stochastic process's statistical complexity stands out as a fundamental property: the minimum information required to synchronize one process generator to another. How much information is required, though, when synchronizing over a…

Quantum Physics · Physics 2015-08-13 J. R. Mahoney , C. Aghamohammadi , J. P. Crutchfield

Rare events can potentially occur in many applications. When manifested as opportunities to be exploited, risks to be ameliorated, or certain features to be extracted, such events become of paramount significance. Due to their sporadic…

Information Theory · Computer Science 2012-10-10 Ali Tajer , H. Vincent Poor

Identifying and quantifying memory are often critical steps in developing a mechanistic understanding of stochastic processes. These are particularly challenging and necessary when exploring processes that exhibit long-range correlations.…

Statistical Mechanics · Physics 2016-04-20 Sarah E. Marzen , James P. Crutchfield

Datasets involving sequences of different types of events without meaningful time stamps are prevalent in many applications, for instance when extracted from textual corpora. We propose a family of models for such event sequences -- summary…

Artificial Intelligence · Computer Science 2022-05-09 Debarun Bhattacharjya , Saurabh Sihag , Oktie Hassanzadeh , Liza Bialik

In this work, we propose an algorithm to simulate rare events for electronic circuit design. Our approach heavily relies on a smart use of importance sampling, which enables us to tackle probabilities of the magnitude 10 --10. Not only can…

Probability · Mathematics 2021-09-20 Xavier Jonsson , Jérôme Lelong