English
Related papers

Related papers: The Markov Memory for Generating Rare Events

200 papers

Markov models are widely used to describe processes of stochastic dynamics. Here, we show that Markov models are a natural consequence of the dynamical principle of Maximum Caliber. First, we show that when there are different possible…

Statistical Mechanics · Physics 2015-05-28 Hao Ge , Steve Presse , Kingshuk Ghosh , Ken Dill

Predictive constructions are a powerful way of characterizing the probability law of stochastic processes with certain forms of invariance, such as exchangeability or Markov exchangeability. When de Finetti-like representation theorems are…

Methodology · Statistics 2015-11-16 Sandra Fortini , Sonia Petrone

The Poisson process is the most elementary continuous-time stochastic process that models a stream of repeating events. It is uniquely characterised by a single parameter called the rate. Instead of a single value for this rate, we here…

Probability · Mathematics 2019-06-05 Alexander Erreygers , Jasper De Bock

One of the remarkable notions in the recent development of quantum physics is the weak value related to weak measurements. We emulate it as a two-time conditional expectation in a classical stochastic model. We use the well known…

Statistical Mechanics · Physics 2017-08-23 Hiroyuki Tomita

Rare events are ubiquitous in many different fields, yet they are notoriously difficult to simulate because few, if any, events are observed in a conventiona l simulation run. Over the past several decades, specialised simulation methods…

Statistical Mechanics · Physics 2015-05-13 Rosalind J. Allen , Chantal Valeriani , Pieter Rein ten Wolde

Building upon the rule-algebraic stochastic mechanics framework, we present new results on the relationship of stochastic rewriting systems described in terms of continuous-time Markov chains, their embedded discrete-time Markov chains and…

Logic in Computer Science · Computer Science 2021-02-05 Nicolas Behr

The applicability of machine learning for predicting chaotic dynamics relies heavily upon the data used in the training stage. Chaotic time series obtained by numerically solving ordinary differential equations embed a complicated noise of…

Data Analysis, Statistics and Probability · Physics 2021-10-13 Igor A Khovanov

Many probabilistic inference problems such as stochastic filtering or the computation of rare event probabilities require model analysis under initial and terminal constraints. We propose a solution to this bridging problem for the widely…

Systems and Control · Electrical Eng. & Systems 2021-05-28 Michael Backenköhler , Luca Bortolussi , Gerrit Großmann , Verena Wolf

In this invited contribution, we revisit the stochastic shortest path problem, and show how recent results allow one to improve over the classical solutions: we present algorithms to synthesize strategies with multiple guarantees on the…

Logic in Computer Science · Computer Science 2014-11-05 Mickael Randour , Jean-François Raskin , Ocan Sankur

We introduce Generator Matching, a modality-agnostic framework for generative modeling using arbitrary Markov processes. Generators characterize the infinitesimal evolution of a Markov process, which we leverage for generative modeling in a…

Machine Learning · Computer Science 2025-02-28 Peter Holderrieth , Marton Havasi , Jason Yim , Neta Shaul , Itai Gat , Tommi Jaakkola , Brian Karrer , Ricky T. Q. Chen , Yaron Lipman

A cornerstone of human statistical learning is the ability to extract temporal regularities / patterns from random sequences. Here we present a method of computing pattern time statistics with generating functions for first-order Markov…

Neurons and Cognition · Quantitative Biology 2018-06-29 Yanlong Sun , Hongbin Wang

We study very simple sorting algorithms based on a probabilistic comparator model. In our model, errors in comparing two elements are due to (1) the energy or effort put in the comparison and (2) the difference between the compared…

Data Structures and Algorithms · Computer Science 2018-05-16 Barbara Geissmann , Paolo Penna

We formalize and analyze the notions of stochastic monotonicity and realizable mono-tonicity for Markov Chains in continuous-time, taking values in a finite partially ordered set. Similarly to what happens in discrete-time, the two notions…

Probability · Mathematics 2016-03-08 Paolo Dai Pra , Pierre-Yves Louis , Ida Minelli

Dynamical fluctuations or rare events associated with atypical trajectories in chaotic maps due to specific initial conditions can crucially determine their fate, as the may lead to stability islands or regions in phase space otherwise…

Statistical Mechanics · Physics 2024-01-31 Ricardo Gutiérrez , Adrián Canella-Ortiz , Carlos Pérez-Espigares

How much information do we need about a process' past to faithfully simulate its future? The statistical complexity is a prominent quantifier of structure for stochastic processes. Quantum machines, however, can simulate classical…

The probability of rare and extreme events is an important quantity for design purposes. However, computing the probability of rare events can be expensive because only a few events, if any, can be observed. To this end, it is necessary to…

Computational Physics · Physics 2020-01-08 Malik Hassanaly , Venkat Raman

The numerical quantification of the statistics of rare events in stochastic processes is a challenging computational problem. We present a sampling method that constructs an ensemble of stochastic trajectories that are constrained to have…

Statistical Mechanics · Physics 2022-07-13 Javier Aguilar , Joseph W. Baron , Tobias Galla , Raul Toral

Symbolic event recognition systems have been successfully applied to a variety of application domains, extracting useful information in the form of events, allowing experts or other systems to monitor and respond when significant events are…

Artificial Intelligence · Computer Science 2013-08-16 Anastasios Skarlatidis , Georgios Paliouras , Alexander Artikis , George A. Vouros

This paper formed part of a preliminary research report for a risk consultancy and academic research. Stochastic Programming models provide a powerful paradigm for decision making under uncertainty. In these models the uncertainties are…

Computational Finance · Quantitative Finance 2009-04-08 Sovan Mitra

The paper is devoted to a systematic study of the duality of processes in the sense that $E f(X_t^x,y)=E f (x, Y_t^y)$ for a certain $f$. This classical topic has well known applications in interacting particles, intertwining,…

Probability · Mathematics 2022-05-03 Vassili Kolokoltsov , RuiXin Lee