English
Related papers

Related papers: Efficient estimation of rare-event kinetics

200 papers

Markov chains are simple yet powerful mathematical structures to model temporally dependent processes. They generally assume stationary data, i.e., fixed transition probabilities between observations/states. However, live, real-world…

Machine Learning · Computer Science 2024-11-27 Kutalmış Coşkun , Borahan Tümer , Bjarne C. Hiller , Martin Becker

Large-scale rare events data are commonly encountered in practice. To tackle the massive rare events data, we propose a novel distributed estimation method for logistic regression in a distributed system. For a distributed framework, we…

Methodology · Statistics 2023-04-06 Xuetong Li , Xuening Zhu , Hansheng Wang

We consider continuous time Markovian processes where populations of individual agents interact stochastically according to kinetic rules. Despite the increasing prominence of such models in fields ranging from biology to smart cities,…

Machine Learning · Statistics 2016-05-16 Anastasis Georgoulas , Jane Hillston , Guido Sanguinetti

We present an algorithm for the simulation of the exact real-time dynamics of classical many-body systems with discrete energy levels. In the same spirit of kinetic Monte Carlo methods, a stochastic solution of the master equation is found,…

Statistical Mechanics · Physics 2016-07-20 Alejandro Mendoza-Coto , Rogelio Díaz-Méndez , Guido Pupillo

Stochastic and soft optimal policies resulting from entropy-regularized Markov decision processes (ER-MDP) are desirable for exploration and imitation learning applications. Motivated by the fact that such policies are sensitive with…

Machine Learning · Computer Science 2022-01-03 Tien Mai , Patrick Jaillet

The paper studies an improved estimate for the rate of convergence for nonlinear homogeneous discrete-time Markov chains. These processes are nonlinear in terms of the distribution law. Hence, the transition kernels are dependent on the…

Probability · Mathematics 2021-05-21 Aleksandr Shchegolev

Extreme El Ni\~no events, such as occurred in 1997--1998, can induce severe weather on a global scale, with significant socioeconomic impacts that motivate efforts to understand them better. However, extreme El Ni\~no events are rare, and…

Atmospheric and Oceanic Physics · Physics 2025-12-30 Sarah Packman , Justin Finkel , Dorian S. Abbot , Eli Tziperman

There are multiple ways in which a stochastic system can be out of statistical equilibrium. It might be subject to time-varying forcing; or be in a transient phase on its way towards equilibrium; it might even be in equilibrium without us…

Dynamical Systems · Mathematics 2019-07-08 Péter Koltai , Hao Wu , Frank Noé , Christof Schütte

Atomistic simulations with methods such as molecular dynamics are extremely powerful tools to understand nanoscale dynamical behavior. The resulting trajectories, by the virtue of being embedded in a high-dimensional configuration space,…

Statistical Mechanics · Physics 2020-08-27 Animesh Agarwal , Sandrasegaram Gnanakaran , Nicholas Hengartner , Arthur F. Voter , Danny Perez

We present a theory of modified reduced dynamics in the presence of counting fields. Reduced dynamics techniques are useful for describing open quantum systems at long emergent timescales when the memory timescales are short. However, they…

Quantum Physics · Physics 2022-08-24 Felix A. Pollock , Emanuel Gull , K. Modi , Guy Cohen

We address the problem of identifying the dynamical law governing the evolution of a population of indistinguishable particles, when only aggregate distributions at successive times are observed. Assuming a Markovian evolution on a discrete…

Optimization and Control · Mathematics 2025-11-21 Michele Mascherpa , Axel Ringh , Amirhossein Taghvaei , Johan Karlsson

Predictive equivalence in discrete stochastic processes have been applied with great success to identify randomness and structure in statistical physics and chaotic dynamical systems and to inferring hidden Markov models. We examine the…

Statistical Mechanics · Physics 2021-09-21 Samuel P. Loomis , James P. Crutchfield

We propose a unified framework that extends the inference methods for classical hidden Markov models to continuous settings, where both the hidden states and observations occur in continuous time. Two different settings are analyzed: hidden…

Methodology · Statistics 2021-06-18 Qingcan Wang , Weinan E

We consider the problem of model building for rare events prediction in longitudinal follow-up studies. In this paper, we compare several resampling methods to improve standard regression models on a real life example. We evaluate the…

Methodology · Statistics 2023-06-21 Pierre Druilhet , Mathieu Berthe , Stéphanie Léger

We obtain a perfect sampling characterization of weak ergodicity for backward products of finite stochastic matrices, and equivalently, simultaneous tail triviality of the corresponding nonhomogeneous Markov chains. Applying these ideas to…

Statistics Theory · Mathematics 2016-01-07 Nick Whiteley , Anthony Lee

Closely related to the laws of thermodynamics, the detection and quantification of disequilibria are crucial in unraveling the complexities of nature, particularly those beneath observable layers. Theoretical developments in nonequilibrium…

Statistical Mechanics · Physics 2024-07-23 Pedro E. Harunari

We establish sufficient conditions for exponential convergence to a unique quasi-stationary distribution in the total variation norm. These conditions also ensure the existence and exponential ergodicity of the Q-process, the process…

Probability · Mathematics 2023-08-01 Aurélien Velleret

Markov State Models (MSM) are widely used to elucidate dynamic properties of molecular systems from unbiased Molecular Dynamics (MD). However, the implementation of reweighting schemes for MSMs to analyze biased simulations, for example…

Chemical Physics · Physics 2020-11-26 Stefanie Kieninger , Luca Donati , Bettina G. Keller

We propose a method to sample stationary properties of solutions of stochastic differential equations, which is accurate and efficient if there are rarely visited regions or rare transitions between distinct regions of the state space. The…

Statistical Mechanics · Physics 2016-03-23 Rüdiger Kürsten , Ulrich Behn

In this paper, we consider linear state-space models with compressible innovations and convergent transition matrices in order to model spatiotemporally sparse transient events. We perform parameter and state estimation using a dynamic…

Machine Learning · Statistics 2016-10-21 Abbas Kazemipour , Ji Liu , Patrick Kanold , Min Wu , Behtash Babadi