English
Related papers

Related papers: Dynamical reweighting methods for Markov models

200 papers

Probabilistic models analyze data by relying on a set of assumptions. Data that exhibit deviations from these assumptions can undermine inference and prediction quality. Robust models offer protection against mismatch between a model's…

Machine Learning · Statistics 2018-06-20 Yixin Wang , Alp Kucukelbir , David M. Blei

Dynamic trajectories can be modeled with a Markov State Model (MSM). The reduction of continuous space coordinates to discretized coordinates can be done by statistical binning process. In addition to that, the transition probabilities can…

Statistical Mechanics · Physics 2015-06-02 Efe Ilker

When sampling multi-modal probability distributions, correctly estimating the relative probability of each mode, even when the modes have been discovered and locally sampled, remains challenging. We test a simple reweighting scheme designed…

Statistics Theory · Mathematics 2026-02-17 Pierre Monmarché

Machine learning (ML) has emerged as a pervasive tool in science, engineering, and beyond. Its success has also led to several synergies with molecular dynamics (MD) simulations, which we use to identify and characterize the major…

Biomolecules · Quantitative Biology 2022-05-09 Christopher Kolloff , Simon Olsson

We present a maximum-caliber method for inferring transition rates of a Markov State Model (MSM) with perturbed equilibrium populations, given estimates of state populations and rates for an unperturbed MSM. It is similar in spirit to…

Biomolecules · Quantitative Biology 2016-05-26 Vincent A. Voelz , Guangfeng Zhou , Hongbin Wan

Many processes in chemistry and physics take place on timescales that cannot be explored using standard molecular dynamics simulations. This renders the use of enhanced sampling mandatory. Here we introduce an enhanced sampling method that…

Chemical Physics · Physics 2020-06-12 Jayashrita Debnath , Michele Parrinello

Particle Markov Chain Monte Carlo methods are used to carry out inference in non-linear and non-Gaussian state space models, where the posterior density of the states is approximated using particles. Current approaches usually perform…

Computation · Statistics 2019-09-30 Eduardo F. Mendes , Christopher K. Carter , David Gunawan , Robert Kohn

Filtering is concerned with the sequential estimation of the state, and uncertainties, of a Markovian system, given noisy observations. It is particularly difficult to achieve accurate filtering in complex dynamical systems, such as those…

Probability · Mathematics 2015-12-14 Wonjung Lee , Andrew Stuart

Computing averages over a target probability density by statistical re-weighting of a set of samples with a different distribution is a strategy which is commonly adopted in fields as diverse as atomistic simulation and finance. Here we…

Chemical Physics · Physics 2012-02-21 Michele Ceriotti , Guy A. R. Brain , Oliver Riordan , David E. Manolopoulos

A resampling scheme provides a way to switch low-weight particles for sequential Monte Carlo with higher-weight particles representing the objective distribution. The less the variance of the weight distribution is, the more concentrated…

Computation · Statistics 2023-09-19 Xiongming Dai , Gerald Baumgartner

This work presents a low-rank tensor model for multi-dimensional Markov chains. A common approach to simplify the dynamical behavior of a Markov chain is to impose low-rankness on the transition probability matrix. Inspired by the success…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Madeline Navarro , Sergio Rozada , Antonio G. Marques , Santiago Segarra

We introduce a new micro-macro Markov chain Monte Carlo method (mM-MCMC) to sample invariant distributions of molecular dynamics systems that exhibit a time-scale separation between the microscopic (fast) dynamics, and the macroscopic…

Numerical Analysis · Mathematics 2020-02-24 Hannes Vandecasteele , Giovanni Samaey

Model merging aims to combine multiple fine-tuned models into a single set of weights that performs well across all source tasks. While prior work has shown that merging can approximate the performance of individual fine-tuned models for…

Machine Learning · Computer Science 2025-10-17 Mohammadsajad Alipour , Mohammad Mohammadi Amiri

Parameter sensitivity analysis is a powerful tool in the building and analysis of biochemical network models. For stochastic simulations, parameter sensitivity analysis can be computationally expensive, requiring multiple simulations for…

Computational Physics · Physics 2015-06-04 Patrick B. Warren , Rosalind J. Allen

Importance sampling is a variance reduction technique for efficient estimation of rare-event probabilities by Monte Carlo. In standard importance sampling schemes, the system is simulated using an a priori fixed change of measure suggested…

Probability · Mathematics 2007-05-23 Paul Dupuis , Hui Wang

We present two algorithms by which a set of short, unbiased trajectories can be iteratively reweighted to obtain various observables. The first algorithm estimates the stationary (steady state) distribution of a system by iteratively…

Computational Physics · Physics 2020-06-18 John D. Russo , Jeremy Copperman , Daniel M. Zuckerman

Markov processes with stochastic resetting towards the origin generically converge towards non-equilibrium steady-states. Long dynamical trajectories can be thus analyzed via the large deviations at Level 2.5 for the joint probability of…

Statistical Mechanics · Physics 2021-05-07 Cecile Monthus

Cyber-physical systems (CPSs) are naturally modelled as reactive systems with nondeterministic and probabilistic dynamics. Model-based verification techniques have proved effective in the deployment of safety-critical CPSs. Central for a…

Machine Learning · Computer Science 2021-10-08 Giovanni Bacci , Anna Ingólfsdóttir , Kim Larsen , Raphaël Reynouard

Malliavin weight sampling (MWS) is a stochastic calculus technique for computing the derivatives of averaged system properties with respect to parameters in stochastic simulations, without perturbing the system's dynamics. It applies to…

Statistical Mechanics · Physics 2013-12-31 Patrick B. Warren , Rosalind J. Allen

We propose a probabilistic modeling framework for learning the dynamic patterns in the collective behaviors of social agents and developing profiles for different behavioral groups, using data collected from multiple information sources.…

Machine Learning · Statistics 2016-06-28 Lin Li , Ananthram Swami , Anna Scaglione