English
Related papers

Related papers: Adaptive Markov State Model estimation using short…

200 papers

Closed-loop irrigation can deliver a promising solution for precision irrigation. The accurate soil moisture (state) estimation is critical in implementing the closed-loop irrigation of agrohydrological systems. In general, the agricultural…

Systems and Control · Electrical Eng. & Systems 2021-12-23 Soumya R. Sahoo , Jinfeng Liu

Hidden Markov models (HMMs) and their extensions have proven to be powerful tools for classification of observations that stem from systems with temporal dependence as they take into account that observations close in time are likely…

Applications · Statistics 2021-11-22 Sofia Ruiz-Suarez , Vianey Leos-Barajas , Juan Manuel Morales

Recent research in decision theoretic planning has focussed on making the solution of Markov decision processes (MDPs) more feasible. We develop a family of algorithms for structured reachability analysis of MDPs that are suitable when an…

Artificial Intelligence · Computer Science 2013-04-24 Craig Boutilier , Ronen I. Brafman , Christopher W. Geib

We present a theoretical analysis of some popular adaptive Stochastic Gradient Descent (SGD) methods in the small learning rate regime. Using the stochastic modified equations framework introduced by Li et al., we derive effective…

Machine Learning · Statistics 2025-09-29 Luca Callisti , Marco Romito , Francesco Triggiano

The problem of state tracking with active observation control is considered for a system modeled by a discrete-time, finite-state Markov chain observed through conditionally Gaussian measurement vectors. The measurement model statistics are…

Systems and Control · Computer Science 2015-06-18 Daphney-Stavroula Zois , Marco Levorato , Urbashi Mitra

The molecular motor protein kinesin plays a key role in fundamental cellular processes such as intracellular transport, mitotic spindle formation, and cytokinesis, with important implications for neurodegenerative and cancer disease…

Biomolecules · Quantitative Biology 2014-11-18 B. D. Jacobson , L. J. Herskowitz , S. J. Koch , S. R. Atlas

The study of biomolecular folding has been greatly advanced by single-molecule force spectroscopy (SMFS), which enables the observation of the dynamics of individual molecules. However, extracting quantitative models of fundamental…

Chemical Physics · Physics 2026-04-30 Lars Dingeldein , Aaron Lyons , Pilar Cossio , Michael Woodside , Roberto Covino

Stochastic kinetic models (SKMs) are increasingly used to account for the inherent stochasticity exhibited by interacting populations of species in areas such as epidemiology, population ecology and systems biology. Species numbers are…

Computation · Statistics 2023-04-06 Tom E. Lowe , Andrew Golightly , Chris Sherlock

Software-intensive systems, such as software product lines and robotics, utilise Markov decision processes (MDPs) to capture uncertainty and analyse sequential decision-making problems. Despite the usefulness of conventional policy…

Artificial Intelligence · Computer Science 2026-05-01 Alexandros Evangelidis , Gricel Vázquez , Simos Gerasimou

We present a novel machine learning approach to understanding conformation dynamics of biomolecules. The approach combines kernel-based techniques that are popular in the machine learning community with transfer operator theory for…

Computational Physics · Physics 2019-01-24 Stefan Klus , Andreas Bittracher , Ingmar Schuster , Christof Schütte

Molecular dynamics (MD) simulation is a widely used technique to simulate molecular systems, most commonly at the all-atom resolution where equations of motion are integrated with timesteps on the order of femtoseconds…

State redistribution (SRD) is a recently developed technique for stabilizing cut cells that result from finite-volume embedded boundary methods. SRD has been successfully applied to a variety of compressible and incompressible flow…

Numerical Analysis · Mathematics 2023-09-13 Isabel Barrio Sanchez , Ann S. Almgren , John B. Bell , Marc T. Henry de Frahan , Weiqun Zhang

Molecular dynamics (MD) simulations are essential tools in computational chemistry and drug discovery, offering crucial insights into dynamic molecular behavior. However, their utility is significantly limited by substantial computational…

Chemical Physics · Physics 2025-09-04 Bin Feng , Jiying Zhang , Xinni Zhang , Zijing Liu , Yu Li

Recurrent neural networks are able to learn complex long-term relationships from sequential data and output a pdf over the state space. Therefore, recurrent models are a natural choice to address path prediction tasks, where a trained model…

Computer Vision and Pattern Recognition · Computer Science 2018-08-30 Ronny Hug , Stefan Becker , Wolfgang Hübner , Michael Arens

We introduce a new method to accurately and efficiently estimate the effective dynamics of collective variables in molecular simulations. Such reduced dynamics play an essential role in the study of a broad class of processes, ranging from…

Statistical Mechanics · Physics 2022-03-28 Hadrien Vroylandt , Ludovic Goudenège , Pierre Monmarché , Fabio Pietrucci , Benjamin Rotenberg

We propose an adaptive biasing algorithm aimed at enhancing the sampling of multimodal measures by Langevin dynamics. The underlying idea consists in generalizing the standard adaptive biasing force method commonly used in conjunction with…

Analysis of PDEs · Mathematics 2010-08-23 Chris Chipot , Tony Lelièvre

A Markov state model is a powerful tool that can be used to track the evolution of populations of configurations in an atomistic representation of a protein. For a coarse-grained linear chain model with discontinuous interactions, the…

Soft Condensed Matter · Physics 2024-02-06 Margarita Colberg , Jeremy Schofield

We propose a Bayesian hidden Markov model for analyzing time series and sequential data where a special structure of the transition probability matrix is embedded to model explicit-duration semi-Markovian dynamics. Our formulation allows…

Methodology · Statistics 2022-05-23 Beniamino Hadj-Amar , Jack Jewson , Mark Fiecas

Developing physics-based models for molecular simulation requires fitting many unknown parameters to diverse experimental datasets. Traditionally, this process is piecemeal and difficult to reproduce, leading to a fragmented landscape of…

Biological Physics · Physics 2025-04-10 Ryan K. Krueger , Megan C. Engel , Ryan Hausen , Michael P. Brenner

Dynamic Mode Decomposition (DMD) is a powerful data-driven method used to extract spatio-temporal coherent structures that dictate a given dynamical system. The method consists of stacking collected temporal snapshots into a matrix and…

Machine Learning · Computer Science 2021-05-11 Gabriel F. Barros , Malú Grave , Alex Viguerie , Alessandro Reali , Alvaro L. G. A. Coutinho