English
Related papers

Related papers: Markov State Models for Tracking Reaction Dynamics…

200 papers

This paper investigates hybrid kinetic-MHD models, where a hot plasma (governed by a kinetic theory) interacts with a fluid bulk (governed by MHD). Different nonlinear coupling schemes are reviewed, including the pressure-coupling scheme…

Plasma Physics · Physics 2014-07-10 Cesare Tronci , Emanuele Tassi , Enrico Camporeale , Philip J. Morrison

In this article a flexible Bayesian non-parametric model is proposed for non-homogeneous hidden Markov models. The model is developed through the amalgamation of the ideas of hidden Markov models and predictor dependent stick-breaking…

Methodology · Statistics 2012-05-10 Abhra Sarkar , Anindya Bhadra , Bani K. Mallick

Marked temporal point processes (MTPPs) model sequences of events occurring at irregular time intervals, with wide-ranging applications in fields such as healthcare, finance and social networks. We propose the state-space point process…

Machine Learning · Statistics 2025-10-24 Yuxin Chang , Alex Boyd , Cao Xiao , Taha Kass-Hout , Parminder Bhatia , Padhraic Smyth , Andrew Warrington

We develop a semi-parametric state-space model for time-series data with latent regime transitions. Classical Markov-switching models use fixed parametric transition functions, such as logistic or probit links, which restrict flexibility…

Machine Learning · Statistics 2026-04-08 Prakul Sunil Hiremath

Recurrent State-space models (RSSMs) are highly expressive models for learning patterns in time series data and system identification. However, these models assume that the dynamics are fixed and unchanging, which is rarely the case in…

Machine Learning · Computer Science 2023-10-16 Vaisakh Shaj , Dieter Buchler , Rohit Sonker , Philipp Becker , Gerhard Neumann

By considering general Markov stochastic dynamics and its coarse-graining, we study the framework of stochastic thermodynamics for the original and reduced descriptions corresponding to different scales. We are especially concerned with the…

Statistical Mechanics · Physics 2015-01-29 Yohei Nakayama , Kyogo Kawaguchi

Accurate modelling of electrostatic interactions and charge transfer is fundamental to computational chemistry, yet most machine learning interatomic potentials (MLIPs) rely on local atomic descriptors that cannot capture long-range…

The design of efficient electrolysis devices for pure metal production requires accurate data on the properties of the melts used in the process. This work focuses on two key systems for calcium production: the molten Ca-Cu alloy and the…

Materials Science · Physics 2026-03-27 M. Polovinkin , N. Rybin , D. Maksimov , F. Valiev , A. Khudorozhkova , M. Laptev , A. Rudenko , A. Shapeev

Markov Decision Processes (MDPs) have been used to formulate many decision-making problems in science and engineering. The objective is to synthesize the best decision (action selection) policies to maximize expected rewards (or minimize…

Optimization and Control · Mathematics 2015-07-07 Mahmoud El Chamie , Behcet Acikmese

Molecular dynamics with the stochastic process provides a convenient way to compute structural and thermodynamic properties of chemical, biological, and materials systems. It is demonstrated that the virtual dynamics case that we proposed…

Statistical Mechanics · Physics 2018-03-20 Dezhang Li , Zifei Chen , Zhijun Zhang , Jian Liu

Understanding the dynamic behavior of biomolecules is fundamental to elucidating biological function and facilitating drug discovery. While Molecular Dynamics (MD) simulations provide a rigorous physical basis for studying these dynamics,…

Biomolecules · Quantitative Biology 2026-03-19 Liang Shi , Jiarui Lu , Junqi Liu , Chence Shi , Zhi Yang , Jian Tang

Nature, as far as we know, evolves continuously through space and time. Yet the ubiquitous hidden Markov model (HMM)--originally developed for discrete time and space analysis in natural language processing--remains a central tool in…

Biomolecules · Quantitative Biology 2025-06-09 Max Schweiger , Ayush Saurabh , Steve Pressé

Nonlinear non-Gaussian state-space models are ubiquitous in statistics, econometrics, information engineering and signal processing. Particle methods, also known as Sequential Monte Carlo (SMC) methods, provide reliable numerical…

Computation · Statistics 2015-09-11 Nikolas Kantas , Arnaud Doucet , Sumeetpal S. Singh , Jan Maciejowski , Nicolas Chopin

Coarse-grained (CG) models can provide computationally efficient and conceptually simple characterizations of soft matter systems. While generic models probe the underlying physics governing an entire family of free-energy landscapes,…

Soft Condensed Matter · Physics 2019-08-15 Joseph F. Rudzinski

A multiscale scheme combining molecular dynamics (MD) and microscopic phase-field theory is proposed to study the structural phase transformations in solids with inhomogeneous strain field. The approach calculates strain response based on…

Materials Science · Physics 2007-05-23 Zhi-Rong Liu , Huajian Gao

Deep Markov models (DMM) are generative models that are scalable and expressive generalization of Markov models for representation, learning, and inference problems. However, the fundamental stochastic stability guarantees of such models…

Machine Learning · Computer Science 2021-11-09 Ján Drgoňa , Sayak Mukherjee , Jiaxin Zhang , Frank Liu , Mahantesh Halappanavar

State-space models (SSMs) offer a powerful framework for dynamical system analysis, wherein the temporal dynamics of the system are assumed to be captured through the evolution of the latent states, which govern the values of the…

Machine Learning · Statistics 2024-12-17 Jiahe Lin , George Michailidis

Quantum state tomography (QST) is the gold standard technique for obtaining an estimate for the state of small quantum systems in the laboratory. Its application to systems with more than a few constituents (e.g. particles) soon becomes…

A new Markov Chain Monte Carlo method for simulating the dynamics of molecular systems characterized by hard-core interactions is introduced. In contrast to traditional Kinetic Monte Carlo approaches, where the state of the system is…

Computational Physics · Physics 2017-02-07 Liborio I. Costa

The chemical fueling of transient states (CFTS) is a powerful process to control the nonequilibrium structuring and the homeostatic function of adaptive soft matter systems. Here, we introduce a mean-field model of CFTS based on the…

Soft Condensed Matter · Physics 2023-06-12 Sven Pattloch , Joachim Dzubiella