English
Related papers

Related papers: An Information Bottleneck Approach for Markov Mode…

200 papers

Markov state models (MSMs) have been broadly adopted for analyzing molecular dynamics trajectories, but the approximate nature of the models that results from coarse-graining into discrete states is a long-known limitation. We show…

Computational Physics · Physics 2021-05-31 John D. Russo , Jeremy Copperman , David Aristoff , Gideon Simpson , Daniel M. Zuckerman

Leveraging high-quality joint representations from multimodal data can greatly enhance model performance in various machine-learning based applications. Recent multimodal learning methods, based on the multimodal information bottleneck…

Machine Learning · Computer Science 2025-05-27 Qilong Wu , Yiyang Shao , Jun Wang , Xiaobo Sun

Computational modeling of assembly is challenging for many systems because their timescales vastly exceed those accessible to simulations. This article describes the MultiMSM, which is a general framework that uses Markov state models…

Soft Condensed Matter · Physics 2024-05-07 Anthony Trubiano , Michael F. Hagan

State-space models (SSMs) are commonly used to model time series data where the observations depend on an unobserved latent process. However, inference on the model parameters of an SSM can be challenging, especially when the likelihood of…

Computation · Statistics 2023-08-08 Mary Llewellyn , Ruth King , Víctor Elvira , Gordon Ross

State Space Models (SSMs), particularly recent selective variants like Mamba, have emerged as a leading architecture for sequence modeling, challenging the dominance of Transformers. However, the success of these state-of-the-art models…

Machine Learning · Computer Science 2025-08-06 Yiyi Wang , Jian'an Zhang , Hongyi Duan , Haoyang Liu , Qingyang Li

Machine learning interatomic potentials (MLIPs) enable efficient molecular dynamics (MD) simulations with ab initio accuracy and have been applied across various domains in physical science. However, their performance often relies on…

Computational Physics · Physics 2025-07-29 Taoyong Cui , Zhongyao Wang , Dongzhan Zhou , Yuqiang Li , Lei Bai , Wanli Ouyang , Mao Su , Shufei Zhang

Present-day atomistic simulations generate long trajectories of ever more complex systems. Analyzing these data, discovering metastable states, and uncovering their nature is becoming increasingly challenging. In this paper, we first use…

Computational Physics · Physics 2023-06-23 Pietro Novelli , Luigi Bonati , Massimiliano Pontil , Michele Parrinello

Information Bottleneck (IB) is widely used, but in deep learning, it is usually implemented through tractable surrogates, such as variational bounds or neural mutual information (MI) estimators, rather than directly controlling the MI…

Machine Learning · Computer Science 2026-02-05 Weiqi Wang , Zhiyi Tian , Chenhan Zhang , Shui Yu

State space models (SSMs) have emerged as a powerful framework for modelling long-range dependencies in sequence data. Unlike traditional recurrent neural networks (RNNs) and convolutional neural networks (CNNs), SSMs offer a structured and…

Machine Learning · Computer Science 2024-10-07 Siddhanth Bhat

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) form a useful tool for modeling dynamical systems. They are particularly useful for representing environments such as road networks and office…

Artificial Intelligence · Computer Science 2013-01-30 Hagit Shatkay

The information bottleneck (IB) principle has been suggested as a way to analyze deep neural networks. The learning dynamics are studied by inspecting the mutual information (MI) between the hidden layers and the input and output. Notably,…

Machine Learning · Computer Science 2022-02-15 Stephan Sloth Lorenzen , Christian Igel , Mads Nielsen

Synthetic molecular dynamics (synMD) trajectories from learned generative models have been proposed as a useful addition to the biomolecular simulation toolbox. The computational expense of explicitly integrating the equations of motion in…

Computational Physics · Physics 2022-05-05 John D. Russo , Daniel M. Zuckerman

We introduce the Markov Stochastic Block Model (MSBM): a growth model for community based networks where node attributes are assigned through a Markovian dynamic. We rely on HMMs' literature to design prediction methods that are robust to…

Social and Information Networks · Computer Science 2023-01-09 Quentin Duchemin

Multi-state models are commonly used for intermittent observations of a state over time, but these are generally based on the Markov assumption, that transition rates are independent of the time spent in current and previous states. In a…

Methodology · Statistics 2026-05-07 Christopher Jackson

Recent pre-training strategies for molecular graphs have attempted to use 2D and 3D molecular views as both inputs and self-supervised signals, primarily aligning graph-level representations. However, existing studies remain limited in…

Machine Learning · Computer Science 2025-11-25 Van Thuy Hoang , O-Joun Lee

An adaptive physics-inspired model design strategy for machine-learning interatomic potentials (MLIPs) is proposed. This strategy relies on iterative reconfigurations of composite models from single-term models, followed by a unified…

Materials Science · Physics 2026-02-27 Weishi Wang , Mark K. Transtrum , Vincenzo Lordi , Vasily V. Bulatov , Amit Samanta

With recent advances in structural biology, including experimental techniques and deep learning-enabled high-precision structure predictions, molecular dynamics methods that scale up to large biomolecular systems are required. Current…

Biological Physics · Physics 2022-06-24 Tim Hempel , Simon Olsson , Frank Noé

A state-space model is a time-series model that has an unobserved latent process from which we take noisy measurements over time. The observations are conditionally independent given the latent process and the latent process itself is…

Methodology · Statistics 2025-10-07 Paul Fearnhead , Chris Sherlock

When clustering molecular dynamics (MD) trajectories into a few metastable conformational states, the Markov state models (MSMs) assumption of timescale separation between fast intrastate fluctuations and rarely occurring interstate…

Soft Condensed Matter · Physics 2025-01-17 Sofia Sartore , Franziska Teichmann , Gerhard Stock

Predictions for physical systems often rely upon knowledge acquired from ensembles of entities, e.g., ensembles of cells in biological sciences. For qualitative and quantitative analysis, these ensembles are simulated with parametric…

Machine Learning · Statistics 2023-09-28 Timothy Rumbell , Jaimit Parikh , James Kozloski , Viatcheslav Gurev