English
Related papers

Related papers: Markovian Circuit Tracing for Transformer State Dy…

200 papers

Attention-based transformers have achieved tremendous success across a variety of disciplines including natural languages. To deepen our understanding of their sequential modeling capabilities, there is a growing interest in using Markov…

Machine Learning · Computer Science 2025-07-22 Ashok Vardhan Makkuva , Marco Bondaschi , Adway Girish , Alliot Nagle , Martin Jaggi , Hyeji Kim , Michael Gastpar

We propose a Bayesian hidden Markov model for analyzing time series and sequential data where a special structure of the transition probability matrix is embedded to model explicit-duration semi-Markovian dynamics. Our formulation allows…

Methodology · Statistics 2022-05-23 Beniamino Hadj-Amar , Jack Jewson , Mark Fiecas

Model-based offline reinforcement learning is brittle under distribution shift: policy improvement drives rollouts into state--action regions weakly supported by the dataset, where compounding model error yields severe value overestimation.…

Machine Learning · Computer Science 2026-02-04 Zeyu Fang , Zuyuan Zhang , Mahdi Imani , Tian Lan

This paper studies the traffic state estimation problem at signalized intersections with low penetration rate vehicle trajectory data. While many existing studies have proposed different methods to estimate unknown traffic states and…

Systems and Control · Electrical Eng. & Systems 2024-04-16 Xingmin Wang , Zihao Wang , Zachary Jerome , Henry X. Liu

Markov chains are simple yet powerful mathematical structures to model temporally dependent processes. They generally assume stationary data, i.e., fixed transition probabilities between observations/states. However, live, real-world…

Machine Learning · Computer Science 2024-11-27 Kutalmış Coşkun , Borahan Tümer , Bjarne C. Hiller , Martin Becker

We consider a unified framework of sequential change-point detection and hypothesis testing modeled by means of hidden Markov chains. One observes a sequence of random variables whose distributions are functionals of a hidden Markov chain.…

Optimization and Control · Mathematics 2013-12-13 Savas Dayanik , Kazutoshi Yamazaki

Hidden Markov models (HMMs) offer a robust and efficient framework for analyzing time series data, modelling both the underlying latent state progression over time and the observation process, conditional on the latent state. However, a…

Applications · Statistics 2024-07-19 Ioannis Rotous , Alex Diana , Alessio Farcomeni , Eleni Matechou , Andréa Thiebault

Hidden semi-Markov Models (HSMM's) - while broadly in use - are restricted to a discrete and uniform time grid. They are thus not well suited to explain often irregularly spaced discrete event data from continuous-time phenomena. We show…

Machine Learning · Statistics 2022-10-18 Nicolai Engelmann , Heinz Koeppl

The transient dynamics of quantum coherence of Gaussian states are investigated. The state is coupled to an external environment which can be described by a Fano-Anderson type Hamiltonian. Solving the quantum Langevin equation, we obtain…

Quantum Physics · Physics 2022-01-20 Md. Manirul Ali , Chandrashekar Radhakrishnan

Time series of conformational dynamics in proteins are usually evaluated with hidden Markov models (HMMs). This approach works well if the number of states and their connectivity is known. However, for the multi-domain protein Hsp90, a…

By monitoring the sampling of states with different magnetizations in transition matrix procedures a family of accurate and easily implemented techniques are constructed that automatically control the variation of the temperature or energy…

Statistical Mechanics · Physics 2017-05-24 David Yevick , Yong Hwan Lee

Markov state models (MSMs) have been widely used to analyze computer simulations of various biomolecular systems. They can capture conformational transitions much slower than an average or maximal length of a single molecular dynamics (MD)…

Biomolecules · Quantitative Biology 2018-02-14 Anton V. Sinitskiy , Vijay S. Pande

Transition Path Theory (TPT) provides a rigorous statistical characterization of the ensemble of trajectories connecting directly, i.e., without detours, two disconnected (sets of) states in a Markov chain, a stochastic process that…

Statistical Mechanics · Physics 2023-06-28 G. Bonner , F. J. Beron-Vera , M. J. Olascoaga

We propose a history-driven target (HDT) framework in Markov Chain Monte Carlo (MCMC) to improve any random walk algorithm on discrete state spaces, such as general undirected graphs, for efficient sampling from target distribution…

Machine Learning · Computer Science 2025-07-29 Jie Hu , Yi-Ting Ma , Do Young Eun

Motivated by applications arising in networked systems, this work examines controlled regime-switching systems that stem from a mean-variance formulation. A main point is that the switching process is a hidden Markov chain. An additional…

Optimization and Control · Mathematics 2014-01-21 Zhixin Yang , George Yin , Qing Zhang

We propose a new Bayesian tracking and parameter learning algorithm for non-linear non-Gaussian multiple target tracking (MTT) models. We design a Markov chain Monte Carlo (MCMC) algorithm to sample from the posterior distribution of the…

Applications · Statistics 2015-10-28 Lan Jiang , Sumeetpal S. Singh , Sinan Yıldırım

This work is devoted to the almost sure stabilization of adaptive control systems that involve an unknown Markov chain. The control system displays continuous dynamics represented by differential equations and discrete events given by a…

Probability · Mathematics 2008-07-10 Bernard Bercu , Francois Dufour , G. George Yin

The formalism of state estimation and hidden Markov models (HMMs) can simplify and clarify the discussion of stochastic thermodynamics in the presence of feedback and measurement errors. After reviewing the basic formalism, we use it to…

Statistical Mechanics · Physics 2015-11-13 John Bechhoefer

This paper presents a mathematical framework for causal nonlinear prediction in settings where observations are generated from an underlying hidden Markov model (HMM). Both the problem formulation and the proposed solution are motivated by…

Machine Learning · Computer Science 2026-03-16 Heng-Sheng Chang , Prashant G. Mehta

We present a data-driven model predictive control scheme for chance-constrained Markovian switching systems with unknown switching probabilities. Using samples of the underlying Markov chain, ambiguity sets of transition probabilities are…

Optimization and Control · Mathematics 2020-10-02 Mathijs Schuurmans , Panagiotis Patrinos