English
Related papers

Related papers: Universal Filtering via Hidden Markov Modeling

200 papers

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

We consider the problem of approximating optimal in the Minimum Mean Squared Error (MMSE) sense nonlinear filters in a discrete time setting, exploiting properties of stochastically convergent state process approximations. More…

Statistics Theory · Mathematics 2016-11-15 Dionysios S. Kalogerias , Athina P. Petropulu

A hidden Markov model is called observable if distinct initial laws give rise to distinct laws of the observation process. Observability implies stability of the nonlinear filter when the signal process is tight, but this need not be the…

Probability · Mathematics 2009-08-10 Ramon van Handel

The hidden Markov model (HMM) is a fundamental tool for sequence modeling that cleanly separates the hidden state from the emission structure. However, this separation makes it difficult to fit HMMs to large datasets in modern NLP, and they…

Computation and Language · Computer Science 2020-11-10 Justin T. Chiu , Alexander M. Rush

Conformal inference is a statistical method used to construct prediction sets for point predictors, providing reliable uncertainty quantification with probability guarantees. This method utilizes historical labeled data to estimate the…

Machine Learning · Computer Science 2024-11-05 Xiaoyi Su , Zhixin Zhou , Rui Luo

We propose a theory of unimodal maps perturbed by an heteroscedastic Markov chain noise and experiencing another heteroscedastic noise due to uncertain observation. We address and treat the filtering problem showing that by collecting more…

Statistics Theory · Mathematics 2024-11-26 Fabrizio Lillo , Stefano Marmi , Matteo Tanzi , Sandro Vaienti

The forgetting of the initial distribution for discrete Hidden Markov Models (HMM) is addressed: a new set of conditions is proposed, to establish the forgetting property of the filter, at a polynomial and geometric rate. Both a…

Statistics Theory · Mathematics 2008-07-18 Randal Douc , Gersende Fort , Eric Moulines , Pierre Priouret

We consider the problem of filtering an unseen Markov chain from noisy observations, in the presence of uncertainty regarding the parameters of the processes involved. Using the theory of nonlinear expectations, we describe the uncertainty…

Methodology · Statistics 2018-05-15 Samuel N. Cohen

Finite state space hidden Markov models are flexible tools to model phenomena with complex time dependencies: any process distribution can be approximated by a hidden Markov model with enough hidden states.We consider the problem of…

Statistics Theory · Mathematics 2021-02-16 Luc Lehéricy

We address the problem of detecting an anomalous process among a large number of processes. At each time t, normal processes are in state zero (normal state), while the abnormal process may be in either state zero (normal state) or state…

Signal Processing · Electrical Eng. & Systems 2025-06-23 Levli Citron , Kobi Cohen , Qing Zhao

We consider estimating the transition probability matrix of a finite-state finite-observation alphabet hidden Markov model with known observation probabilities. The main contribution is a two-step algorithm; a method of moments estimator…

Systems and Control · Computer Science 2017-11-22 Robert Mattila , Cristian R. Rojas , Vikram Krishnamurthy , Bo Wahlberg

Herein, we analyze an efficient branching particle method for asymptotic solutions to a class of continuous-discrete filtering problems. Suppose that $t\to X_t$ is a Markov process and we wish to calculate the measure-valued process…

Probability · Mathematics 2007-05-23 Michael A. Kouritzin , Wei Sun

We develop a (nearly) unbiased particle filtering algorithm for a specific class of continuous-time state-space models, such that (a) the latent process $X_t$ is a linear Gaussian diffusion; and (b) the observations arise from a Poisson…

Computation · Statistics 2023-11-07 Ruiyang Jin , Sumeetpal S. Singh , Nicolas Chopin

Suppose that we are given a time series where consecutive samples are believed to come from a probabilistic source, that the source changes from time to time and that the total number of sources is fixed. Our objective is to estimate the…

Information Theory · Computer Science 2018-04-24 Mark Kozdoba , Shie Mannor

We consider a unified framework of sequential change-point detection and hypothesis testing modeled by means of hidden Markov chains. One observes a sequence of random variables whose distributions are functionals of a hidden Markov chain.…

Optimization and Control · Mathematics 2013-12-13 Savas Dayanik , Kazutoshi Yamazaki

Nature, as far as we know, evolves continuously through space and time. Yet the ubiquitous hidden Markov model (HMM)--originally developed for discrete time and space analysis in natural language processing--remains a central tool in…

Biomolecules · Quantitative Biology 2025-06-09 Max Schweiger , Ayush Saurabh , Steve Pressé

The hidden Markov model (HMM) provides a powerful framework for inference in time-varying environments, where the underlying state evolves according to a Markov chain. To address the optimal filtering problem in general dynamic settings, we…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Dongyan Sui , Haotian Pu , Siyang Leng , Stefan Vlaski

In this paper we consider a control problem for a Partially Observable Piecewise Deterministic Markov Process of the following type: After the jump of the process the controller receives a noisy signal about the state and the aim is to…

Optimization and Control · Mathematics 2021-07-21 Nicole Bäuerle , Dirk Lange

In this paper, we study a simple correlation-based strategy for estimating the unknown delay and amplitude of a signal based on a small number of noisy, randomly chosen frequency-domain samples. We model the output of this "compressive…

Information Theory · Computer Science 2016-11-17 Armin Eftekhari , Justin Romberg , Michael B. Wakin

This work proposes a multi-agent filtering algorithm over graphs for finite-state hidden Markov models (HMMs), which can be used for sequential state estimation or for tracking opinion formation over dynamic social networks. We show that…

Signal Processing · Electrical Eng. & Systems 2022-03-10 Mert Kayaalp , Virginia Bordignon , Stefan Vlaski , Ali H. Sayed