English
Related papers

Related papers: Prediction with a Short Memory

200 papers

Standard practice in Hidden Markov Model (HMM) selection favors the candidate with the highest full-sequence likelihood, although this is equivalent to making a decision based on a single realization. We introduce a \emph{fragment-based}…

Methodology · Statistics 2025-05-01 Carlos M. Hernandez-Suarez , Osval A. Montesinos-López

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

We present a new algorithm for discovering patterns in time series and other sequential data. We exhibit a reliable procedure for building the minimal set of hidden, Markovian states that is statistically capable of producing the behavior…

Machine Learning · Computer Science 2007-05-23 Cosma Rohilla Shalizi , Kristina Lisa Shalizi , James P. Crutchfield

Hidden Markov Models (HMMs) are powerful tools for modeling sequential data, where the underlying states evolve in a stochastic manner and are only indirectly observable. Traditional HMM approaches are well-established for linear sequences,…

Machine Learning · Statistics 2024-06-05 Farzan Vafa , Sahand Hormoz

Hidden Markov models (HMMs) and their extensions have proven to be powerful tools for classification of observations that stem from systems with temporal dependence as they take into account that observations close in time are likely…

Applications · Statistics 2021-11-22 Sofia Ruiz-Suarez , Vianey Leos-Barajas , Juan Manuel Morales

We present a simple model and algorithm for predicting driver destinations and routes, based on the input of the latest road links visited as part of an ongoing trip. The algorithm may be used to predict any clusters previously observed in…

Physics and Society · Physics 2018-04-11 Yassine Lassoued , Julien Monteil , Yingqi Gu , Giovanni Russo , Robert Shorten , Martin Mevissen

We consider a hidden Markov model with multiple observation processes, one of which is chosen at each point in time by a policy---a deterministic function of the information state---and attempt to determine which policy minimises the…

Probability · Mathematics 2015-03-17 James Y. Zhao

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

Hidden Markov models (HMMs) and conditional random fields (CRFs) are two popular techniques for modeling sequential data. Inference algorithms designed over CRFs and HMMs allow estimation of the state sequence given the observations. In…

Artificial Intelligence · Computer Science 2012-02-20 Gungor Polatkan , Oncel Tuzel

Hidden Markov Models (HMMs) are foundational tools for modeling sequential data with latent Markovian structure, yet fitting them to real-world data remains computationally challenging. In this work, we show that pre-trained large language…

Machine Learning · Computer Science 2026-04-27 Yijia Dai , Zhaolin Gao , Yahya Sattar , Sarah Dean , Jennifer J. Sun

We consider the problem of diagnosis where a set of simple observations are used to infer a potentially complex hidden hypothesis. Finding the optimal subset of observations is intractable in general, thus we focus on the problem of active…

Artificial Intelligence · Computer Science 2017-07-12 Yewen Pu , Leslie P Kaelbling , Armando Solar-Lezama

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-11-21 Viktoriya Krakovna , Finale Doshi-Velez

This work considers the problem of learning the Markov parameters of a linear system from observed data. Recent non-asymptotic system identification results have characterized the sample complexity of this problem in the single and…

Optimization and Control · Mathematics 2021-12-09 Han Wang , James Anderson

Hidden Markov Models (HMMs) comprise a powerful generative approach for modeling sequential data and time-series in general. However, the commonly employed assumption of the dependence of the current time frame to a single or multiple…

Machine Learning · Computer Science 2021-09-13 Konstantinos P. Panousis , Sotirios Chatzis , Sergios Theodoridis

Real-world sequential decision making problems commonly involve partial observability, which requires the agent to maintain a memory of history in order to infer the latent states, plan and make good decisions. Coping with partial…

Machine Learning · Computer Science 2022-02-09 Yonathan Efroni , Chi Jin , Akshay Krishnamurthy , Sobhan Miryoosefi

Experiments, in particular on biological systems, typically probe lower-dimensional observables which are projections of high-dimensional dynamics. In order to infer consistent models capturing the relevant dynamics of the system, it is…

Statistical Mechanics · Physics 2025-11-18 Xizhu Zhao , Dmitrii E. Makarov , Aljaž Godec

We consider the problem of estimating the number of distinct elements in a large data set (or, equivalently, the support size of the distribution induced by the data set) from a random sample of its elements. The problem occurs in many…

Machine Learning · Computer Science 2021-06-17 Talya Eden , Piotr Indyk , Shyam Narayanan , Ronitt Rubinfeld , Sandeep Silwal , Tal Wagner

Variational inference algorithms have proven successful for Bayesian analysis in large data settings, with recent advances using stochastic variational inference (SVI). However, such methods have largely been studied in independent or…

Machine Learning · Statistics 2014-11-07 Nicholas J. Foti , Jason Xu , Dillon Laird , Emily B. Fox

When learning a hidden Markov model (HMM), sequen- tial observations can often be complemented by real-valued summary response variables generated from the path of hid- den states. Such settings arise in numerous domains, includ- ing many…

Machine Learning · Statistics 2015-12-17 Yizhe Zhang , Ricardo Henao , Lawrence Carin , Jianling Zhong , Alexander J. Hartemink

In this paper, we solve the problem of predicting the next locations of the moving objects with a historical dataset of trajectories. We present a Next Location Predictor with Markov Modeling (NLPMM) which has the following advantages: (1)…

Artificial Intelligence · Computer Science 2020-03-17 Meng Chen , Yang Liu , Xiaohui Yu