English
Related papers

Related papers: Infinite Structured Hidden Semi-Markov Models

200 papers

Undirected graphical models are applied in genomics, protein structure prediction, and neuroscience to identify sparse interactions that underlie discrete data. Although Bayesian methods for inference would be favorable in these contexts,…

Machine Learning · Statistics 2017-06-15 John Ingraham , Debora Marks

In this work, we present the first results for neuralizing an Unsupervised Hidden Markov Model. We evaluate our approach on tag in- duction. Our approach outperforms existing generative models and is competitive with the state-of-the-art…

Computation and Language · Computer Science 2016-09-29 Ke Tran , Yonatan Bisk , Ashish Vaswani , Daniel Marcu , Kevin Knight

Mixture models are one of the most widely used statistical tools when dealing with data from heterogeneous populations. This paper considers the long-standing debate over finite mixture and infinite mixtures and brings the two modelling…

Methodology · Statistics 2019-04-23 Raffaele Argiento , Maria De Iorio

This paper addresses the issue of model selection for hidden Markov models (HMMs). We generalize factorized asymptotic Bayesian inference (FAB), which has been recently developed for model selection on independent hidden variables (i.e.,…

Machine Learning · Computer Science 2012-06-22 Ryohei Fujimaki , Kohei Hayashi

We introduce the minimal maximally predictive models ({\epsilon}-machines) of processes generated by certain hidden semi-Markov models. Their causal states are either hybrid discrete-continuous or continuous random variables and…

Statistical Mechanics · Physics 2017-05-24 Sarah E. Marzen , James P. Crutchfield

Bayesian nonparametric models offer a flexible and powerful framework for statistical model selection, enabling the adaptation of model complexity to the intricacies of diverse datasets. This survey intends to delve into the significance of…

Machine Learning · Computer Science 2024-04-02 Bahman Moraffah

We present a new method for nonlinear prediction of discrete random sequences under minimal structural assumptions. We give a mathematical construction for optimal predictors of such processes, in the form of hidden Markov models. We then…

Machine Learning · Computer Science 2014-08-12 Cosma Shalizi , Kristina Lisa Klinkner

We develop Bayesian predictive stacking for geostatistical models, where the primary inferential objective is to provide inference on the latent spatial random field and conduct spatial predictions at arbitrary locations. We exploit…

Methodology · Statistics 2025-09-25 Lu Zhang , Wenpin Tang , Sudipto Banerjee

State space models have long played an important role in signal processing. The Gaussian case can be treated algorithmically using the famous Kalman filter. Similarly since the 1970s there has been extensive application of Hidden Markov…

Statistics Theory · Mathematics 2007-06-13 Peter Bickel , Yaacov Ritov , Tobias Rydén

Hidden Markov Models (HMMs) comprise a powerful generative approach for modeling sequential data and time-series in general. However, the commonly employed assumption of the dependence of the current time frame to a single or multiple…

Machine Learning · Computer Science 2021-09-13 Konstantinos P. Panousis , Sotirios Chatzis , Sergios Theodoridis

In this paper, we develop a Bayesian multiscale approach based on a multiscale finite element method. Because of scale disparity in many multiscale applications, computational models can not resolve all scales. Various subgrid models are…

Numerical Analysis · Mathematics 2017-02-13 Y. Efendiev , W. T. Leung , S. W. Cheung , N. Guha , V. H. Hoang , B. Mallick

Due to their great flexibility, nonparametric Bayes methods have proven to be a valuable tool for discovering complicated patterns in data. The term "nonparametric Bayes" suggests that these methods inherit model-free operating…

Methodology · Statistics 2013-04-15 Peter D. Hoff

We examine an analytic variational inference scheme for the Gaussian Process State Space Model (GPSSM) - a probabilistic model for system identification and time-series modelling. Our approach performs variational inference over both the…

Machine Learning · Statistics 2018-12-11 Alessandro Davide Ialongo , Mark van der Wilk , Carl Edward Rasmussen

In this letter we borrow from the inference techniques developed for unbounded state-cardinality (nonparametric) variants of the HMM and use them to develop a tuning-parameter free, black-box inference procedure for Explicit-state-duration…

Machine Learning · Statistics 2015-06-04 Michael Dewar , Chris Wiggins , Frank Wood

We introduce an extension of finite mixture models by incorporating skew-normal distributions within a Hidden Markov Model framework. By assuming a constant transition probability matrix and allowing emission distributions to vary according…

Methodology · Statistics 2025-09-25 Andrea Nigri , Marco Forti , Han Lin Shang

Spurred on by recent successes in causal inference competitions, Bayesian nonparametric (and high-dimensional) methods have recently seen increased attention in the causal inference literature. In this paper, we present a comprehensive…

Methodology · Statistics 2022-01-11 Antonio R. Linero , Joseph L. Antonelli

This is a supplementary material to the paper "Online Expectation Maximization based algorithms for inference in hidden Markov models". It contains further technical derivations and additional simulation results.

Statistics Theory · Mathematics 2012-10-18 Sylvain Le Corff , Gersende Fort

Many exact Markov chain Monte Carlo algorithms have been developed for posterior inference in Bayesian nonparametric models which involve infinite-dimensional priors. However, these methods are not generic and special methodology must be…

Computation · Statistics 2014-05-22 Jim E. Griffin

We propose a Bayesian inference approach for a class of latent Markov models. These models are widely used for the analysis of longitudinal categorical data, when the interest is in studying the evolution of an individual unobservable…

Methodology · Statistics 2011-01-05 Francesco Bartolucci , Silvia Pandolfi

Bayesian nonparametric methods are a popular choice for analysing survival data due to their ability to flexibly model the distribution of survival times. These methods typically employ a nonparametric prior on the survival function that is…

Methodology · Statistics 2022-02-22 Edwin Fong , Brieuc Lehmann