English
Related papers

Related papers: Clustering hidden Markov models with variational H…

200 papers

Hidden Markov Models (HMMs) are foundational tools for modeling sequential data with latent Markovian structure, yet fitting them to real-world data remains computationally challenging. In this work, we show that pre-trained large language…

Machine Learning · Computer Science 2026-04-27 Yijia Dai , Zhaolin Gao , Yahya Sattar , Sarah Dean , Jennifer J. Sun

Hidden Markov Models (HMMs) are a ubiquitous tool to model time series data, and have been widely used in two main tasks of Automatic Music Transcription (AMT): note segmentation, i.e. identifying the played notes after a multi-pitch…

Machine Learning · Statistics 2017-04-13 D. Cazau , G. Nuel

We propose the Gaussian-Linear Hidden Markov model (GLHMM), a generalisation of different types of HMMs commonly used in neuroscience. In short, the GLHMM is a general framework where linear regression is used to flexibly parameterise the…

Neurons and Cognition · Quantitative Biology 2024-10-02 Diego Vidaurre , Laura Masaracchia , Nick Y. Larsen , Lenno R. P. T Ruijters , Sonsoles Alonso , Christine Ahrends , Mark W. Woolrich

This paper presents a novel approach for automatic recognition of group activities for video surveillance applications. We propose to use a group representative to handle the recognition with a varying number of group members, and use an…

Computer Vision and Pattern Recognition · Computer Science 2015-03-03 Weiyao Lin , Ming-Ting Sun , Radha Poovendran , Zhengyou Zhang

Data clustering is a process of arranging similar data into groups. A clustering algorithm partitions a data set into several groups such that the similarity within a group is better than among groups. In this paper a hybrid clustering…

Databases · Computer Science 2012-05-25 Ravindra Jain

Discrete hidden Markov models (HMM) are often applied to malware detection and classification problems. However, the continuous analog of discrete HMMs, that is, Gaussian mixture model-HMMs (GMM-HMM), are rarely considered in the field of…

Cryptography and Security · Computer Science 2021-03-05 Jing Zhao , Samanvitha Basole , Mark Stamp

Extending classical probabilistic reasoning using the quantum mechanical view of probability has been of recent interest, particularly in the development of hidden quantum Markov models (HQMMs) to model stochastic processes. However, there…

Machine Learning · Computer Science 2019-12-05 Sandesh Adhikary , Siddarth Srinivasan , Geoff Gordon , Byron Boots

Modern scientific studies often require the identification of a subset of relevant explanatory variables, in the attempt to understand an interesting phenomenon. Several statistical methods have been developed to automate this task, but…

Methodology · Statistics 2019-05-14 Matteo Sesia , Chiara Sabatti , Emmanuel J. Candès

Until recently obtaining data on populations of networks was typically rare. However, with the advancement of automatic monitoring devices and the growing social and scientific interest in networks, such data has become more widely…

Methodology · Statistics 2020-01-22 Mirko Signorelli , Ernst Wit

Clustering analysis is one of the most widely used statistical tools in many emerging areas such as microarray data analysis. For microarray and other high-dimensional data, the presence of many noise variables may mask underlying…

Machine Learning · Statistics 2008-03-26 Benhuai Xie , Wei Pan , Xiaotong Shen

Mixtures of linear mixed models (MLMMs) are useful for clustering grouped data and can be estimated by likelihood maximization through the EM algorithm. The conventional approach to determining a suitable number of components is to compare…

Applications · Statistics 2014-05-26 Siew Li Tan , David J. Nott

Online (also called "recursive" or "adaptive") estimation of fixed model parameters in hidden Markov models is a topic of much interest in times series modelling. In this work, we propose an online parameter estimation algorithm that…

Computation · Statistics 2011-02-16 Olivier Cappé

There is much interest in the Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) as a natural Bayesian nonparametric extension of the traditional HMM. However, in many settings the HDP-HMM's strict Markovian constraints are…

Machine Learning · Computer Science 2012-03-19 Matthew J. Johnson , Alan Willsky

Stochastic gradient MCMC (SG-MCMC) algorithms have proven useful in scaling Bayesian inference to large datasets under an assumption of i.i.d data. We instead develop an SG-MCMC algorithm to learn the parameters of hidden Markov models…

Machine Learning · Statistics 2017-06-16 Yi-An Ma , Nicholas J. Foti , Emily B. Fox

Inferring time-varying networks is important to understand the development and evolution of interactions over time. However, the vast majority of currently used models assume direct measurements of node states, which are often difficult to…

Applications · Statistics 2014-05-06 Xin Wang , Ke Yuan , Christoph Hellmayr , Wei Liu , Florian Markowetz

We describe a network clustering framework, based on finite mixture models, that can be applied to discrete-valued networks with hundreds of thousands of nodes and billions of edge variables. Relative to other recent model-based clustering…

Computation · Statistics 2020-03-13 Duy Q. Vu , David R. Hunter , Michael Schweinberger

Hidden Markov Models (HMMs) are fundamental for modeling sequential data, yet learning their parameters from observations remains challenging. Classical methods like the Baum-Welch algorithm are computationally intensive and prone to local…

Machine Learning · Computer Science 2026-04-27 Reginald Zhiyan Chen , Heng-Sheng Chang , Prashant G. Mehta

We propose a novel deep clustering method that integrates Variational Autoencoders (VAEs) into the Expectation-Maximization (EM) framework. Our approach models the probability distribution of each cluster with a VAE and alternates between…

Machine Learning · Computer Science 2025-01-14 Michael Adipoetra , Ségolène Martin

With the symbolic framework of Probability Bracket Notation (PBN), the Markov Sequence Projector (MSP) is introduced to expand the evolution formula of Homogeneous Markov Chains (HMCs). The well-known weather example, a Visible Markov Model…

Artificial Intelligence · Computer Science 2025-02-21 Xing M. Wang

The main focus of this work is on developing models for the activity profile of a terrorist group, detecting sudden spurts and downfalls in this profile, and, in general, tracking it over a period of time. Toward this goal, a $d$-state…

Applications · Statistics 2014-01-16 Vasanthan Raghavan , Aram Galstyan , Alexander G. Tartakovsky