English
Related papers

Related papers: Decoding Hidden Markov Models Faster Than Viterbi …

200 papers

Recently, there has been a surge of interest in using spectral methods for estimating latent variable models. However, it is usually assumed that the distribution of the observations conditioned on the latent variables is either discrete or…

Machine Learning · Statistics 2016-09-22 Kirthevasan Kandasamy , Maruan Al-Shedivat , Eric P. Xing

This work proposes a multi-agent filtering algorithm over graphs for finite-state hidden Markov models (HMMs), which can be used for sequential state estimation or for tracking opinion formation over dynamic social networks. We show that…

Signal Processing · Electrical Eng. & Systems 2022-03-10 Mert Kayaalp , Virginia Bordignon , Stefan Vlaski , Ali H. Sayed

Stock market forecasting is a classic problem that has been thoroughly investigated using machine learning and artificial neural network based tools and techniques. Interesting aspects of this problem include its time reliance as well as…

Statistical Finance · Quantitative Finance 2023-02-20 Raihan Tanvir , Md Tanvir Rouf Shawon , Md. Golam Rabiul Alam

Homomorphic permutation is fundamental to privacy-preserving computations based on batch-encoding homomorphic encryption. It underpins nearly all homomorphic matrix operations and predominantly influences their complexity. Permutation…

Cryptography and Security · Computer Science 2025-11-27 Xirong Ma , Junling Fang , Chunpeng Ge , Dung Hoang Duong , Yali Jiang , Yanbin Li , Willy Susilo , Lizhen Cui

Hidden Markov Models (HMMs) comprise a powerful generative approach for modeling sequential data and time-series in general. However, the commonly employed assumption of the dependence of the current time frame to a single or multiple…

Machine Learning · Computer Science 2021-09-13 Konstantinos P. Panousis , Sotirios Chatzis , Sergios Theodoridis

In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time…

Machine Learning · Computer Science 2021-11-16 Rahul Singh , Qinsheng Zhang , Yongxin Chen

We consider the problem of preprocessing an $n\times n$ matrix $\mathbf{M}$, and supporting queries that, for any vector $v$, returns the matrix-vector product $\mathbf{M} v$. This problem has been extensively studied in both theory and…

Data Structures and Algorithms · Computer Science 2026-02-10 Emile Anand , Jan van den Brand , Rose McCarty

Inferring a state sequence from a sequence of measurements is a fundamental problem in bioinformatics and natural language processing. The Viterbi and the Beam Search (BS) algorithms are popular inference methods, but they have limitations…

Machine Learning · Computer Science 2023-05-22 Xuechun Xu , Joakim Jaldén

We present a novel algorithm for learning the parameters of hidden Markov models (HMMs) in a geometric setting where the observations take values in Riemannian manifolds. In particular, we elevate a recent second-order method of moments…

Machine Learning · Computer Science 2023-02-16 Berlin Chen , Cyrus Mostajeran , Salem Said

We consider the Online Boolean Matrix-Vector Multiplication (OMV) problem studied by Henzinger et al. [STOC'15]: given an $n \times n$ Boolean matrix $M$, we receive $n$ Boolean vectors $v_1,\ldots,v_n$ one at a time, and are required to…

Data Structures and Algorithms · Computer Science 2016-05-09 Kasper Green Larsen , Ryan Williams

The hierarchical Dirichlet process (HDP) has become an important Bayesian nonparametric model for grouped data, such as document collections. The HDP is used to construct a flexible mixed-membership model where the number of components is…

Machine Learning · Statistics 2012-01-10 Chong Wang , David M. Blei

We consider estimating the transition probability matrix of a finite-state finite-observation alphabet hidden Markov model with known observation probabilities. The main contribution is a two-step algorithm; a method of moments estimator…

Systems and Control · Computer Science 2017-11-22 Robert Mattila , Cristian R. Rojas , Vikram Krishnamurthy , Bo Wahlberg

In a hidden Markov model, the underlying Markov chain is usually hidden. Often, the maximum likelihood alignment (Viterbi alignment) is used as its estimate. Although having the biggest likelihood, the Viterbi alignment can behave very…

Methodology · Statistics 2013-07-31 Kristi Kuljus , Jüri Lember

Various Neural Networks employ time-consuming matrix operations like matrix inversion. Many such matrix operations are faster to compute given the Singular Value Decomposition (SVD). Previous work allows using the SVD in Neural Networks…

Machine Learning · Computer Science 2020-09-30 Alexander Mathiasen , Frederik Hvilshøj , Jakob Rødsgaard Jørgensen , Anshul Nasery , Davide Mottin

Auditory attention decoding (AAD) algorithms exploit brain signals, such as electroencephalography (EEG), to identify which speaker a listener is focusing on in a multi-speaker environment. While state-of-the-art AAD algorithms can identify…

Signal Processing · Electrical Eng. & Systems 2025-07-01 Nicolas Heintz , Tom Francart , Alexander Bertrand

We investigate a novel modeling approach for end-to-end neural network training using hidden Markov models (HMM) where the transition probabilities between hidden states are modeled and learned explicitly. Most contemporary…

Machine Learning · Computer Science 2023-10-10 Daniel Mann , Tina Raissi , Wilfried Michel , Ralf Schlüter , Hermann Ney

We present an improved hybrid algorithm for vertexing, that combines deep learning with conventional methods. Even though the algorithm is a generic approach to vertex finding, we focus here on it's application as an alternative Primary…

We consider a problem of localizing a path-signal that evolves over time on a graph. A path-signal can be viewed as the trajectory of a moving agent on a graph in several consecutive time points. Combining dynamic programming and graph…

Signal Processing · Electrical Eng. & Systems 2018-11-14 Yaoqing Yang , Siheng Chen , Mohammad Ali Maddah-Ali , Pulkit Grover , Soummya Kar , Jelena Kovačević

This paper considers the quickest detection problem for hidden Markov models (HMMs) in a Bayesian setting. We construct an augmented HMM representation of the problem that allows the application of a dynamic programming approach to prove…

Systems and Control · Electrical Eng. & Systems 2023-03-17 Jason J. Ford , Jasmin James , Timothy L. Molloy

In this paper, we aim to accelerate a preconditioned alternating direction method of multipliers (pADMM), whose proximal terms are convex quadratic functions, for solving linearly constrained convex optimization problems. To achieve this,…

Optimization and Control · Mathematics 2024-12-10 Defeng Sun , Yancheng Yuan , Guojun Zhang , Xinyuan Zhao