English
Related papers

Related papers: Hidden Markov Models with Momentum

200 papers

This paper revisits momentum in the context of min-max optimization. Momentum is a celebrated mechanism for accelerating gradient dynamics in settings like convex minimization, but its direct use in min-max optimization makes gradient…

Optimization and Control · Mathematics 2026-04-21 Henry Shugart , Shuyi Wang , Jason M. Altschuler

In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time…

Machine Learning · Computer Science 2021-11-16 Rahul Singh , Qinsheng Zhang , Yongxin Chen

Momentum-based gradients are essential for optimizing advanced machine learning models, as they not only accelerate convergence but also advance optimizers to escape stationary points. While most state-of-the-art momentum techniques utilize…

Machine Learning · Computer Science 2025-05-20 Wei Zhang , Arif Hassan Zidan , Afrar Jahin , Yu Bao , Tianming Liu

Optimization algorithms with momentum, e.g., (ADAM), have been widely used for building deep learning models due to the faster convergence rates compared with stochastic gradient descent (SGD). Momentum helps accelerate SGD in the relevant…

Machine Learning · Computer Science 2020-01-24 Jiyang Bai , Yuxiang Ren , Jiawei Zhang

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) form a useful tool for modeling dynamical systems. They are particularly useful for representing environments such as road networks and office…

Artificial Intelligence · Computer Science 2013-01-30 Hagit Shatkay

In part of speech tagging by Hidden Markov Model, a statistical model is used to assign grammatical categories to words in a text. Early work in the field relied on a corpus which had been tagged by a human annotator to train the model.…

cmp-lg · Computer Science 2008-02-03 David Elworthy

We derive the Baum-Welch algorithm for hidden Markov models (HMMs) through an information-theoretical approach using cross-entropy instead of the Lagrange multiplier approach which is universal in machine learning literature. The proposed…

Information Theory · Computer Science 2014-06-27 Alireza Nejati , Charles Unsworth

Hidden Markov Models (HMMs) are fundamental for modeling sequential data, yet learning their parameters from observations remains challenging. Classical methods like the Baum-Welch algorithm are computationally intensive and prone to local…

Machine Learning · Computer Science 2026-04-27 Reginald Zhiyan Chen , Heng-Sheng Chang , Prashant G. Mehta

We consider gradient descent with `momentum', a widely used method for loss function minimization in machine learning. This method is often used with `Nesterov acceleration', meaning that the gradient is evaluated not at the current…

Machine Learning · Computer Science 2020-01-20 Goran Nakerst , John Brennan , Masudul Haque

Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques…

Hidden Markov Models (HMM) have been used for several years in many time series analysis or pattern recognitions tasks. HMM are often trained by means of the Baum-Welch algorithm which can be seen as a special variant of an expectation…

Machine Learning · Computer Science 2016-05-30 Christian Gruhl , Bernhard Sick

We focus on the optimization problem with smooth, possibly nonconvex objectives and a convex constraint set for which the Euclidean projection operation is practically available. Focusing on this setting, we carry out a general convergence…

Optimization and Control · Mathematics 2026-04-23 Matteo Lapucci , Giampaolo Liuzzi , Stefano Lucidi , Marco Sciandrone , Diego Scuppa

A variety of widely used optimization methods like SignSGD and Muon can be interpreted as instances of steepest descent under different norm-induced geometries. In this work, we study the implicit bias of mini-batch stochastic steepest…

Machine Learning · Computer Science 2026-02-13 Jichu Li , Xuan Tang , Difan Zou

In this work, we investigate the effect of momentum on the optimisation trajectory of gradient descent. We leverage a continuous-time approach in the analysis of momentum gradient descent with step size $\gamma$ and momentum parameter…

Machine Learning · Computer Science 2024-03-11 Hristo Papazov , Scott Pesme , Nicolas Flammarion

The momentum acceleration technique is widely adopted in many optimization algorithms. However, there is no theoretical answer on how the momentum affects the generalization performance of the optimization algorithms. This paper studies…

Machine Learning · Computer Science 2022-05-30 Bohan Wang , Qi Meng , Huishuai Zhang , Ruoyu Sun , Wei Chen , Zhi-Ming Ma , Tie-Yan Liu

We present a novel algorithm for learning the parameters of hidden Markov models (HMMs) in a geometric setting where the observations take values in Riemannian manifolds. In particular, we elevate a recent second-order method of moments…

Machine Learning · Computer Science 2023-02-16 Berlin Chen , Cyrus Mostajeran , Salem Said

Distributed optimization advances centralized machine learning methods by enabling parallel and decentralized learning processes over a network of computing nodes. This work provides an accelerated consensus-based distributed algorithm for…

Systems and Control · Electrical Eng. & Systems 2025-07-01 Mohammadreza Doostmohammadian , Hamid R. Rabiee

We introduce Hindsight-Guided Momentum (HGM), a first-order optimization algorithm that adaptively scales learning rates based on the directional consistency of recent updates. Traditional adaptive methods, such as Adam or RMSprop , adapt…

Optimization and Control · Mathematics 2025-07-01 Krisanu Sarkar

This paper introduces a new parsimonious structure for mixture of autoregressive models. the weighting coefficients are determined through latent random variables, following a hidden Markov model. We propose a dynamic programming algorithm…

Statistics Theory · Mathematics 2011-05-12 S. H. Alizadeh , S. Rezakhah

Hidden Markov models (HMMs) are widely used statistical models for modeling sequential data. The parameter estimation for HMMs from time series data is an important learning problem. The predominant methods for parameter estimation are…

Machine Learning · Computer Science 2014-04-30 Carl Mattfeld