English
Related papers

Related papers: Latent State Models of Training Dynamics

200 papers

We consider probabilistic systems with hidden state and unobservable transitions, an extension of Hidden Markov Models (HMMs) that in particular admits unobservable {\epsilon}-transitions (also called null transitions), allowing state…

Machine Learning · Computer Science 2022-05-30 Rebecca Bernemann , Barbara König , Matthias Schaffeld , Torben Weis

We consider the general class of time-homogeneous stochastic dynamical systems, both discrete and continuous, and study the problem of learning a representation of the state that faithfully captures its dynamics. This is instrumental to…

Machine Learning · Computer Science 2024-03-15 Vladimir R. Kostic , Pietro Novelli , Riccardo Grazzi , Karim Lounici , Massimiliano Pontil

We propose a probabilistic modeling framework for learning the dynamic patterns in the collective behaviors of social agents and developing profiles for different behavioral groups, using data collected from multiple information sources.…

Machine Learning · Statistics 2016-06-28 Lin Li , Ananthram Swami , Anna Scaglione

Hidden Markov models (HMMs) are popular time series model in many fields including ecology, economics and genetics. HMMs can be defined over discrete or continuous time, though here we only cover the former. In the field of movement ecology…

Quantitative Methods · Quantitative Biology 2018-06-29 Vianey Leos-Barajas , Théo Michelot

Hidden Markov models (HMMs) are widely applied in studies where a discrete-valued process of interest is observed indirectly. They have for example been used to model behaviour from human and animal tracking data, disease status from…

Methodology · Statistics 2025-05-22 Théo Michelot

In pursuit of explainability, we develop generative models for sequential data. The proposed models provide state-of-the-art classification results and robust performance for speech phone classification. We combine modern neural networks…

Machine Learning · Computer Science 2021-07-05 Anubhab Ghosh , Antoine Honoré , Dong Liu , Gustav Eje Henter , Saikat Chatterjee

Recurrent neural network is a powerful model that learns temporal patterns in sequential data. For a long time, it was believed that recurrent networks are difficult to train using simple optimizers, such as stochastic gradient descent, due…

Neural and Evolutionary Computing · Computer Science 2015-04-20 Tomas Mikolov , Armand Joulin , Sumit Chopra , Michael Mathieu , Marc'Aurelio Ranzato

We present and analyse three online algorithms for learning in discrete Hidden Markov Models (HMMs) and compare them with the Baldi-Chauvin Algorithm. Using the Kullback-Leibler divergence as a measure of generalisation error we draw…

Machine Learning · Statistics 2007-08-20 Roberto C. Alamino , Nestor Caticha

Social learning strategies enable agents to infer the underlying true state of nature in a distributed manner by receiving private environmental signals and exchanging beliefs with their neighbors. Previous studies have extensively focused…

Multiagent Systems · Computer Science 2025-03-18 Dongyan Sui , Haitian Zheng , Siyang Leng , Stefan Vlaski

We describe a generalization of the Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) which is able to encode prior information that state transitions are more likely between "nearby" states. This is accomplished by defining a…

Machine Learning · Statistics 2017-07-24 Colin Reimer Dawson , Chaofan Huang , Clayton T. Morrison

We consider penalized estimation in hidden Markov models (HMMs) with multivariate Normal observations. In the moderate-to-large dimensional setting, estimation for HMMs remains challenging in practice, due to several concerns arising from…

Methodology · Statistics 2014-01-09 Nicolas Städler , Sach Mukherjee

Hidden Markov models (HMMs) are probabilistic functions of finite Markov chains, or, put in other words, state space models with finite state space. In this paper, we examine subspace estimation methods for HMMs whose output lies a finite…

Statistics Theory · Mathematics 2009-11-20 Sofia Andersson , Tobias Rydén

Hidden Markov Models (HMM) have been used for several years in many time series analysis or pattern recognitions tasks. HMM are often trained by means of the Baum-Welch algorithm which can be seen as a special variant of an expectation…

Machine Learning · Computer Science 2016-05-30 Christian Gruhl , Bernhard Sick

The field of world modeling is fragmented, with researchers developing bespoke architectures that rarely build upon each other. We propose a framework that specifies the natural building blocks for structured world models based on the…

Machine Learning · Computer Science 2025-11-05 Lancelot Da Costa , Sanjeev Namjoshi , Mohammed Abbas Ansari , Bernhard Schölkopf

In this work, we study the evolution of the loss Hessian across many classification tasks in order to understand the effect the curvature of the loss has on the training dynamics. Whereas prior work has focused on how different learning…

This thesis explores how deep learning models learn over time, using ideas inspired by force analysis. Specifically, we zoom in on the model's training procedure to see how one training example affects another during learning, like…

Machine Learning · Computer Science 2025-09-25 Yi Ren

We consider the filtering of continuous-time finite-state hidden Markov models, where the rate and observation matrices depend on unknown time-dependent parameters, for which no prior or stochastic model is available. We quantify and…

Probability · Mathematics 2021-03-17 Andrew L. Allan

We take a Bayesian perspective to illustrate a connection between training speed and the marginal likelihood in linear models. This provides two major insights: first, that a measure of a model's training speed can be used to estimate its…

Machine Learning · Computer Science 2020-10-28 Clare Lyle , Lisa Schut , Binxin Ru , Yarin Gal , Mark van der Wilk

Markov state models (MSMs) have been successful in computing metastable states, slow relaxation timescales and associated structural changes, and stationary or kinetic experimental observables of complex molecules from large amounts of…

Chemical Physics · Physics 2015-06-17 Frank Noe , Hao Wu , Jan-Hendrik Prinz , Nuria Plattner

Large language models are powerful but costly. We ask whether meta-learning can make the pretraining of small language models not only better but also more interpretable. We integrate first-order MAML with subset-masked LM pretraining,…

Computation and Language · Computer Science 2025-11-10 David Demitri Africa , Yuval Weiss , Paula Buttery , Richard Diehl Martinez