English
Related papers

Related papers: Entropy Semiring Forward-backward Algorithm for HM…

200 papers

Reservoir computing (RC), is a class of computational methods such as Echo State Networks (ESN) and Liquid State Machines (LSM) describe a generic method to perform pattern recognition and temporal analysis with any non-linear system. This…

Machine Learning · Computer Science 2024-11-19 Anmol Biswas , Sharvari Ashok Medhe , Raghav Singhal , Udayan Ganguly

A Hidden Markov Model (HMM) is a common statistical model which is widely used for analysis of biological sequence data and other sequential phenomena. In the present paper we show how HMMs can be extended with side-constraints and present…

Artificial Intelligence · Computer Science 2010-08-02 Henning Christiansen , Christian Theil Have , Ole Torp Lassen , Matthieu Petit

This study investigates the application of machine learning predictors for min-entropy estimation in Random Number Generators (RNGs), a key component in cryptographic applications where accurate entropy assessment is essential for…

Machine Learning · Computer Science 2024-07-01 Javier Blanco-Romero , Vicente Lorenzo , Florina Almenares Mendoza , Daniel Díaz-Sánchez

We introduce Entropy-Guided Sequence Weighting (EGSW), a novel approach that enhances the exploration-exploitation tradeoff by dynamically assigning weights to generated outputs based on their advantage and entropy for Reinforcement…

Machine Learning · Computer Science 2025-04-01 Abdullah Vanlioglu

Sequential data modeling and analysis have become indispensable tools for analyzing sequential data, such as time-series data, because larger amounts of sensed event data have become available. These methods capture the sequential structure…

Artificial Intelligence · Computer Science 2019-02-15 Hiromi Narimatsu , Hiroyuki Kasai

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

We propose the segmented iHMM (siHMM), a hierarchical infinite hidden Markov model (iHMM) that supports a simple, efficient inference scheme. The siHMM is well suited to segmentation problems, where the goal is to identify points at which a…

Machine Learning · Statistics 2016-02-23 Ardavan Saeedi , Matthew Hoffman , Matthew Johnson , Ryan Adams

Exponential-family harmoniums (EFHs), which extend restricted Boltzmann machines (RBMs) from Bernoulli random variables to other exponential families (Welling et al., 2005), are generative models that can be trained with…

Machine Learning · Computer Science 2016-05-20 Joseph G. Makin , Benjamin K. Dichter , Philip N. Sabes

Hybrid methods have been shown to outperform pure statistical and pure deep learning methods at forecasting tasks and quantifying the associated uncertainty with those forecasts (prediction intervals). One example is Exponential Smoothing…

Machine Learning · Computer Science 2021-12-17 Thabang Mathonsi , Terence L. van Zyl

Many entropy-conservative and entropy-stable (summarized as entropy-preserving) methods for hyperbolic conservation laws rely on Tadmor's theory for two-point entropy-preserving numerical fluxes and its higher-order extension via flux…

Numerical Analysis · Mathematics 2026-03-26 Marco Artiano , Hendrik Ranocha

Detecting broken time-reversibility at micro- and nanoscale is often difficult when experiments offer limited state resolution. We introduce a lumping method that builds an effective semi-Markov model able to reproduce exactly the full…

Statistical Mechanics · Physics 2025-12-16 Gianluca Teza , Attilio L. Stella , Trevor GrandPre

We consider the task of learning mappings from sequential data to real-valued responses. We present and evaluate an approach to learning a type of hidden Markov model (HMM) for regression. The learning process involves inferring the…

Machine Learning · Computer Science 2012-06-18 Keith Noto , Mark Craven

The hidden Markov model (HMM) is a fundamental tool for sequence modeling that cleanly separates the hidden state from the emission structure. However, this separation makes it difficult to fit HMMs to large datasets in modern NLP, and they…

Computation and Language · Computer Science 2020-11-10 Justin T. Chiu , Alexander M. Rush

Learning and understanding the typical patterns in the daily activities and routines of people from low-level sensory data is an important problem in many application domains such as building smart environments, or providing intelligent…

Machine Learning · Computer Science 2014-08-14 Truyen Tran , Hung Bui , Svetha Venkatesh

The conformational kinetics of enzymes can be reliably revealed when they are governed by Markovian dynamics. Hidden Markov Models (HMMs) are appropriate especially in the case of conformational states that are hardly distinguishable.…

Quantitative Methods · Quantitative Biology 2009-02-05 A. Kovalev , N. Zarrabi , F. Werz , M. Boersch , Z. Ristic , H. Lill , D. Bald , C. Tietz , J. Wrachtrup

This work pioneers regret analysis of risk-sensitive reinforcement learning in partially observable environments with hindsight observation, addressing a gap in theoretical exploration. We introduce a novel formulation that integrates…

Machine Learning · Computer Science 2024-02-29 Tonghe Zhang , Yu Chen , Longbo Huang

How to establish the matching (or corresponding) between two different 3D shapes is a classical problem. This paper focused on the research on shape mapping of 3D mesh models, and proposed a shape mapping algorithm based on Hidden Markov…

Graphics · Computer Science 2017-07-31 Yong Wang , Huai-yu Wu

Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques…

In this work, we tackle the problem of transform-invariant unsupervised learning in the space of Covariance matrices and applications thereof. We begin by introducing the Spectral Polytope Covariance Matrix (SPCM) Similarity function; a…

Machine Learning · Computer Science 2017-10-30 Nadia Figueroa , Aude Billard

The semiparametric regression models have attracted increasing attention owing to their robustness compared to their parametric counterparts. This paper discusses the efficiency bound for functional response models (FRM), an emerging class…

Methodology · Statistics 2022-05-18 Jinyuan Liu , Tuo Lin , Tian Chen , Xinlian Zhang , Xin M. Tu