English
Related papers

Related papers: A gentle tutorial on accelerated parameter and con…

200 papers

Statistical machine learning has widespread application in various domains. These methods include probabilistic algorithms, such as Markov Chain Monte-Carlo (MCMC), which rely on generating random numbers from probability distributions.…

Hardware Architecture · Computer Science 2021-08-03 Ramin Bashizade , Xiangyu Zhang , Sayan Mukherjee , Alvin R. Lebeck

The impact of randomness on model training is poorly understood. How do differences in data order and initialization actually manifest in the model, such that some training runs outperform others or converge faster? Furthermore, how can we…

Machine Learning · Computer Science 2024-01-23 Michael Y. Hu , Angelica Chen , Naomi Saphra , Kyunghyun Cho

Hidden Markov models (HMMs) are probabilistic methods in which observations are seen as realizations of a latent Markov process with discrete states that switch over time. Moving beyond standard statistical tests, HMMs offer a statistical…

Methodology · Statistics 2024-03-20 S. Mildiner Moraga , E. Aarts

Modeling continuous-time physiological processes that manifest a patient's evolving clinical states is a key step in approaching many problems in healthcare. In this paper, we develop the Hidden Absorbing Semi-Markov Model (HASMM): a…

Artificial Intelligence · Computer Science 2016-12-28 Ahmed M. Alaa , Mihaela van der Schaar

The main focus of this work is on developing models for the activity profile of a terrorist group, detecting sudden spurts and downfalls in this profile, and, in general, tracking it over a period of time. Toward this goal, a $d$-state…

Applications · Statistics 2014-01-16 Vasanthan Raghavan , Aram Galstyan , Alexander G. Tartakovsky

We propose a generic Markov Chain Monte Carlo (MCMC) algorithm to speed up computations for datasets with many observations. A key feature of our approach is the use of the highly efficient difference estimator from the survey sampling…

Methodology · Statistics 2017-08-03 Matias Quiroz , Mattias Villani , Robert Kohn

This work deals with the analysis of longitudinal ordinal responses. The novelty of the proposed approach is in modeling simultaneously the temporal dynamics of a latent trait of interest, measured via the observed ordinal responses, and…

Methodology · Statistics 2021-11-29 R. Colombi , S. Giordano , M. Kateri

In this article, we use the theory of quantum channels and open quantum systems to provide an efficient unitary characterization of a class of stochastic generators known as quantum hidden Markov models (QHMMs). By utilizing the unitary…

Quantum Physics · Physics 2025-02-27 Vanio Markov , Vladimir Rastunkov , Amol Deshmukh , Daniel Fry , Charlee Stefanski

Hidden Markov models (HMM) have been widely used by scientists to model stochastic systems: the underlying process is a discrete Markov chain and the observations are noisy realizations of the underlying process. Determining the number of…

Statistics Theory · Mathematics 2024-07-18 Yang Chen , Cheng-Der Fuh , Chu-Lan Michael Kao

The lack of large video databases obtained from real patients with respiratory disorders makes the design and optimization of video-based monitoring systems quite critical. The purpose of this study is the development of suitable models and…

Applications · Statistics 2023-07-14 Davide Alinovi , Gianluigi Ferrari , Francesco Pisani , Riccardo Raheli

We present a novel approach to lexical error recovery on textual input. An advanced robust tokenizer has been implemented that can not only correct spelling mistakes, but also recover from segmentation errors. Apart from the orthographic…

cmp-lg · Computer Science 2008-02-03 Peter Ingels

Cyber threat intelligence is one of the emerging areas of focus in information security. Much of the recent work has focused on rule-based methods and detection of network attacks using Intrusion Detection algorithms. In this paper we…

Machine Learning · Computer Science 2024-09-05 Soham Deshmukh , Rahul Rade , Faruk Kazi

Speculative decoding accelerates LLM inference by using a smaller draft model to speculate tokens that a larger target model verifies. Verification is often the bottleneck (e.g. verification is $4\times$ slower than token generation when a…

Computation and Language · Computer Science 2026-05-27 Avinash Kumar , Sujay Sanghavi , Poulami Das

Momentum is a popular technique for improving convergence rates during gradient descent. In this research, we experiment with adding momentum to the Baum-Welch expectation-maximization algorithm for training Hidden Markov Models. We compare…

Machine Learning · Computer Science 2022-06-10 Andrew Miller , Fabio Di Troia , Mark Stamp

Finding optimal hyperparameters for the machine learning algorithm can often significantly improve its performance. But how to choose them in a time-efficient way? In this paper we present the protocol of generating benchmark data…

Machine Learning · Computer Science 2020-09-01 Wojciech Kretowicz , Przemysław Biecek

We demonstrate the application of pattern recognition algorithms via hidden Markov models (HMM) for qubit readout. This scheme provides a state-path trajectory approach capable of detecting qubit state transitions and makes for a robust…

Quantum Physics · Physics 2021-01-04 Luis A. Martinez , Yaniv J. Rosen , Jonathan L. DuBois

In this paper, we establish a robustification of an on-line algorithm for modelling asset prices within a hidden Markov model (HMM). In this HMM framework, parameters of the model are guided by a Markov chain in discrete time, parameters of…

Methodology · Statistics 2013-04-09 Christina Erlwein , Peter Ruckdeschel

The R package trajmsm provides functions designed to simplify the estimation of the parameters of a model combining latent class growth analysis (LCGA), a trajectory analysis technique, and marginal structural models (MSMs) called LCGA-MSM.…

We consider the problem of the construction of the estimator-process of the unknown finite-dimensional parameter in the case of the observations of nonlinear autoregressive process. The estimation is done in two or three steps. First we…

Statistics Theory · Mathematics 2016-02-01 Yury A. Kutoyants , Anastasia Motrunich

Hidden Markov models (HMMs) offer a robust and efficient framework for analyzing time series data, modelling both the underlying latent state progression over time and the observation process, conditional on the latent state. However, a…

Applications · Statistics 2024-07-19 Ioannis Rotous , Alex Diana , Alessio Farcomeni , Eleni Matechou , Andréa Thiebault