English
Related papers

Related papers: Non-asymptotic deviation inequalities for smoothed…

200 papers

[This paper was initially published in PHME conference in 2016, selected for further publication in International Journal of Prognostics and Health Management.] This paper describes an Autoregressive Partially-hidden Markov model (ARPHMM)…

Machine Learning · Statistics 2021-05-04 Pablo Juesas , Emmanuel Ramasso , Sébastien Drujont , Vincent Placet

Adaptive homodyne estimation of a continuously evolving optical phase using time-symmetric quantum smoothing has been demonstrated experimentally to provide superior accuracy in the phase estimate compared to adaptive or nonadaptive…

Quantum Physics · Physics 2015-09-14 Shibdas Roy , Ian R. Petersen , Elanor H. Huntington

Due to developments in instruments and computers, functional observations are increasingly popular. However, effective methodologies for flexibly estimating the underlying trends with valid uncertainty quantification for a sequence of…

Methodology · Statistics 2022-09-22 Tomoya Wakayama , Shonosuke Sugasawa

In this paper, we propose a novel supervised single-channel speech enhancement method combing the the Kullback-Leibler divergence-based non-negative matrix factorization (NMF) and hidden Markov model (NMF-HMM). With the application of HMM,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-01 Yang Xiang , Liming Shi , Jesper Lisby Højvang , Morten Højfeldt Rasmussen , Mads Græsbøll Christensen

We study the effect of fading in the communication channels between sensor nodes on the performance of the incremental least mean square (ILMS) algorithm, and derive steady state performance metrics, including the mean-square deviation…

Information Theory · Computer Science 2015-09-10 Azam Khalili , Amir Rastegarnia

The hidden Markov model (HMM) provides a powerful framework for inference in time-varying environments, where the underlying state evolves according to a Markov chain. To address the optimal filtering problem in general dynamic settings, we…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Dongyan Sui , Haotian Pu , Siyang Leng , Stefan Vlaski

We consider a class of filtering problems for large populations where each individual is modeled by the same hidden Markov model (HMM). In this paper, we focus on aggregate inference problems in HMMs with discrete state space and continuous…

Machine Learning · Statistics 2020-11-09 Qinsheng Zhang , Rahul Singh , Yongxin Chen

The hidden Markov model (HMM) is a fundamental tool for sequence modeling that cleanly separates the hidden state from the emission structure. However, this separation makes it difficult to fit HMMs to large datasets in modern NLP, and they…

Computation and Language · Computer Science 2020-11-10 Justin T. Chiu , Alexander M. Rush

A prevalent problem in general state space models is the approximation of the smoothing distribution of a state conditional on the observations from the past, the present, and the future. The aim of this paper is to provide a rigorous…

Statistics Theory · Mathematics 2016-05-30 Thi Ngoc Minh Nguyen , Sylvain Le Corff , Eric Moulines

The conformational kinetics of enzymes can be reliably revealed when they are governed by Markovian dynamics. Hidden Markov Models (HMMs) are appropriate especially in the case of conformational states that are hardly distinguishable.…

Quantitative Methods · Quantitative Biology 2009-02-05 A. Kovalev , N. Zarrabi , F. Werz , M. Boersch , Z. Ristic , H. Lill , D. Bald , C. Tietz , J. Wrachtrup

We consider the problem of estimating an additive regression function in an inverse regres- sion model with a convolution type operator. A smooth backfitting procedure is developed and asymptotic normality of the resulting estimator is…

Methodology · Statistics 2016-11-26 Nicolai Bissantz , Holger Dette , Thimo Hildebrandt

This paper presents a hierarchical federated learning (FL) framework that extends the alternating direction method of multipliers (ADMM) with smoothing techniques, tailored for non-convex and non-smooth objectives. Unlike traditional…

Machine Learning · Computer Science 2025-03-13 Reza Mirzaeifard , Stefan Werner

In this paper, a posteriori error estimates of functional type for a stationary diffusion problem with nonsymmetric coefficients are derived. The estimate is guaranteed and does not depend on any particular numerical method. An algorithm…

Numerical Analysis · Mathematics 2014-11-24 Olli Mali

We study the effect of fading in the communication channels between nodes on the performance of the incremental least mean square (ILMS) algorithm. We derive steady-state performance metrics, including the mean-square deviation (MSD),…

Systems and Control · Computer Science 2015-08-11 Azam Khalili , Amir Rastegarnia

We propose a Bayesian hidden Markov model for analyzing time series and sequential data where a special structure of the transition probability matrix is embedded to model explicit-duration semi-Markovian dynamics. Our formulation allows…

Methodology · Statistics 2022-05-23 Beniamino Hadj-Amar , Jack Jewson , Mark Fiecas

Over the last decade, hidden Markov models (HMMs) have become increasingly popular in statistical ecology, where they constitute natural tools for studying animal behavior based on complex sensor data. Corresponding analyses sometimes…

Methodology · Statistics 2025-10-15 Jan-Ole Koslik , Carlina C. Feldmann , Sina Mews , Rouven Michels , Roland Langrock

We consider penalized estimation in hidden Markov models (HMMs) with multivariate Normal observations. In the moderate-to-large dimensional setting, estimation for HMMs remains challenging in practice, due to several concerns arising from…

Methodology · Statistics 2014-01-09 Nicolas Städler , Sach Mukherjee

Dynamic inference problems in autoregressive (AR/ARMA/ARIMA), exponential smoothing, and navigation are often formulated and solved using state-space models (SSM), which allow a range of statistical distributions to inform innovations and…

Optimization and Control · Mathematics 2019-10-31 Jonathan Jonker , Peng Zheng , Aleksandr Y. Aravkin

We consider stochastic optimization problems involving an expected value of a nonlinear function of a base random vector and a conditional expectation of another function depending on the base random vector, a dependent random vector, and…

Optimization and Control · Mathematics 2024-05-20 Andrzej Ruszczyński , Shangzhe Yang

We present a stochastic setting for optimization problems with nonsmooth convex separable objective functions over linear equality constraints. To solve such problems, we propose a stochastic Alternating Direction Method of Multipliers…

Machine Learning · Computer Science 2013-01-23 Hua Ouyang , Niao He , Alexander Gray