English
Related papers

Related papers: Asymptotically Efficient Identification of Known-S…

200 papers

In this paper, we introduce a new estimator for the emission densities of a nonparametric hidden Markov model. It is adaptive and minimax with respect to each state's regularity--as opposed to globally minimax estimators, which adapt to the…

Statistics Theory · Mathematics 2018-07-17 Luc Lehéricy

Motivated by reduction of computational complexity, this work develops sign-error adaptive filtering algorithms for estimating time-varying system parameters. Different from the previous work on sign-error algorithms, the parameters are…

Optimization and Control · Mathematics 2016-11-17 Araz Hashemi , G. Yin , Le Yi Wang

A hidden Markov process is a well known concept in information theory and is used for a vast range of applications such as speech recognition and error correction. We bridge between two disciplines, experimental physics and advanced…

Mesoscale and Nanoscale Physics · Physics 2015-06-24 Ido Kanter , Aviad Frydman , Asaf Ater

Latent variable models have been playing a central role in psychometrics and related fields. In many modern applications, the inference based on latent variable models involves one or several of the following features: (1) the presence of…

Methodology · Statistics 2025-01-08 Siliang Zhang , Yunxiao Chen

Direct simulation of biomolecular dynamics in thermal equilibrium is challenging due to the metastable nature of conformation dynamics and the computational cost of molecular dynamics. Biased or enhanced sampling methods may improve the…

Chemical Physics · Physics 2015-06-12 Benjamin Trendelkamp-Schroer , Frank Noe

We introduce and test an algorithm that adaptively estimates large deviation functions characterizing the fluctuations of additive functionals of Markov processes in the long-time limit. These functions play an important role for predicting…

Statistical Mechanics · Physics 2023-03-30 Grégoire Ferré , Hugo Touchette

Newton-step approximations to pseudo maximum likelihood estimates of spatial autoregressive models with a large number of parameters are examined, in the sense that the parameter space grows slowly as a function of sample size. These have…

Econometrics · Economics 2021-05-25 Abhimanyu Gupta

This paper deals with control of partially observable discrete-time stochastic systems. It introduces and studies Markov Decision Processes with Incomplete Information and with semi-uniform Feller transition probabilities. The important…

Optimization and Control · Mathematics 2022-08-30 Eugene A. Feinberg , Pavlo O. Kasyanov , Michael Z. Zgurovsky

This paper presents a mathematical framework for causal nonlinear prediction in settings where observations are generated from an underlying hidden Markov model (HMM). Both the problem formulation and the proposed solution are motivated by…

Machine Learning · Computer Science 2026-03-16 Heng-Sheng Chang , Prashant G. Mehta

This paper proposes an accelerated proximal point method for maximally monotone operators. The proof is computer-assisted via the performance estimation problem approach. The proximal point method includes various well-known convex…

Optimization and Control · Mathematics 2021-03-25 Donghwan Kim

Estimating conditional dependence graphs and precision matrices are some of the most common problems in modern statistics and machine learning. When data are fully observed, penalized maximum likelihood-type estimators have become standard…

Machine Learning · Statistics 2019-04-09 Roger Fan , Byoungwook Jang , Yuekai Sun , Shuheng Zhou

This paper considers maximum likelihood (ML) estimation in a large class of models with hidden Markov regimes. We investigate consistency of the ML estimator and local asymptotic normality for the models under general conditions which allow…

Statistics Theory · Mathematics 2021-12-07 Demian Pouzo , Zacharias Psaradakis , Martin Sola

Continuous-time Markov processes over finite state-spaces are widely used to model dynamical processes in many fields of natural and social science. Here, we introduce an maximum likelihood estimator for constructing such models from data…

Data Analysis, Statistics and Probability · Physics 2015-07-01 Robert T. McGibbon , Vijay S. Pande

We formulate two classes of first-order algorithms more general than previously studied for minimizing smooth and strongly convex or, respectively, smooth and convex functions. We establish sufficient conditions, via new discrete Lyapunov…

Optimization and Control · Mathematics 2023-04-21 Penghui Fu , Zhiqiang Tan

In simulation-based inferences for partially observed Markov process models (POMP), the by-product of the Monte Carlo filtering is an approximation of the log likelihood function. Recently, iterated filtering [14, 13] has originally been…

Methodology · Statistics 2018-02-26 Dao Nguyen

We observe a length-$n$ sample generated by an unknown,stationary ergodic Markov process (\emph{model}) over a finite alphabet $\mathcal{A}$. Given any string $\bf{w}$ of symbols from $\mathcal{A}$ we want estimates of the conditional…

Information Theory · Computer Science 2014-06-11 Meysam Asadi , Ramezan Paravi Torghabeh , Narayana P. Santhanam

State aggregation is a popular model reduction method rooted in optimal control. It reduces the complexity of engineering systems by mapping the system's states into a small number of meta-states. The choice of aggregation map often depends…

Machine Learning · Computer Science 2019-10-17 Yaqi Duan , Zheng Tracy Ke , Mengdi Wang

We provide a numerically robust and fast method capable of exploiting the local geometry when solving large-scale stochastic optimisation problems. Our key innovation is an auxiliary variable construction coupled with an inverse Hessian…

Machine Learning · Statistics 2018-02-14 Adrian Wills , Thomas Schön

We propose a new framework to estimate the evolution of an ensemble of indistinguishable agents on a hidden Markov chain using only aggregate output data. This work can be viewed as an extension of the recent developments in optimal mass…

Optimization and Control · Mathematics 2021-07-01 Isabel Haasler , Axel Ringh , Yongxin Chen , Johan Karlsson

In this paper, we propose new methods to efficiently solve convex optimization problems encountered in sparse estimation, which include a new quasi-Newton method that avoids computing the Hessian matrix and improves efficiency, and we prove…

Optimization and Control · Mathematics 2023-09-06 Ryosuke Shimmura , Joe Suzuki