English
Related papers

Related papers: Asymptotic Properties of Recursive Maximum Likelih…

200 papers

Variational methods for parameter estimation are an active research area, potentially offering computationally tractable heuristics with theoretical performance bounds. We build on recent work that applies such methods to network data, and…

Statistics Theory · Mathematics 2013-10-30 Peter Bickel , David Choi , Xiangyu Chang , Hai Zhang

Approximate Bayesian computation (ABC) is a popular technique for approximating likelihoods and is often used in parameter estimation when the likelihood functions are analytically intractable. Although the use of ABC is widespread in many…

Statistics Theory · Mathematics 2011-03-29 Thomas A. Dean , Sumeetpal S. Singh , Ajay Jasra , Gareth W. Peters

A linear Gaussian state-space smoothing algorithm is presented for estimation of derivatives from a sequence of noisy measurements. The algorithm uses numerically stable square-root formulas, can handle simultaneous independent measurements…

Methodology · Statistics 2016-10-17 Robert Piche

After decades of research in Direction of Arrival (DoA) estimation, today Maximum Likelihood (ML) algorithms still provide the best performance in terms of resolution capabilities. At the cost of a multidimensional search, ML algorithms…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Xavier Mestre , Pascal Vallet

For recursive circular filtering based on circular statistics, we introduce a general framework for estimation of a circular state based on different circular distributions, specifically the wrapped normal distribution and the von Mises…

Systems and Control · Computer Science 2018-01-01 Gerhard Kurz , Igor Gilitschenski , Uwe D. Hanebeck

The maximum likelihood estimates of an ARMA model can be obtained by the Kalman filter based on the state-space representation of the model. This paper presents an algorithm for computing gradient of the log-likelihood by an extending the…

Computation · Statistics 2020-11-20 G. Kitagawa

A new approach to inference in state space models is proposed, based on approximate Bayesian computation (ABC). ABC avoids evaluation of the likelihood function by matching observed summary statistics with statistics computed from data…

Statistics Theory · Mathematics 2014-10-01 Gael M. Martin , Brendan P. M. McCabe , Worapree Maneesoonthorn , Christian P. Robert

The classical sparse parameter identification methods are usually based on the iterative basis selection such as greedy algorithms, or the numerical optimization of regularized cost functions such as LASSO and Bayesian posterior probability…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Yanxin Fu , Wenxiao Zhao

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

This paper studies a nonlinear filtering problem over an infinite time interval. The signal to be estimated is driven by a stochastic partial differential equation involves unknown parameters. Based on discrete observation, strongly…

Statistics Theory · Mathematics 2021-07-12 Qizhu Liang , Jie Xiong , Xingqiu Zhao

The computational properties of neural systems are often thought to be implemented in terms of their network dynamics. Hence, recovering the system dynamics from experimentally observed neuronal time series, like multiple single-unit (MSU)…

Neurons and Cognition · Quantitative Biology 2017-07-05 Daniel Durstewitz

The optimal selection of experimental conditions is essential to maximizing the value of data for inference and prediction, particularly in situations where experiments are time-consuming and expensive to conduct. We propose a general…

Machine Learning · Statistics 2012-12-04 Xun Huan , Youssef M. Marzouk

Finite state space hidden Markov models are flexible tools to model phenomena with complex time dependencies: any process distribution can be approximated by a hidden Markov model with enough hidden states.We consider the problem of…

Statistics Theory · Mathematics 2021-02-16 Luc Lehéricy

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

Bayesian methods are often optimal, yet increasing pressure for fast computations, especially with streaming data, brings renewed interest in faster, possibly sub-optimal, solutions. The extent to which these algorithms approximate Bayesian…

Statistics Theory · Mathematics 2026-02-18 Sandra Fortini , Sonia Petrone

State-space models have been used in many applications, including econometrics, engineering, medical research, etc. The maximum likelihood estimation (MLE) of the static parameter of general state-space models is not straightforward because…

Methodology · Statistics 2025-02-04 Yuxiong Gao , Wentao Li , Rong Chen

In simulation-based inferences for partially observed Markov process models (POMP), the by-product of the Monte Carlo filtering is an approximation of the log likelihood function. Recently, iterated filtering [14, 13] has originally been…

Methodology · Statistics 2018-02-26 Dao Nguyen

Continuous-time state-space models (SSMs) are flexible tools for analysing irregularly sampled sequential observations that are driven by an underlying state process. Corresponding applications typically involve restrictive assumptions…

Methodology · Statistics 2020-10-29 Sina Mews , Roland Langrock , Marius Ötting , Houda Yaqine , Jost Reinecke

We use statistical learning methods to construct an adaptive state estimator for nonlinear stochastic systems. Optimal state estimation, in the form of a Kalman filter, requires knowledge of the system's process and measurement uncertainty.…

Machine Learning · Statistics 2014-11-05 Michael Busch , Jeff Moehlis

Online (also called "recursive" or "adaptive") estimation of fixed model parameters in hidden Markov models is a topic of much interest in times series modelling. In this work, we propose an online parameter estimation algorithm that…

Computation · Statistics 2011-02-16 Olivier Cappé