English
Related papers

Related papers: Bayesian and Maximum Likelihood Estimation for Gau…

200 papers

We study the class of state-space models and perform maximum likelihood estimation for the model parameters. We consider a stochastic approximation expectation-maximization (SAEM) algorithm to maximize the likelihood function with the…

Computation · Statistics 2017-10-25 Umberto Picchini , Adeline Samson

Approximate Bayesian computation (ABC) is a popular technique for approximating likelihoods and is often used in parameter estimation when the likelihood functions are analytically intractable. Although the use of ABC is widespread in many…

Statistics Theory · Mathematics 2011-03-29 Thomas A. Dean , Sumeetpal S. Singh , Ajay Jasra , Gareth W. Peters

This paper addresses the adaptive radar target detection problem in the presence of Gaussian interference with unknown statistical properties. To this end, the problem is first formulated as a binary hypothesis test, and then we derive a…

Signal Processing · Electrical Eng. & Systems 2025-03-05 Chaoran Yin , Tianqi Wang , Linjie Yan , Chengpeng Hao , Alfonso Farina , Danilo Orlando

Likelihood-based inference in stochastic non-linear dynamical systems, such as those found in chemical reaction networks and biological clock systems, is inherently complex and has largely been limited to small and unrealistically simple…

Computation · Statistics 2024-07-08 Ben Swallow , David A. Rand , Giorgos Minas

We consider a framework for determining and estimating the conditional pairwise relationships of variables when the observed samples are contaminated with measurement error in high dimensional settings. Assuming the true underlying…

Methodology · Statistics 2019-07-05 Michael Byrd , Linh Nghiem , Monnie McGee

The Expectation-Maximization (EM) algorithm is a fundamental tool in unsupervised machine learning. It is often used as an efficient way to solve Maximum Likelihood (ML) estimation problems, especially for models with latent variables. It…

Quantum Physics · Physics 2020-07-08 Iordanis Kerenidis , Alessandro Luongo , Anupam Prakash

We propose a multilevel Markov chain Monte Carlo (MCMC) method for the Bayesian inference of random field parameters in PDEs using high-resolution data. Compared to existing multilevel MCMC methods, we additionally consider level-dependent…

Numerical Analysis · Mathematics 2025-08-19 Pieter Vanmechelen , Geert Lombaert , Giovanni Samaey

We present both offline and online maximum likelihood estimation (MLE) techniques for inferring the static parameters of a multiple target tracking (MTT) model with linear Gaussian dynamics. We present the batch and online versions of the…

Applications · Statistics 2014-10-09 Sinan Yildirim , Lan Jiang , Sumeetpal S. Singh , Tom Dean

Mixed linear regression (MLR) model is among the most exemplary statistical tools for modeling non-linear distributions using a mixture of linear models. When the additive noise in MLR model is Gaussian, Expectation-Maximization (EM)…

Machine Learning · Statistics 2021-05-14 Babak Barazandeh , Ali Ghafelebashi , Meisam Razaviyayn , Ram Sriharsha

We propose a new and computationally efficient algorithm for maximizing the observed log-likelihood for a multivariate normal data matrix with missing values. We show that our procedure based on iteratively regressing the missing on the…

Methodology · Statistics 2012-11-21 Nicolas Städler , Daniel J. Stekhoven , Peter Bühlmann

Gravitational-wave astronomers often wish to characterize the expected parameter-estimation accuracy of future observations. The Fisher matrix provides a lower bound on the spread of the maximum-likelihood estimator across noise…

General Relativity and Quantum Cosmology · Physics 2011-11-08 Michele Vallisneri

Bayesian methods for low-rank matrix completion with noise have been shown to be very efficient computationally. While the behaviour of penalized minimization methods is well understood both from the theoretical and computational points of…

Statistics Theory · Mathematics 2015-04-08 The Tien Mai , Pierre Alquier

Much recent research has been conducted in the area of Bayesian learning, particularly with regard to the optimization of hyper-parameters via Gaussian process regression. The methodologies rely chiefly on the method of maximizing the…

Machine Learning · Statistics 2014-05-13 James Brofos

In recent times empirical likelihood has been widely applied under Bayesian framework. Markov chain Monte Carlo (MCMC) methods are frequently employed to sample from the posterior distribution of the parameters of interest. However,…

Methodology · Statistics 2022-09-07 Sanjay Chaudhuri , Teng Yin

The Brown-Resnick max-stable process has proven to be well-suited for modeling extremes of complex environmental processes, but in many applications its likelihood function is intractable and inference must be based on a composite…

Methodology · Statistics 2017-01-16 Emeric Thibaud , Juha Aalto , Daniel S. Cooley , Anthony C. Davison , Juha Heikkinen

We present a kernel-independent method that applies hierarchical matrices to the problem of maximum likelihood estimation for Gaussian processes. The proposed approximation provides natural and scalable stochastic estimators for its…

Computation · Statistics 2019-03-26 Christopher J. Geoga , Mihai Anitescu , Michael L. Stein

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander

In this paper we consider the parameter estimation problem associated to partially-observed time changed SDEs, with observations that are given at discrete times. In particular we consider both likelihood and Bayesian estimation. We develop…

Numerical Analysis · Mathematics 2026-05-12 Ke Zhao , Ajay Jasra

Deriving Bayesian inference for exponential random graph models (ERGMs) is a challenging "doubly intractable" problem as the normalizing constants of the likelihood and posterior density are both intractable. Markov chain Monte Carlo (MCMC)…

Computation · Statistics 2019-11-26 Linda S. L. Tan , Nial Friel

We present new methodologies for Bayesian inference on the rate parameters of a discretely observed continuous-time Markov jump processes with a countably infinite state space. The usual method of choice for inference, particle Markov chain…

Computation · Statistics 2022-06-22 Chris Sherlock , Andrew Golightly