English
Related papers

Related papers: Optimal Estimation for General Gaussian Processes

200 papers

This paper investigates a channel estimator based on Gaussian mixture models (GMMs) in the context of linear inverse problems with additive Gaussian noise. We fit a GMM to given channel samples to obtain an analytic probability density…

Signal Processing · Electrical Eng. & Systems 2022-09-14 Michael Koller , Benedikt Fesl , Nurettin Turan , Wolfgang Utschick

This paper defines a Maximum Likelihood Estimator (MLE) for the admittance matrix estimation of distribution grids, utilising voltage magnitude and power measurements collected only from common, unsychronised measuring devices (Smart…

Systems and Control · Electrical Eng. & Systems 2022-10-06 Lisa Laurent , Jean-Sébastien Brouillon , Giancarlo Ferrari-Trecate

An estimation problem of fundamental interest is that of phase synchronization, in which the goal is to recover a collection of phases using noisy measurements of relative phases. It is known that in the Gaussian noise setting, the maximum…

Optimization and Control · Mathematics 2016-11-02 Huikang Liu , Man-Chung Yue , Anthony Man-Cho So

The saddlepoint approximation gives an approximation to the density of a random variable in terms of its moment generating function. When the underlying random variable is itself the sum of $n$ unobserved i.i.d. terms, the basic classical…

Statistics Theory · Mathematics 2022-01-25 Jesse Goodman

Maximum likelihood is the most widely used statistical estimation technique. Recent work by the authors introduced a general methodology for the construction of estimators for functionals in parametric models, and demonstrated improvements…

Methodology · Statistics 2014-09-29 Jiantao Jiao , Kartik Venkat , Yanjun Han , Tsachy Weissman

We study maximum likelihood estimation for spatial generalized linear mixed models with Gaussian process approximations using a stochastic Newton-Raphson algorithm. We consider two Gaussian Process approximations in this context: spectral…

Methodology · Statistics 2026-05-19 Samuel I. Watson , Yixin Wang , Emanuele Giorgi

Let $f(y|\theta), \; \theta \in \Omega$ be a parametric family, $\eta(\theta)$ a given function, and $G$ an unknown mixing distribution. It is desired to estimate $E_G (\eta(\theta))\equiv \eta_G$ based on independent observations…

Statistics Theory · Mathematics 2022-07-29 Eitan Greenshtein , Ya'acov Ritov

There have been many applications of deep neural networks to detector calibrations and a growing number of studies that propose deep generative models as automated fast detector simulators. We show that these two tasks can be unified by…

High Energy Physics - Phenomenology · Physics 2025-04-14 Haoxing Du , Claudius Krause , Vinicius Mikuni , Benjamin Nachman , Ian Pang , David Shih

We analyze the problem of maximum likelihood estimation for Gaussian distributions that are multivariate totally positive of order two (MTP2). By exploiting connections to phylogenetics and single-linkage clustering, we give a simple proof…

Methodology · Statistics 2018-05-29 Steffen Lauritzen , Caroline Uhler , Piotr Zwiernik

We consider parameter estimation in finite hidden state space Markov models with time-dependent inhomogeneous noise, where the inhomogeneity vanishes sufficiently fast. Based on the concept of asymptotic mean stationary processes we prove…

Statistics Theory · Mathematics 2018-10-02 Manuel Diehn , Axel Munk , Daniel Rudolf

Determinantal point processes (DPPs) have wide-ranging applications in machine learning, where they are used to enforce the notion of diversity in subset selection problems. Many estimators have been proposed, but surprisingly the basic…

Statistics Theory · Mathematics 2017-07-25 Victor-Emmanuel Brunel , Ankur Moitra , Philippe Rigollet , John Urschel

Targeted maximum likelihood estimators (TMLEs) are asymptotically optimal among regular, asymptotically linear estimators. In small samples, however, we may be far from "asymptopia" and not reap the benefits of optimality. Here we propose a…

Methodology · Statistics 2025-02-04 Noel Pimentel , Alejandro Schuler , Mark van der Laan

Learning a Gaussian Mixture Model (GMM) is hard when the number of parameters is too large given the amount of available data. As a remedy, we propose restricting the GMM to a Gaussian Markov Random Field Mixture Model (GMRF-MM), as well as…

Machine Learning · Computer Science 2022-01-25 Shahaf E. Finder , Eran Treister , Oren Freifeld

Accurately inferring the state of a quantum device from the results of measurements is a crucial task in building quantum information processing hardware. The predominant state estimation procedure, maximum likelihood estimation (MLE),…

Quantum Physics · Physics 2010-05-04 Robin Blume-Kohout

We prove the consistency and asymptotic normality of the Laplacian Quasi-Maximum Likelihood Estimator (QMLE) for a general class of causal time series including ARMA, AR($\infty$), GARCH, ARCH($\infty$), ARMA-GARCH, APARCH, ARMA-APARCH,...,…

Statistics Theory · Mathematics 2017-02-22 Jean-Marc Bardet , Yakoub Boularouk , Khedidja Djaballah

Operational risk models commonly employ maximum likelihood estimation (MLE) to fit loss data to heavy-tailed distributions. Yet several desirable properties of MLE (e.g. asymptotic normality) are generally valid only for large sample-sizes,…

Risk Management · Quantitative Finance 2016-08-26 Paul Larsen

Hawkes Processes have undergone increasing popularity as default tools for modeling self- and mutually exciting interactions of discrete events in continuous-time event streams. A Maximum Likelihood Estimation (MLE) unconstrained…

Machine Learning · Computer Science 2021-05-11 Rafael Lima

Asymptotic efficiency of targeted maximum likelihood estimators (TMLE) of target features of the data distribution relies on a a second order remainder being asymptotically negligible. In previous work we proposed a nonparametric MLE termed…

Statistics Theory · Mathematics 2021-07-02 Mark van der Laan , Zeyi Wang , Lars van der Laan

We consider signal source localization from range-difference measurements. First, we give some readily-checked conditions on measurement noises and sensor deployment to guarantee the asymptotic identifiability of the model and show the…

Signal Processing · Electrical Eng. & Systems 2023-09-26 Guangyang Zeng , Biqiang Mu , Ling Shi , Jiming Chen , Junfeng Wu

The paper studies large sample asymptotic properties of the Maximum Likelihood Estimator (MLE) for the parameter of a continuous time Markov chain, observed in white noise. Using the method of weak convergence of likelihoods due to…

Probability · Mathematics 2009-06-18 Pavel Chigansky