English
Related papers

Related papers: Local solutions of Maximum Likelihood Estimation i…

200 papers

In this paper we consider regression problems subject to arbitrary noise in the operator or design matrix. This characterization appropriately models many physical phenomena with uncertainty in the regressors. Although the problem has been…

Computation · Statistics 2021-04-08 Richard J Clancy , Stephen Becker

We present an algorithm based on maximum likelihood for the estimation and renormalization (marginalization) of exponential densities. The moment-matching problem resulting from the maximization of the likelihood is solved as an…

Statistics Theory · Mathematics 2009-11-10 Panagiotis Stinis

Consider the problem of minimizing an expected logarithmic loss over either the probability simplex or the set of quantum density matrices. This problem includes tasks such as solving the Poisson inverse problem, computing the…

Optimization and Control · Mathematics 2024-03-12 Chung-En Tsai , Hao-Chung Cheng , Yen-Huan Li

In recent years, methods of approximate parameter estimation have attracted considerable interest in complex problems where exact likelihoods are hard to obtain. In their most basic form, Bayesian methods such as Approximate Bayesian…

Computation · Statistics 2015-07-17 Johanna Bertl , Gregory Ewing , Carolin Kosiol , Andreas Futschik

We describe a method to computationally estimate the probability density function of a univariate random variable by applying the maximum entropy principle with some local conditions given by Gaussian functions. The estimation errors and…

Statistics Theory · Mathematics 2012-06-21 Mihail-Ioan Pop

A local algorithm is a distributed algorithm where each node must operate solely based on the information that was available at system startup within a constant-size neighbourhood of the node. We study the applicability of local algorithms…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-09-09 Patrik Floréen , Petteri Kaski , Topi Musto , Jukka Suomela

We tackle the problem of high-dimensional nonparametric density estimation by taking the class of log-concave densities on $\mathbb{R}^p$ and incorporating within it symmetry assumptions, which facilitate scalable estimation algorithms and…

Statistics Theory · Mathematics 2019-03-15 Min Xu , Richard J. Samworth

Maximum likelihood (ML) estimation using Newton's method in nonlinear state space models (SSMs) is a challenging problem due to the analytical intractability of the log-likelihood and its gradient and Hessian. We estimate the gradient and…

Computation · Statistics 2016-03-11 Manon Kok , Johan Dahlin , Thomas B. Schön , Adrian Wills

We report on an intrinsic relationship between the maximum-likelihood quantum-state estimation and the representation of the signal. A quantum analogy of the transfer function determines the space where the reconstruction should be done…

Quantum Physics · Physics 2009-11-13 Z. Hradil , D. Mogilevtsev , J. Rehacek

Many imaging problems require solving an inverse problem that is ill-conditioned or ill-posed. Imaging methods typically address this difficulty by regularising the estimation problem to make it well-posed. This often requires setting the…

Methodology · Statistics 2020-08-17 Ana F. Vidal , Valentin De Bortoli , Marcelo Pereyra , Alain Durmus

Maximum likelihood is the most widely used statistical estimation technique. Recent work by the authors introduced a general methodology for the construction of estimators for functionals in parametric models, and demonstrated improvements…

Methodology · Statistics 2014-09-29 Jiantao Jiao , Kartik Venkat , Yanjun Han , Tsachy Weissman

We study maximum likelihood estimation in log-linear models under conditional Poisson sampling schemes. We derive necessary and sufficient conditions for existence of the maximum likelihood estimator (MLE) of the model parameters and…

Statistics Theory · Mathematics 2012-07-24 Stephen E. Fienberg , Alessandro Rinaldo

The Expectation-Maximization (EM) algorithm is an iterative method to maximize the log-likelihood function for parameter estimation. Previous works on the convergence analysis of the EM algorithm have established results on the asymptotic…

Statistics Theory · Mathematics 2017-05-31 Chong Wu , Can Yang , Hongyu Zhao , Ji Zhu

Estimating a Gibbs density function given a sample is an important problem in computational statistics and statistical learning. Although the well established maximum likelihood method is commonly used, it requires the computation of the…

Machine Learning · Computer Science 2023-03-14 Eldad Haber , Moshe Eliasof , Luis Tenorio

We consider the system identification problem of estimating a dynamical parameter of a Markovian quantum open system (the atom maser), by performing continuous time measurements in the system's output (outgoing atoms). Two estimation…

Quantum Physics · Physics 2015-06-17 Catalin Catana , Theodore Kypraios , Madalin Guta

In this paper, we propose a maximum smoothed likelihood method to estimate the component density functions of mixture models, in which the mixing proportions are known and may differ among observations. The proposed estimates maximize a…

Methodology · Statistics 2014-07-14 Tao Yu , Pengfei Li , Jing Qin

We study probability density functions that are log-concave. Despite the space of all such densities being infinite-dimensional, the maximum likelihood estimate is the exponential of a piecewise linear function determined by finitely many…

The likelihood function is a fundamental component in Bayesian statistics. However, evaluating the likelihood of an observation is computationally intractable in many applications. In this paper, we propose a non-parametric approximation of…

Machine Learning · Computer Science 2019-10-24 Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh , Man-Chung Yue , Daniel Kuhn , Wolfram Wiesemann

Local Fourier analysis is a useful tool for predicting and analyzing the performance of many efficient algorithms for the solution of discretized PDEs, such as multigrid and domain decomposition methods. The crucial aspect of local Fourier…

Optimization and Control · Mathematics 2020-07-29 Jed Brown , Yunhui He , Scott MacLachlan , Matt Menickelly , Stefan M. Wild

Quantum state tomography, the ability to deduce the density matrix of a quantum system from measured data, is of fundamental importance for the verification of present and future quantum devices. It has been realized in systems with few…

Quantum Physics · Physics 2010-02-22 M. Cramer , M. B. Plenio