English
Related papers

Related papers: Local solutions of Maximum Likelihood Estimation i…

200 papers

The expectation--maximization (EM) algorithm combines global monotonicity, local linear convergence, and strong practical robustness, but these features are usually analyzed separately. Global descent is nonlinear, whereas local convergence…

Machine Learning · Statistics 2026-05-11 Qiao Wang

Assume that we observe i.i.d.~points lying close to some unknown $d$-dimensional $\mathcal{C}^k$ submanifold $M$ in a possibly high-dimensional space. We study the problem of reconstructing the probability distribution generating the…

Statistics Theory · Mathematics 2022-02-15 Vincent Divol

In this study the common least-squares minimization approach is compared to the Bayesian updating procedure. In the content of material parameter identification the posterior parameter density function is obtained from its prior and the…

Data Analysis, Statistics and Probability · Physics 2024-08-12 Thomas Most

Maximum likelihood estimation (MLE) of latent variable models is often recast as the minimization of a free energy functional over an extended space of parameters and probability distributions. This perspective was recently combined with…

Machine Learning · Computer Science 2024-06-05 Jen Ning Lim , Juan Kuntz , Samuel Power , Adam M. Johansen

Time-homogeneous Markov chains are often used as disease progression models in studies of cost-effectiveness and optimal decision-making. Maximum likelihood estimation of these models can be challenging when data are collected at a time…

Methodology · Statistics 2022-09-26 Duncan Ermini Leaf

We propose an adaptive, two steps strategy, for the estimation of mixed qubit states. We show that the strategy is optimal in a local minimax sense for the trace norm distance as well as other locally quadratic figures of merit. Local…

Quantum Physics · Physics 2011-06-23 Madalin Guta , Bas Janssens , Jonas Kahn

Quantum estimation theory provides optimal observations for various estimation problems for unknown parameters in the state of the system under investigation. However, the theory has been developed under the assumption that every observable…

Quantum Physics · Physics 2009-11-10 M. Hotta , M. Ozawa

Let X_1, ..., X_n be independent and identically distributed random vectors with a log-concave (Lebesgue) density f. We first prove that, with probability one, there exists a unique maximum likelihood estimator of f. The use of this…

Methodology · Statistics 2008-04-25 Madeleine Cule , Richard Samworth , Michael Stewart

We apply a general method for the estimation of completely positive maps to the 1-to-2 universal covariant cloning machine. The method is based on the maximum-likelihood principle, and makes use of random input states, along with random…

Quantum Physics · Physics 2009-11-06 Massimiliano F. Sacchi

We introduce a fresh scheme based on the local hidden variable models to quantify nonlocality for arbitrarily high-dimensional quantum systems. Our scheme explores the minimal amount of white noise that must be added to the system in order…

Quantum Physics · Physics 2009-11-09 Dong-Ling Deng , Jing-Ling Chen , Zi-Sui Zhou

We investigate the landscape of the negative log-likelihood function of Gaussian Mixture Models (GMMs) with a general number of components in the population limit. As the objective function is non-convex, there can be multiple local minima…

Machine Learning · Statistics 2026-01-21 Yudong Chen , Dogyoon Song , Xumei Xi , Yuqian Zhang

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing (local) maximum likelihood estimate (MLE). It can be used in an extensive range of problems, including the clustering of data based on the Gaussian…

Machine Learning · Statistics 2023-03-28 Pierre Houdouin , Esa Ollila , Frederic Pascal

We present a protocol that allows the estimation of any density matrix element for continuous-variable quantum states, without resorting to the complete reconstruction of the full density matrix. The algorithm adaptatively discretizes the…

Quantum Physics · Physics 2024-09-25 Virginia Feldman , Ariel Bendersky

Maximum likelihood estimation is widely used in training Energy-based models (EBMs). Training requires samples from an unnormalized distribution, which is usually intractable, and in practice, these are obtained by MCMC algorithms such as…

Machine Learning · Computer Science 2021-04-23 Zhisheng Xiao , Qing Yan , Yali Amit

Non-convex optimization is ubiquitous in modern machine learning. Researchers devise non-convex objective functions and optimize them using off-the-shelf optimizers such as stochastic gradient descent and its variants, which leverage the…

Machine Learning · Computer Science 2021-03-26 Tengyu Ma

In this paper, we present a novel optimization algorithm designed specifically for estimating state-space models to deal with heavy-tailed measurement noise and constraints. Our algorithm addresses two significant limitations found in…

Signal Processing · Electrical Eng. & Systems 2024-11-19 Yifan Yu , Shengjie Xiu , Daniel P. Palomar

Quantum state tomography is an indispensable but costly part of many quantum experiments. Typically, it requires measurements to be carried in a number of different settings on a fixed experimental setup. The collected data is often…

Quantum Physics · Physics 2017-09-13 Jun Li , Shilin Huang , Zhihuang Luo , Keren Li , Dawei Lu , Bei Zeng

Likelihood functions evaluated using particle filters are typically noisy, computationally expensive, and non-differentiable due to Monte Carlo variability. These characteristics make conventional optimization methods difficult to apply…

Methodology · Statistics 2026-01-13 Genshiro Kitagawa

We investigate methods for parameter learning from incomplete data that is not missing at random. Likelihood-based methods then require the optimization of a profile likelihood that takes all possible missingness mechanisms into account.…

Methodology · Statistics 2012-07-02 Manfred Jaeger

The problem of simulatability of quantum processes using classical resources plays a cornerstone role for quantum computing. Quantum circuits can be simulated classically, e.g., using Monte Carlo sampling techniques applied to…

Quantum Physics · Physics 2024-02-09 Denis A. Kulikov , Vsevolod I. Yashin , Aleksey K. Fedorov , Evgeniy O. Kiktenko