English
Related papers

Related papers: An Approximate MSE Expression for Maximum Likeliho…

200 papers

Maximum likelihood (ML) estimation is widely used in statistics. The h-likelihood has been proposed as an extension of Fisher's likelihood to statistical models including unobserved latent variables of recent interest. Its advantage is that…

Methodology · Statistics 2022-07-21 Jeongseop Han , Youngjo Lee , Jae Kwang Kim

Estimating the size of hidden populations using Multiple Systems Estimation (MSE) is a critical task in quantitative sociology; however, practical application is often hindered by imperfect administrative data and computational constraints.…

Applications · Statistics 2026-01-12 Joseph Marsh , Nathan A. Judd , Lax Chan , Rowland G. Seymour

In this article, we propose the Sample Information Optimal Estimator (SIOE) and the Stochastic Restricted Optimal Estimator (SROE) for misspecified linear regression model when multicollinearity exists among explanatory variables. Further,…

Statistics Theory · Mathematics 2019-05-13 Manickavasagar Kayanan , Pushpakanthie Wijekoon

Due to the well-known computational showstopper of the exact Maximum Likelihood Estimation (MLE) for large geospatial observations, a variety of approximation methods have been proposed in the literature, which usually require tuning…

Methodology · Statistics 2021-06-10 Yiping Hong , Sameh Abdulah , Marc G. Genton , Ying Sun

We investigate the theoretical performances of the Partial Least Square (PLS) algorithm in a high dimensional context. We provide upper bounds on the risk in prediction for the statistical linear model when considering the PLS estimator.…

Statistics Theory · Mathematics 2024-10-15 Luca Castelli , Irène Gannaz , Clément Marteau

In this paper we derive a second-order unbiased (or nearly unbiased) mean squared prediction error (MSPE) estimator of the empirical best linear unbiased predictor (EBLUP) of a small area mean for a semi-parametric extension to the…

Methodology · Statistics 2025-02-26 Shijie Chen , P. Lahiri , J. N. K. Rao

We analyze the mean-squared error (MSE) performance of widely linear (WL) and conventional subspace-based channel estimation for single-input multiple-output (SIMO) flat-fading channels employing binary phase-shift-keying (BPSK) modulation…

Information Theory · Computer Science 2015-05-28 Saeed Abdallah , Ioannis N. Psaromiligkos

Mrs. Gerber's Lemma lower bounds the entropy at the output of a binary symmetric channel in terms of the entropy of the input process. In this paper, we lower bound the output entropy via a different measure of input uncertainty, pertaining…

Information Theory · Computer Science 2015-06-02 Or Ordentlich , Ofer Shayevitz

In many semiparametric models that are parameterized by two types of parameters---a Euclidean parameter of interest and an infinite-dimensional nuisance parameter---the two parameters are bundled together, that is, the nuisance parameter is…

Statistics Theory · Mathematics 2012-03-13 Ying Ding , Bin Nan

Recently, we have proposed a maximum likelihood iterative algorithm for estimation of the parameters of the Nakagami-m distribution. This technique performs better than state of art estimation techniques for this distribution. This could be…

Machine Learning · Computer Science 2014-02-04 Rangeet Mitra , Amit Kumar Mishra , Tarun Choubisa

In various applied areas such as reliability engineering, molecular biology, finance, etc., the measure of uncertainty of a probability distribution plays an important role. In the present work, we consider the estimation of a function of…

Statistics Theory · Mathematics 2023-02-09 Lakshmi Kanta Patra , Shrajal Bajpai , Neeraj Misra

We develop a preference elicitation method for a Von Neumann-Morgenstern (VNM)-type decision-maker from pairwise comparison data in the presence of response errors. We apply the maximum likelihood estimation (MLE) method to jointly elicit…

Optimization and Control · Mathematics 2026-03-30 Bo Chen , Jia Liu

Skew normal model suffers from inferential drawbacks, namely singular Fisher information in the vicinity of symmetry and diverging of maximum likelihood estimation. To address the above drawbacks, Azzalini and Arellano-Valle (2013)…

Methodology · Statistics 2024-01-25 Jian Zhang , Tong Wang

We employ a parameter-free distribution estimation framework where estimators are random distributions and utilize the Kullback-Leibler (KL) divergence as a loss function. Wu and Vos [J. Statist. Plann. Inference 142 (2012) 1525-1536] show…

Statistics Theory · Mathematics 2015-09-21 Paul Vos , Qiang Wu

Sparse coding refers to the pursuit of the sparsest representation of a signal in a typically overcomplete dictionary. From a Bayesian perspective, sparse coding provides a Maximum a Posteriori (MAP) estimate of the unknown vector under a…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Dror Simon , Jeremias Sulam , Yaniv Romano , Yue M. Lu , Michael Elad

Orthogonal group synchronization aims to recover orthogonal group elements from their noisy pairwise measurements. It has found numerous applications including computer vision, imaging science, and community detection. Due to the orthogonal…

Statistics Theory · Mathematics 2025-02-21 Ziliang Samuel Zhong , Shuyang Ling

Bias reduction in tail estimation has received considerable interest in extreme value analysis. Estimation methods that minimize the bias while keeping the mean squared error (MSE) under control, are especially useful when applying…

Statistics Theory · Mathematics 2016-06-21 Gaonyalelwe Maribe , Andréhette Verster , Jan Beirlant

This paper investigates the minimum mean square error (MMSE) estimation of x, given the observation y = Hx+n, when x and n are independent and Gaussian Mixture (GM) distributed. The introduction of GM distributions, represents a…

Statistics Theory · Mathematics 2011-08-18 John T. Flam , Saikat Chatterjee , Kimmo Kansanen , Torbjorn Ekman

We study nonparametric estimation for current status data with competing risks. Our main interest is in the nonparametric maximum likelihood estimator (MLE), and for comparison we also consider a simpler ``naive estimator.'' Groeneboom,…

Statistics Theory · Mathematics 2008-06-20 Piet Groeneboom , Marloes H. Maathuis , Jon A. Wellner

Target parameter estimation performance is investigated for a radar employing a set of widely separated transmitting and receiving antenna arrays. Cases with multiple extended targets are considered under two signal model assumptions:…

Information Theory · Computer Science 2018-08-02 Peter Khomchuk , Igal Bilik , Rick S. Blum