English
Related papers

Related papers: Liu-type Negative Binomial Regression: A Compariso…

200 papers

Standard variational lower bounds used to train latent variable models produce biased estimates of most quantities of interest. We introduce an unbiased estimator of the log marginal likelihood and its gradients for latent variable models…

Machine Learning · Computer Science 2020-07-14 Yucen Luo , Alex Beatson , Mohammad Norouzi , Jun Zhu , David Duvenaud , Ryan P. Adams , Ricky T. Q. Chen

The computation of the maximum likelihood (ML) estimator for heteroscedastic regression models is considered. The traditional Newton algorithms for the problem require matrix multiplications and inversions, which are bottlenecks in modern…

Computation · Statistics 2016-08-24 Hien D. Nguyen , Luke R. Lloyd-Jones , Geoffrey J. McLachlan

Restricted maximum likelihood (REML) estimation is a widely accepted and frequently used method for fitting linear mixed models, with its principal advantage being that it produces less biased estimates of the variance components. However,…

Methodology · Statistics 2025-05-15 Luca Maestrini , Francis K. C. Hui , Alan H. Welsh

The bias of an estimator is defined as the difference of its expected value from the parameter to be estimated, where the expectation is with respect to the model. Loosely speaking, small bias reflects the desire that if an experiment is…

Methodology · Statistics 2018-02-16 Ioannis Kosmidis

For a multinomial distribution, suppose that we have prior knowledge of the sum of the probabilities of some categories. This allows us to construct a submodel in a full (i.e., no-restriction) model. Maximum likelihood estimation (MLE)…

Statistics Theory · Mathematics 2021-06-07 Yo Sheena

In this paper, we consider the multicollinearity problem in the gamma regression model when model parameters are linearly restricted. The linear restrictions are available from prior information to ensure the validity of scientific theories…

Methodology · Statistics 2023-03-10 Solmaz Seifollahi , Hossein Bevrani , Kaniav Kamary

It is proposed in the literature that in some complicated problems maximum likelihood estimates (MLE) are not suitable or even do not exist. An alternative to MLE for estimation of the parameters is the Bayesian method. The Markov chain…

Applications · Statistics 2019-10-08 Ali Reza Fotouhi

RNA-Seq data characteristically exhibits large variances, which need to be appropriately accounted for in the model. We first explore the effects of this variability on the maximum likelihood estimator (MLE) of the overdispersion parameter…

Methodology · Statistics 2015-12-03 Luis Leon-Novelo , Claudio Fuentes , Sarah Emerson

Recent progress in deep latent variable models has largely been driven by the development of flexible and scalable variational inference methods. Variational training of this type involves maximizing a lower bound on the log-likelihood,…

Machine Learning · Computer Science 2016-06-02 Andriy Mnih , Danilo J. Rezende

The objective of this paper is to propose an unbiased ratio-type estimator for finite population mean when the variables are negatively correlated. Hartley and Ross[2] and Singh and Singh [6] estimators are identified as particular cases of…

Methodology · Statistics 2012-10-11 Jayant Singh , Housila P. Singh , Rajesh Singh

This work studies the properties of the maximum likelihood estimator (MLE) of a non-linear model with Gaussian errors and multidimensional parameter. The observations are collected in a two-stage experimental design and are dependent since…

Statistics Theory · Mathematics 2019-11-01 Nancy Flournoy , Caterina May , Chiara Tommasi

Given an i.i.d. sample drawn from some probability distribution on a finite set, the best (in the sense of least variance) linear unbiased estimator (BLUE) of the average of any quantity with respect to that distribution is the sample…

Statistics Theory · Mathematics 2025-07-28 Bastiaan J. Braams

We propose a new unbiased estimator for estimating the utility of the optimal stopping problem. The MUSE, short for Multilevel Unbiased Stopping Estimator, constructs the unbiased Multilevel Monte Carlo (MLMC) estimator at every stage of…

Computation · Statistics 2022-12-29 Zhengqing Zhou , Guanyang Wang , Jose Blanchet , Peter W. Glynn

A bias-reduced estimator is proposed for the mean absolute deviation parameter of a median regression model. A workaround is devised for the lack of smoothness in the sense conventionally required in general bias-reduced estimation. A local…

Methodology · Statistics 2023-05-04 Michele Lambardi di San Miniato

Small area estimators that ignore the sampling design lack design consistency when the sampling mechanism is complex and may be severely biased under informative designs. Existing procedures that account for the survey weights under…

Methodology · Statistics 2026-03-12 William Acero , Domingo Morales , Isabel Molina

Highly robust and efficient estimators for the generalized linear model with a dispersion parameter are proposed. The estimators are based on three steps. In the first step the maximum rank correlation estimator is used to consistently…

Methodology · Statistics 2017-03-29 Michael Amiguet , Alfio Marazzi , Marina Valdora , Victor Yohai

In this paper, a new bivariate random coefficient integer-valued autoregressive process based on modified negative binomial operator with dependent innovations is proposed. Basic probabilistic and statistical properties of this model are…

Statistics Theory · Mathematics 2024-04-30 Yixuan Fan , Dehui Wang

Large Language Models (LLMs) are widely used to evaluate natural language generation tasks as automated metrics. However, the likelihood, a measure of LLM's plausibility for a sentence, can vary due to superficial differences in sentences,…

Computation and Language · Computer Science 2025-11-11 Masanari Oi , Masahiro Kaneko , Ryuto Koike , Mengsay Loem , Naoaki Okazaki

Finite sample properties of multiple imputation estimators under the linear regression model are studied. The exact bias of the multiple imputation variance estimator is presented. A method of reducing the bias is presented and simulation…

Statistics Theory · Mathematics 2007-06-13 Jae Kwang Kim

For the univariate current status and, more generally, the interval censoring model, distribution theory has been developed for the maximum likelihood estimator (MLE) and smoothed maximum likelihood estimator (SMLE) of the unknown…

Statistics Theory · Mathematics 2013-06-18 Piet Groeneboom