English
Related papers

Related papers: Closed-form estimators for an exponential family d…

200 papers

We show that the variance of the Monte Carlo estimator that is importance sampled from an exponential family is a convex function of the natural parameter of the distribution. With this insight, we propose an adaptive importance sampling…

Methodology · Statistics 2015-01-12 Ernest K. Ryu , Stephen P. Boyd

This paper proposes a family of weighted batch means variance estimators, which are computationally efficient and can be conveniently applied in practice. The focus is on Markov chain Monte Carlo simulations and estimation of the asymptotic…

Statistics Theory · Mathematics 2018-05-23 Ying Liu , James M. Flegal

A method of calculating probability values from a system of marginal constraints is presented. Previous systems for finding the probability of a single attribute have either made an independence assumption concerning the evidence or have…

Artificial Intelligence · Computer Science 2013-04-05 J. W. Miller , R. M. Goodman

Many common probability distributions in statistics like the Gaussian, multinomial, Beta or Gamma distributions can be studied under the unified framework of exponential families. In this paper, we prove that both R\'enyi and Tsallis…

Information Theory · Computer Science 2012-02-01 Frank Nielsen , Richard Nock

We introduce an estimation method of covariance matrices in a high-dimensional setting, i.e., when the dimension of the matrix, , is larger than the sample size . Specifically, we propose an orthogonally equivariant estimator. The…

Statistics Theory · Mathematics 2020-12-04 Samprit Banerjee , Stefano Monni

We propose and investigate a new estimation method for the parameters of models consisting of smooth density functions on the positive half axis. The procedure is based on a recently introduced characterization result for the respective…

Statistics Theory · Mathematics 2021-06-16 Steffen Betsch , Bruno Ebner , Bernhard Klar

We introduce a new family of estimators for unnormalized statistical models. Our family of estimators is parameterized by two nonlinear functions and uses a single sample from an auxiliary distribution, generalizing Maximum Likelihood Monte…

Machine Learning · Computer Science 2012-03-19 Miika Pihlaja , Michael Gutmann , Aapo Hyvarinen

We develop approximate estimation methods for exponential random graph models (ERGMs), whose likelihood is proportional to an intractable normalizing constant. The usual approach approximates this constant with Monte Carlo simulations,…

Methodology · Statistics 2023-01-11 Angelo Mele , Lingjiong Zhu

We propose leave-out estimators of quadratic forms designed for the study of linear models with unrestricted heteroscedasticity. Applications include analysis of variance and tests of linear restrictions in models with many regressors. An…

Econometrics · Economics 2019-08-28 Patrick Kline , Raffaele Saggio , Mikkel Sølvsten

The links between the mean families of Lehmer and H\"older and the weighted maximum likelihood estimator have recently been established in the case of a regular univariate exponential family. In this article, we will extend the outcomes…

Statistics Theory · Mathematics 2024-05-03 Djemel Ziou , Issam Fakir

The maximum likelihood principle is widely used in statistics, and the associated estimators often display good properties. indeed maximum likelihood estimators are guaranteed to be asymptotically efficient under mild conditions. However in…

Statistics Theory · Mathematics 2016-12-01 Christophe Culan , Claude Adnet

In this study, a family of distributions called cubic lower record-based transmuted is provided. A special case of this family is proposed as an alternative exponential distribution. Several statistical properties are explored. We utilize…

Methodology · Statistics 2026-01-06 Caner Tanış

We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint…

comp-gas · Physics 2008-02-03 David H. Wolpert , David R. Wolf

A finite-support constraint on the parameter space is used to derive a lower bound on the error of an estimator of the correlation coefficient in the bivariate exponential distribution. The bound is then exploited to examine optimality of…

Methodology · Statistics 2017-02-13 W. J. Szajnowski

This note provides new closed forms evaluations of a few classes of exponential sums associated with elliptic curves and hyperelliptic curves.

Number Theory · Mathematics 2011-03-23 N. A. Carella

We describe Monte Carlo approximation to the maximum likelihood estimator in models with intractable norming constants and explanatory variables. We consider both sources of randomness (due to the initial sample and to Monte Carlo…

Methodology · Statistics 2016-12-08 Blazej Miasojedow , Wojciech Niemiro , Jan Palczewski , Wojciech Rejchel

The {\lambda}-exponential family has recently been proposed to generalize the exponential family. While the exponential family is well-understood and widely used, this it not the case of the {\lambda}-exponential family. However, many…

Statistics Theory · Mathematics 2024-06-21 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

A hybrid censoring scheme is a mixture of Type-I and Type-II censoring schemes. We study the estimation of parameters of weighted exponential distribution based on Type-II hybrid censored data. By applying EM algorithm, maximum likelihood…

Statistics Theory · Mathematics 2012-03-02 Akram Kohansal , Saeid Rezakhah

The closure of a discrete exponential family is described by a finite set of equations corresponding to the circuits of an underlying oriented matroid. These equations are similar to the equations used in algebraic statistics, although they…

Statistics Theory · Mathematics 2011-09-19 Johannes Rauh , Thomas Kahle , Nihat Ay

Models implicitly defined through a random simulator of a process have become widely used in scientific and industrial applications in recent years. However, simulation-based inference methods for such implicit models, like approximate…

Methodology · Statistics 2025-04-17 Joonha Park