English
Related papers

Related papers: A Bayesian Nonparametric Estimation to Entropy

200 papers

We consider the problem of frequency estimation by observations of the periodic diffusion process possesing ergodic properties in two different situations. The first one corresponds to continuously differentiable with respect to parameter…

Statistics Theory · Mathematics 2020-03-30 Reinhard Höpfner , Yury A Kutoyants

Despite the risk of misspecification they are tied to, parametric models continue to be used in statistical practice because they are accessible to all. In particular, efficient estimation procedures in parametric models are simple to…

Statistics Theory · Mathematics 2016-09-01 Marco Carone , Alexander R. Luedtke , Mark J. van der Laan

We introduce a new concept of approximation applicable to decision problems and functions, inspired by Bayesian probability. From the perspective of a Bayesian reasoner with limited computational resources, the answer to a problem that…

Computational Complexity · Computer Science 2025-06-27 Vanessa Kosoy , Alexander Appel

Nonparametric methods for the estimation of the Levy density of a Levy process are developed. Estimators that can be written in terms of the ``jumps'' of the process are introduced, and so are discrete-data based approximations. A model…

Statistics Theory · Mathematics 2007-06-13 Enrique Figueroa-Lopez , Christian Houdre

We investigate the information extractable from measurement distributions of two non-commuting spin observables in a multi-well spin-1 Bose-Einstein condensate. We provide a variety of analytic and numerical evidence that suitably chosen…

In this paper we have adapted Bahl and Tuteja (1991) estimator in systematic sampling using auxiliary information. Using Bedi (1996) transformation an improved estimator is also proposed under systematic sampling. The expressions of bias…

Applications · Statistics 2013-07-22 Rajesh Singh , Sachin Malik , Viplav K. Singh

In this paper we introduce two Bayesian estimators for learning the parameters of the Gamma distribution. The first algorithm uses a well known unnormalized conjugate prior for the Gamma shape and the second one uses a non-linear…

Methodology · Statistics 2016-07-13 A. Llera , C. F. Beckmann

The excess entropy of restricted primitive model electrolytes is calculated using a potential based approach through the symmetric Poisson-Boltzmann and the modified Poisson-Boltzmann theories. The theories are utilized in conjunction with…

Statistical Mechanics · Physics 2025-04-01 S. Lamperski , L. B. Bhuiyan , C. W. Outhwaite , R. Gorniak

We reconsider a nonparametric density model based on Gaussian processes. By augmenting the model with latent P\'olya--Gamma random variables and a latent marked Poisson process we obtain a new likelihood which is conjugate to the model's…

Machine Learning · Statistics 2018-05-30 Christian Donner , Manfred Opper

This paper proposes a new probabilistic non-extensive entropy feature for texture characterization, based on a Gaussian information measure. The highlights of the new entropy are that it is bounded by finite limits and that it is non…

Computer Vision and Pattern Recognition · Computer Science 2016-03-09 Seba Susan , Madasu Hanmandlu

The coincidence method of measuring the entropy of a system, proposed some time ago by Ma, is generalized to include systems out of equilibrium. It is suggested that the method can be adapted to analyze multiparticle states produced in…

High Energy Physics - Phenomenology · Physics 2009-10-31 A. Bialas , W. Czyz

In Bayesian nonparametric inference, random discrete probability measures are commonly used as priors within hierarchical mixture models for density estimation and for inference on the clustering of the data. Recently, it has been shown…

Statistics Theory · Mathematics 2012-11-26 Stefano Favaro , Antonio Lijoi , Igor Prünster

Parametric estimation for diffusion processes is considered for high frequency observations over a fixed time interval. The processes solve stochastic differential equations with an unknown parameter in the diffusion coefficient. We find…

Methodology · Statistics 2017-04-03 Nina Munkholt Jakobsen , Michael Sørensen

This article studies the finite sample behaviour of a number of estimators for the integrated power volatility process of a Brownian semistationary process in the non semi-martingale setting. We establish three consistent feasible…

Statistics Theory · Mathematics 2021-06-18 Phillip Murray , Riccardo Passeggeri , Almut E. D. Veraart , Mikko S. Pakkanen

Determining the strength of non-linear statistical dependencies between two variables is a crucial matter in many research fields. The established measure for quantifying such relations is the mutual information. However, estimating mutual…

Data Analysis, Statistics and Probability · Physics 2019-07-24 Damián G. Hernández , Inés Samengo

Standard maximum likelihood estimation cannot be applied to discrete energy-based models in the general case because the computation of exact model probabilities is intractable. Recent research has seen the proposal of several new…

Machine Learning · Computer Science 2012-02-20 Benjamin Marlin , Nando de Freitas

Estimators of information theoretic measures such as entropy and mutual information are a basic workhorse for many downstream applications in modern data science. State of the art approaches have been either geometric (nearest neighbor (NN)…

Information Theory · Computer Science 2016-09-09 Weihao Gao , Sewoong Oh , Pramod Viswanath

Nonparametric density estimators are studied for $d$-dimensional, strongly spatial mixing data which is defined on a general $N$-dimensional lattice structure. We consider linear and nonlinear hard thresholded wavelet estimators which are…

Statistics Theory · Mathematics 2017-12-27 Johannes T. N. Krebs

We consider discrete nonparametric priors which induce Gibbs-type exchangeable random partitions and investigate their posterior behavior in detail. In particular, we deduce conditional distributions and the corresponding Bayesian…

Probability · Mathematics 2008-08-22 Antonio Lijoi , Igor Prünster , Stephen G. Walker

This article studies the asymptotic properties of Bayesian or frequentist estimators of a vector of parameters related to structural properties of sequences of graphs. The estimators studied originate from a particular class of graphex…

Statistics Theory · Mathematics 2025-02-06 Zacharie Naulet , Judith Rousseau , François Caron