中文
相关论文

相关论文: Estimation of differential entropy for normal popu…

200 篇论文

Estimating the entropy of a discrete random variable is a fundamental problem in information theory and related fields. This problem has many applications in various domains, including machine learning, statistics and data compression. Over…

信息论 · 计算机科学 2020-12-22 Yuval Shalev , Amichai Painsky , Irad Ben-Gal

Estimation of permutation entropy (PE) using Bayesian statistical methods is presented for systems where the ordinal pattern sampling follows an independent, multinomial distribution. It is demonstrated that the PE posterior distribution is…

数据分析、统计与概率 · 物理学 2022-02-09 Douglas J. Little , Joshua P. Toomey , Deb M. Kane

We study adaptive estimation and inference in ill-posed linear inverse problems defined by conditional moment restrictions. Existing regularized estimators such as Regularized DeepIV (RDIV) require prior knowledge of the smoothness of the…

机器学习 · 统计学 2026-03-03 Jiyuan Tan , Vasilis Syrgkanis

Prediction intervals are a machine- and human-interpretable way to represent predictive uncertainty in a regression analysis. In this paper, we present a method for generating prediction intervals along with point estimates from an ensemble…

机器学习 · 统计学 2020-07-21 Tárik S. Salem , Helge Langseth , Heri Ramampiaro

Our investigation concerns the estimation of predictive densities and a study of efficiency as measured by the frequentist risk of such predictive densities with integrated $L_2$ and $L_1$ losses. Our findings relate to a $p-$variate…

统计理论 · 数学 2014-08-25 Tatsuya Kubokawa , Éric Marchand , William E. Strawderman

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

机器学习 · 统计学 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

We propose a general approach to construct weighted likelihood estimating equations with the aim of obtaining robust parameter estimates. We modify the standard likelihood equations by incorporating a weight that reflects the statistical…

Estimators derived from a divergence criterion such as $\varphi-$divergences are generally more robust than the maximum likelihood ones. We are interested in particular in the so-called MD$\varphi$DE, an estimator built using a dual…

统计计算 · 统计学 2016-06-14 Diaa Al Mohamad , Michel Broniatowski

The problem of monotone missing data has been broadly studied during the last two decades and has many applications in different fields such as bioinformatics or statistics. Commonly used imputation techniques require multiple iterations…

机器学习 · 计算机科学 2020-09-25 Thu Nguyen , Duy H. M. Nguyen , Huy Nguyen , Binh T. Nguyen , Bruce A. Wade

This study investigates component wise estimation of ordered variances of scale mixture of two normal distributions. For this study two special loss functions are considered namely squared error loss function and entropy loss function. We…

统计理论 · 数学 2026-01-28 Shrajal Bajpai , Lakshmi Kanta Patra

The purpose of this paper is to provide guidelines for empirical researchers who use a class of bivariate threshold crossing models with dummy endogenous variables. A common practice employed by the researchers is the specification of the…

计量经济学 · 经济学 2019-03-06 Sukjin Han , Sungwon Lee

Interval-censored multi-state data arise in many studies of chronic diseases, where the health status of a subject can be characterized by a finite number of disease states and the transition between any two states is only known to occur…

统计方法学 · 统计学 2022-09-19 Yu Gu , Donglin Zeng , Gerardo Heiss , D. Y. Lin

We consider the problem of estimating functionals of discrete distributions, and focus on tight nonasymptotic analysis of the worst case squared error risk of widely used estimators. We apply concentration inequalities to analyze the random…

信息论 · 计算机科学 2017-08-11 Jiantao Jiao , Kartik Venkat , Yanjun Han , Tsachy Weissman

In fitting a mixture of linear regression models, normal assumption is traditionally used to model the error and then regression parameters are estimated by the maximum likelihood estimators (MLE). This procedure is not valid if the normal…

统计方法学 · 统计学 2018-11-06 Yanyuan Ma , Shaoli Wang , Lin Xu , Weixin Yao

One of the most common methods for statistical inference is the maximum likelihood estimator (MLE). The MLE needs to compute the normalization constant in statistical models, and it is often intractable. Using unnormalized statistical…

统计理论 · 数学 2016-04-26 Takafumi Kanamori , Takashi Takenouchi

Walley's Imprecise Dirichlet Model (IDM) for categorical data overcomes several fundamental problems which other approaches to uncertainty suffer from. Yet, to be useful in practice, one needs efficient ways for computing the…

概率论 · 数学 2007-07-16 Marcus Hutter

The missing data problem has been broadly studied in the last few decades and has various applications in different areas such as statistics or bioinformatics. Even though many methods have been developed to tackle this challenge, most of…

We propose a novel targeted maximum likelihood estimator (TMLE) for quantiles in semiparametric missing data models. Our proposed estimator is locally efficient, $\sqrt{n}$-consistent, asymptotically normal, and doubly robust, under…

统计方法学 · 统计学 2016-08-23 Iván Díaz

In a wireless sensor network, multilevel quantization is necessary in order to find a compromise between the smallest possible power consumption of the sensors and the detection performance at the fusion center (FC). The general methodology…

信号处理 · 电气工程与系统科学 2021-05-26 Muath A. Wahdan , Mustafa A. Altınkaya

Deep Ensembles, as a type of Bayesian Neural Networks, can be used to estimate uncertainty on the prediction of multiple neural networks by collecting votes from each network and computing the difference in those predictions. In this paper,…

机器学习 · 计算机科学 2023-07-10 Illia Oleksiienko , Alexandros Iosifidis