English
Related papers

Related papers: Two New Entropy Estimators for Testing Exponential…

200 papers

Lomax distribution has been widely used in economics, business and actuarial sciences. Due to its importance, we consider the statistical inference of this model under joint type-II censoring scenario. In order to estimate the parameters,…

Statistics Theory · Mathematics 2019-12-06 Yasin Asar , R. Arabi Belaghi

Estimating information-theoretic quantities such as entropy and mutual information is central to many problems in statistics and machine learning, but challenging in high dimensions. This paper presents estimators of entropy via inference…

Machine Learning · Statistics 2022-12-13 Feras A. Saad , Marco Cusumano-Towner , Vikash K. Mansinghka

In this paper, a competing risks model is analyzed based on improved adaptive type-II progressive censored sample (IAT-II PCS). Two independent competing causes of failures are considered. It is assumed that lifetimes of the competing…

Methodology · Statistics 2023-02-20 Subhankar Dutta , Suchandan Kayal

The problem of estimation of density functionals like entropy and mutual information has received much attention in the statistics and information theory communities. A large class of estimators of functionals of the probability density…

Statistics Theory · Mathematics 2013-03-05 Kumar Sricharan , Dennis Wei , Alfred O. Hero

We propose a new approach for estimating the parameters of a probability distribution. It consists on combining two new methods of estimation. The first is based on the definition of a new distance measuring the difference between…

Methodology · Statistics 2008-12-30 Ahmed Guellil , Tewfik Kernane

Entropy is a measure of self-information which is used to quantify losses. Entropy was developed in thermodynamics, but is also used to compare probabilities based on their deviating information content. Corresponding model uncertainty is…

Probability · Mathematics 2018-01-23 Alois Pichler , Ruben Schlotter

This paper extends doubly robust censoring unbiased transformations to a broad class of censored data structures under the assumption of coarsening at random and positivity. This includes the classic survival and competing risks setting,…

Methodology · Statistics 2024-11-08 Oliver Lunding Sandqvist

We propose a number of concepts and properties related to `weighted' statistical inference where the observed data are classified in accordance with a `value' of a sample string. The motivation comes from the concepts of weighted…

Statistics Theory · Mathematics 2024-07-31 Mark Kelbert , Yuri Suhov

Two-step estimators often called upon to fit censored regression models in many areas of science and engineering. Since censoring incurs a bias in the naive least-squares fit, a two-step estimator first estimates the bias and then fits a…

Methodology · Statistics 2014-03-17 Yuekai Sun , Jonathan E. Taylor

We present simple and computationally efficient nonparametric estimators of R\'enyi entropy and mutual information based on an i.i.d. sample drawn from an unknown, absolutely continuous distribution over $\R^d$. The estimators are…

Machine Learning · Statistics 2010-10-27 Dávid Pál , Barnabás Póczos , Csaba Szepesvári

The present manuscript is concerned with component-wise estimation of the positive power of ordered restricted standard deviation of two normal populations with certain restrictions on the means. We propose several improved estimators under…

Statistics Theory · Mathematics 2025-08-26 Somnath Mondal , Lakshmi Kanta Patra

We investigate the estimation of the extreme value index when the data are subject to random censorship. We prove, in a unified way, detailed asymptotic normality results for various estimators of the extreme value index and use these…

Statistics Theory · Mathematics 2008-12-18 John H. J. Einmahl , Amélie Fils-Villetard , Armelle Guillou

Partly motivated by entropy-estimation problems in neuroscience, we present a detailed and extensive comparison between some of the most popular and effective entropy estimation methods used in practice: The plug-in method, four different…

Information Theory · Computer Science 2015-05-13 Y. Gao , I. Kontoyiannis , E. Bienenstock

We establish a general connection between entropic uncertainty relations, Einstein-Podolsky-Rosen steering, and joint measurability. Specifically, we construct steering inequalities from any entropic uncertainty relation, given that the…

Quantum Physics · Physics 2018-12-20 Tamás Kriváchy , Florian Fröwis , Nicolas Brunner

We compute R\'enyi entropies for the statistics of a noisy simultaneous observation of two complementary observables in two-dimensional quantum systems. The relative amount of uncertainty between two states depends on the uncertainty…

Quantum Physics · Physics 2015-11-17 Alfredo Luis , Gustavo Martín Bosyk , Mariela Portesi

The achievable error-exponent pairs for the type I and type II errors are characterized in a hypothesis testing setup where the observation consists of independent and identically distributed samples from either a known joint probability…

Information Theory · Computer Science 2018-09-19 Amos Lapidoth , Christoph Pfister

The known constructions of negligible error (non-malleable) two-source extractors can be broadly classified in three categories: (1) Constructions where one source has min-entropy rate about $1/2$, the other source can have small…

Information Theory · Computer Science 2023-06-13 Divesh Aggarwal , Eldon Chung , Maciej Obremski

The doubly robust (DR) estimator, which consists of two nuisance parameters, the conditional mean outcome and the logging policy (the probability of choosing an action), is crucial in causal inference. This paper proposes a DR estimator for…

Machine Learning · Computer Science 2021-06-22 Masahiro Kato , Shota Yasui , Kenichiro McAlinn

This paper introduces two new robust methods for estimation of parameters in a given parametric family. The first method is that of `minimum weighted L2', effectively minimising an estimate of the integrated (and possibly weighted) squared…

Methodology · Statistics 2026-02-23 Nils Lid Hjort

We study the problem of mismatched likelihood ratio test. We analyze the type-\RNum{1} and \RNum{2} error exponents when the actual distributions generating the observation are different from the distributions used in the test. We derive…

Information Theory · Computer Science 2020-01-14 Parham Boroumand , Albert Guillen i Fabregas