English
Related papers

Related papers: Testing Exponentiality Based on R\'enyi Entropy Wi…

200 papers

In this article, the weighted empirical likelihood is applied to a general setting of two-sample semiparametric models, which includes biased sampling models and case-control logistic regression models as special cases. For various types of…

Statistics Theory · Mathematics 2008-12-18 Jian-Jian Ren

Reinforcement learning can learn amortised design policies for designing sequences of experiments. However, current amortised methods rely on estimators of expected information gain (EIG) that require an exponential number of samples on the…

Machine Learning · Computer Science 2024-02-06 Tom Blau , Iadine Chades , Amir Dezfouli , Daniel Steinberg , Edwin V. Bonilla

The aim of this work is to provide bounds connecting two probability measures of the same event using R\'enyi $\alpha$-Divergences and Sibson's $\alpha$-Mutual Information, a generalization of respectively the Kullback-Leibler Divergence…

Information Theory · Computer Science 2020-01-20 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

Estimating information-theoretic quantities such as entropy and mutual information is central to many problems in statistics and machine learning, but challenging in high dimensions. This paper presents estimators of entropy via inference…

Machine Learning · Statistics 2022-12-13 Feras A. Saad , Marco Cusumano-Towner , Vikash K. Mansinghka

A framework for deriving R\'enyi entropy-power inequalities (EPIs) is presented that uses linearization and an inequality of Dembo, Cover, and Thomas. Simple arguments are given to recover the previously known R\'enyi EPIs and derive new…

Information Theory · Computer Science 2020-04-08 Olivier Rioul

Existing sequential generalized estimating equation methodology for longitudinal and group-correlated data focuses on narrow hypotheses concerning treatment efficacy and often makes modeling assumptions that impede the desirable robustness…

Methodology · Statistics 2026-03-16 Nathan T. Provost , Abdus S. Wahed

The equivalence between non-extensive C. Tsallis entropy and the extensive entropy introduced by Alfr\'ed R\'enyi is discussed. The R\'enyi entropy is studied from the perspective of the geometry of the Lebesgue and generalised, exotic…

Data Analysis, Statistics and Probability · Physics 2014-02-25 Giorgio Sonnino , György Steinbrecher , Alberto Sonnino

Robust classification algorithms have been developed in recent years with great success. We take advantage of this development and recast the classical two-sample test problem in the framework of classification. Based on the estimates of…

Statistics Theory · Mathematics 2019-09-18 Haiyan Cai , Bryan Goggin , Qingtang Jiang

We consider a family of prior probability distributions of particular interest, all being defined on the three-dimensional convex set of two-level quantum systems. Each distribution is, following recent work of Petz and Sudar, taken to be…

Quantum Physics · Physics 2009-10-30 Paul B. Slater

We suggest several goodness-of-fit methods which are appropriate with Type-II right censored data. Our strategy is to transform the original observations from a censored sample into an approximately i.i.d. sample of normal variates and then…

Methodology · Statistics 2013-12-12 Christian Goldmann , Bernhard Klar , Simos G. Meintanis

Many products in engineering are highly reliable with large mean lifetimes to failure. Performing lifetests under normal operations conditions would thus require long experimentation times and high experimentation costs. Alternatively,…

Methodology · Statistics 2024-02-12 Narayanaswamy Balakrishnan , María Jaenada , Leandro Pardo

In causal inference, estimating the average treatment effect is a central objective, and in the context of competing risks data, this effect can be quantified by the cause-specific cumulative incidence function (CIF) difference. While…

Methodology · Statistics 2026-03-27 Yifei Tian , Ying Wu

We consider kernel smoothed Grenander-type estimators for a monotone hazard rate and a monotone density in the presence of randomly right censored data. We show that they converge at rate $n^{2/5}$ and that the limit distribution at a fixed…

Statistics Theory · Mathematics 2018-05-18 Hendrik P. Lopuhaä , Eni Musta

We consider the task of estimating a conditional density using i.i.d. samples from a joint distribution, which is a fundamental problem with applications in both classification and uncertainty quantification for regression. For joint…

Statistics Theory · Mathematics 2023-06-16 Blair Bilodeau , Dylan J. Foster , Daniel M. Roy

Since the two seminal papers by Fisher (1915, 1921) were published, the test under a fixed value correlation coefficient null hypothesis for the bivariate normal distribution constitutes an important statistical problem. In the framework of…

Statistics Theory · Mathematics 2022-09-27 María Jaenada , Elena Castilla , Nirian Martín , Leandro Pardo

We develop a unified approach for classification and regression support vector machines for data subject to right censoring. We provide finite sample bounds on the generalization error of the algorithm, prove risk consistency for a wide…

Machine Learning · Statistics 2013-01-15 Yair Goldberg , Michael R. Kosorok

We revisit entropic formulations of the uncertainty principle for an arbitrary pair of positive operator-valued measures (POVM) $A$ and $B$, acting on finite dimensional Hilbert space. Salicr\'u generalized $(h,\phi)$-entropies, including…

Quantum Physics · Physics 2015-06-18 S. Zozor , G. M. Bosyk , M. Portesi

The phenomenon of entropy concentration provides strong support for the maximum entropy method, MaxEnt, for inferring a probability vector from information in the form of constraints. Here we extend this phenomenon, in a discrete setting,…

Information Theory · Computer Science 2021-01-11 Kostas N. Oikonomou

The information content of the two-particle one- and two-dimensional Calogero model is studied using the von Neumann and R\'enyi entropies. The one-dimensional model is shown to have non-monotonic entropies with finite values in the large…

Quantum Physics · Physics 2016-10-26 Mariano Garagiola , Eloisa Cuestas , Federico M. Pont , Pablo Serra , Omar Osenda

Two-sample tests with censored outcomes are a classical topic in statistics with wide use even in cutting edge applications. There are at least two modes of inference used to justify two-sample tests. One is usual superpopulation inference…

Statistics Theory · Mathematics 2022-10-06 Xinran Li , Dylan S. Small
‹ Prev 1 8 9 10 Next ›