English
Related papers

Related papers: New confidence interval methods for Shannon index

200 papers

We consider clinical trials in which an experimental treatment is compared with a control in pre-specified patient subpopulations. In such settings, adaptive enrichment designs allow the enrolled population to be modified at an interim…

Methodology · Statistics 2026-03-17 Enyu Li , Nigel Stallard , Ekkehard Glimm , Dominic Magirr , Peter K. Kimani

This study investigates entropy's potential for analyzing scientific research patterns across disciplines. Originating from thermodynamics, entropy now measures uncertainty and diversity in information systems. We examine Shannon Entropy,…

Physics and Society · Physics 2025-03-27 Yujie Shi , Alex Jie Yang , Sanhong Deng

In this paper we present a technique for using the bootstrap to estimate the operating characteristics and their variability for certain types of ensemble methods. Bootstrapping a model can require a huge amount of work if the training data…

Machine Learning · Statistics 2017-10-26 Anthony Gamst , Jay-Calvin Reyes , Alden Walker

The use of longitudinal finite mixture models such as group-based trajectory modeling has seen a sharp increase during the last decades in the medical literature. However, these methods have been criticized especially because of the…

Methodology · Statistics 2022-05-17 Miceline Mésidor , Caroline Sirois , Marc Simard , Denis Talbot

Modern problems in statistics tend to include estimators of high computational complexity and with complicated distributions. Statistical inference on such estimators usually relies on asymptotic normality assumptions, however, such…

Methodology · Statistics 2016-12-08 Eyal Fisher , Regev Schweiger , Saharon Rosset

For discrete-valued time series, predictive inference cannot be implemented through the construction of prediction intervals to some predetermined coverage level, as this is the case for real-valued time series. To address this problem, we…

Methodology · Statistics 2025-07-23 Maxime Faymonville , Carsten Jentsch , Efstathios Paparoditis

Entropy estimation plays a significant role in biology, economics, physics, communication engineering and other disciplines. It is increasingly used in software engineering, e.g. in software confidentiality, software testing, predictive…

Information Theory · Computer Science 2025-01-22 Ilaria Pia la Torre , David A. Kelly , Hector D. Menendez , David Clark

Bootstrap smoothed (bagged) estimators have been proposed as an improvement on estimators found after preliminary data-based model selection. Efron, 2014, derived a widely applicable formula for a delta method approximation to the standard…

Methodology · Statistics 2019-07-11 Paul Kabaila , Christeen Wijethunga

Inference methods for computing confidence intervals in parametric settings usually rely on consistent estimators of the parameter of interest. However, it may be computationally and/or analytically burdensome to obtain such estimators in…

Methodology · Statistics 2024-09-20 Samuel Orso , Mucyo Karemera , Maria-Pia Victoria-Feser , Stéphane Guerrier

The asymptotic behaviour of the commonly used bootstrap percentile confidence interval is investigated when the parameters are subject to linear inequality constraints. We concentrate on the important one- and two-sample problems with data…

Statistics Theory · Mathematics 2022-12-06 Chunlin Wang , Paul Marriott , Pengfei Li

Bootstrap smoothed (bagged) parameter estimators have been proposed as an improvement on estimators found after preliminary data-based model selection. The key result of Efron (2014) is a very convenient and widely applicable formula for a…

Methodology · Statistics 2019-04-29 Paul Kabaila , Christeen Wijethunga

The assessment of diversity and similarity is relevant in monitoring the status of ecosystems. The respective indicators are based on the taxonomic composition of biological communities of interest, currently estimated through the…

Applications · Statistics 2018-10-12 Fabio Divino , Johanna Ärje , Antti Penttinen , Kristian Meissner , Salme Kärkkäinen

We consider the performance of the bootstrap in high-dimensions for the setting of linear regression, where $p<n$ but $p/n$ is not close to zero. We consider ordinary least-squares as well as robust regression methods and adopt a minimalist…

Methodology · Statistics 2016-08-03 Noureddine El Karoui , Elizabeth Purdom

This paper investigates the effects of smoothed bootstrap iterations on coverage probabilities of smoothed bootstrap and bootstrap-t confidence intervals for population quantiles, and establishes the optimal kernel bandwidths at various…

Statistics Theory · Mathematics 2007-06-13 Yvonne H. S. Ho , Stephen M. S. Lee

Respondent-Driven Sampling (RDS) is a form of link-tracing sampling, a sampling technique used for `hard-to-reach' populations that aims to leverage individuals' social relationships to reach potential participants. While the methodological…

Many online experiments exhibit dependence between users and items. For example, in online advertising, observations that have a user or an ad in common are likely to be associated. Because of this, even in experiments involving millions of…

Methodology · Statistics 2017-10-26 Eytan Bakshy , Dean Eckles

It is common to show the confidence intervals or $p$-values of selected features, or predictor variables in regression, but they often involve selection bias. The selective inference approach solves this bias by conditioning on the…

Methodology · Statistics 2022-06-02 Yoshikazu Terada , Hidetoshi Shimodaira

In recent years there has been significant progress in algorithms and methods for inducing Bayesian networks from data. However, in complex data analysis problems, we need to go beyond being satisfied with inducing networks with high…

Machine Learning · Computer Science 2013-01-30 Nir Friedman , Moises Goldszmidt , Abraham Wyner

The bootstrap, based on resampling, has, for several decades, been a widely used method for computing confidence intervals for applications where no exact method is available and when sample sizes are not large enough to be able to rely on…

Applications · Statistics 2018-08-27 Chris Gotwalt , Li Xu , Yili Hong , William Q. Meeker

Propensity score (PS) methods are widely used to estimate treatment effects in non-randomized studies. Variance is typically estimated using sandwich or bootstrap methods, which can either treat the PS as estimated or fixed. The latter is…

Methodology · Statistics 2025-11-17 Baoshan Zhang , Sean M. O'Brien , Yuan Wu , Laine E. Thomas