English
Related papers

Related papers: Choosing Between Methods of Combining p-values

200 papers

In contrast to its common definition and calculation, interpretation of p-values diverges among statisticians. Since p-value is the basis of various methodologies, this divergence has led to a variety of test methodologies and evaluations…

Methodology · Statistics 2012-12-27 Tomokazu Konishi

Deciding whether a model provides a good description of data is often based on a goodness-of-fit criterion summarized by a p-value. Although there is considerable confusion concerning the meaning of p-values, leading to their misuse, they…

Data Analysis, Statistics and Probability · Physics 2013-05-29 Frederik Beaujean , Allen Caldwell , Daniel Kollar , Kevin Kroeninger

Combining dependent p-values poses a long-standing challenge in statistical inference, particularly when aggregating findings from multiple methods to enhance signal detection. Recently, p-value combination tests based on regularly…

Methodology · Statistics 2025-04-22 Lin Gui , Yuchao Jiang , Jingshu Wang

Selecting the best classifier among the available ones is a difficult task, especially when only instances of one class exist. In this work we examine the notion of combining one-class classifiers as an alternative for selecting the best…

Machine Learning · Computer Science 2013-07-23 Eitan Menahem , Lior Rokach , Yuval Elovici

The mid-p-value is a proposed improvement on the ordinary p-value for the case where the test statistic is partially or completely discrete. In this case, the ordinary p-value is conservative, meaning that its null distribution is larger…

Statistics Theory · Mathematics 2017-06-02 Patrick Rubin-Delanchy , Nicholas A. Heard , Daniel John Lawson

Combining p-values to integrate multiple effects is of long-standing interest in social science and biomedical research. In this paper, we focus on revisiting a classical scenario closely related to meta-analysis, which combines a…

Methodology · Statistics 2022-04-15 Yusi Fang , Chung Chang , George Tseng

Statistical significance of both the original and the replication study is a commonly used criterion to assess replication attempts, also known as the two-trials rule in drug development. However, replication studies are sometimes conducted…

Applications · Statistics 2024-05-31 Leonhard Held , Samuel Pawel , Charlotte Micheloud

Motivation: Combining the results of different experiments to exhibit complex patterns or to improve statistical power is a typical aim of data integration. The starting point of the statistical analysis often comes as sets of p-values…

Methodology · Statistics 2021-12-02 Tristan Mary-Huard , Sarmistha Das , Indranil Mukhopadhyay , Stéphane Robin

Bayesian hypothesis testing via Bayes factors offers a principled alternative to classical p-value methods in meta-analysis, particularly suited to its cumulative and sequential nature. Unlike commonly reported p-values for standard null…

Methodology · Statistics 2026-04-22 Joris Mulder , Robbie C. M. van Aert

A common approach to evaluating the significance of a collection of $p$-values combines them with a pooling function, in particular when the original data are not available. These pooled $p$-values convert a sample of $p$-values into a…

Methodology · Statistics 2023-11-15 Chris Salahub , Wayne Oldford

Combining individual p-values to aggregate multiple small effects has a long-standing interest in statistics, dating back to the classic Fisher's combination test. In modern large-scale data analysis, correlation and sparsity are common…

Methodology · Statistics 2018-11-30 Yaowu Liu , Jun Xie

Meta-analysis can be formulated as combining $p$-values across studies into a joint $p$-value function, from which point estimates and confidence intervals can be derived. We extend the meta-analytic estimation framework based on combined…

Methodology · Statistics 2025-10-21 David Kronthaler , Leonhard Held

The customary use of P-values in scientific research has been attacked as being ill-conceived, and the utility of P-values has been derided. This paper reviews common misconceptions about P-values and their alleged deficits as indices of…

Methodology · Statistics 2013-11-04 Michael J. Lew

This paper revisits a meta-analysis method proposed by Pearson [Biometrika 26 (1934) 425--442] and first used by David [Biometrika 26 (1934) 1--11]. It was thought to be inadmissible for over fifty years, dating back to a paper of Birnbaum…

Statistics Theory · Mathematics 2009-11-19 Art B. Owen

Recently, importance of meta-analysis is increasing in the field of dentistry, since it is not easy to settle controversies arising from conflicting studies. Meta-analysis is the statistical method of combining results from two or more…

Methodology · Statistics 2025-02-25 Hoi-Jeong Lim

Software packages usually report the results of statistical tests using p-values. Users often interpret these by comparing them to standard thresholds, e.g. 0.1%, 1% and 5%, which is sometimes reinforced by a star rating (***, **, *). We…

Methodology · Statistics 2019-11-05 Axel Gandy , Georg Hahn , Dong Ding

We investigate the multiplicity model with m values of some test statistic independently drawn from a mixture of no effect (null) and positive effect (alternative), where we seek to identify, the alternative test results with a controlled…

Methodology · Statistics 2024-02-06 Zhiwen Jiang , Stephan Morgenthaler

The most popular multiple testing procedures are stepwise procedures based on $P$-values for individual test statistics. Included among these are the false discovery rate (FDR) controlling procedures of Benjamini--Hochberg [J. Roy. Statist.…

Statistics Theory · Mathematics 2009-06-18 Arthur Cohen , Harold B. Sackrowitz , Minya Xu

We consider the problem of meta-analyzing two-group studies that report the median of the outcome. Often, these studies are excluded from meta-analysis because there are no well-established statistical methods to pool the difference of…

Methodology · Statistics 2022-06-22 Sean McGrath , Hojoon Sohn , Russell Steele , Andrea Benedetti

In the field of multiple hypothesis testing, combining p-values represents a fundamental statistical method. The Cauchy combination test (CCT) (Liu and Xie, 2020) excels among numerous methods for combining p-values with powerful and…

Methodology · Statistics 2024-10-17 Yanyan Ouyang , Xingwei Liu , Lixing Zhu , Wangli Xu