English
Related papers

Related papers: The Power of Tests for Detecting $p$-Hacking

200 papers

The customary use of P-values in scientific research has been attacked as being ill-conceived, and the utility of P-values has been derided. This paper reviews common misconceptions about P-values and their alleged deficits as indices of…

Methodology · Statistics 2013-11-04 Michael J. Lew

We examine the extent to which random samplings from the values of a random set, determine the distribution of the random set itself. We also comment on how, given the statistics of the sampling, to detect the distribution. Several methods…

Probability · Mathematics 2022-06-01 Zvi Artstein , Alon Shapira

$P$-values that are derived from continuously distributed test statistics are typically uniformly distributed on $(0,1)$ under least favorable parameter configurations (LFCs) in the null hypothesis. Conservativeness of a $p$-value $P$…

Methodology · Statistics 2023-03-13 Daniel Ochieng , Anh-Tuan Hoang , Thorsten Dickhaus

It appeared recently that the underlying degree distribution of networks may play a crucial role concerning their robustness. Empiric and analytic results have been obtained, based on asymptotic and mean-field approximations. Previous work…

Statistical Mechanics · Physics 2009-08-24 Clemence Magnien , Matthieu Latapy , Jean-Loup Guillaume

Password guessers are instrumental for assessing the strength of passwords. Despite their diversity and abundance, little is known about how different guessers compare to each other. We perform in-depth analyses and comparisons of the…

Cryptography and Security · Computer Science 2021-02-23 Zach Parish , Connor Cushing , Shourya Aggarwal , Amirali Salehi-Abari , Julie Thorpe

As network security issues continue gaining prominence, password security has become crucial in safeguarding personal information and network systems. This study first introduces various methods for system password cracking, outlines…

Cryptography and Security · Computer Science 2026-02-11 Jiazhi Mo , Hailu Kuang , Xiaoqi Li

Increased availability of data and accessibility of computational tools in recent years have created unprecedented opportunities for scientific research driven by statistical analysis. Inherent limitations of statistics impose constrains on…

Genomics · Quantitative Biology 2016-09-13 Olga A. Vsevolozhskaya , Gabriel Ruiz , Dmitri V. Zaykin

Penetration Testing is a methodology for assessing network security, by generating and executing possible attacks. Doing so automatically allows for regular and systematic testing without a prohibitive amount of human labor. A key question…

Artificial Intelligence · Computer Science 2013-06-21 Carlos Sarraute , Olivier Buffet , Joerg Hoffmann

Encryption study basically deals with three levels of algorithms. The first algorithm deals with encryption mechanism, second deals with decryption Mechanism and the third discusses about the generation of keys and sub keys used in the…

Networking and Internet Architecture · Computer Science 2010-07-05 Addepalli V. N Krishna , A Vinay Babu

We propose a method for comparing survival data based on the higher criticism of p-values obtained from multiple exact hypergeometric tests. The method accommodates non-informative right-censorship and is sensitive to hazard differences in…

Statistics Theory · Mathematics 2025-10-28 Alon Kipnis , Ben Galili , Zohar Yakhini

The problem of large-scale simultaneous hypothesis testing is re-visited. Bagging and subagging procedures are put forth with the purpose of improving the discovery power of the tests. The procedures are implemented in both simulated and…

Methodology · Statistics 2007-05-23 Dimitris N. Politis

With the rapid advancement of information technology, the complexity of applications continues to increase, and the cybersecurity challenges we face are also escalating. This paper aims to investigate the methods and practices of system…

Cryptography and Security · Computer Science 2026-02-02 Chunyi Zhang , Jin Zeng , Xiaoqi Li

Leaks from password datasets are a regular occurrence. An organization may defend a leak with reassurances that just a small subset of passwords were taken. In this paper we show that the leak of a relatively small number of text-based…

Cryptography and Security · Computer Science 2021-03-29 Hazel Murray , David Malone

In a case-control study aimed at localizing disease variants, association between a marker and the disease status is often tested by comparing the marker allele frequencies among cases and controls. These marker allele frequencies are…

Methodology · Statistics 2015-09-22 M. A. Jonker , M. W. T. Tanck

Much of science is (rightly or wrongly) driven by hypothesis testing. Even in situations where the hypothesis testing paradigm is correct, the common practice of basing inferences solely on p-values has been under intense criticism for over…

Methodology · Statistics 2015-12-31 M. J. Bayarri , Daniel J. Benjamin , James O. Berger , Thomas M. Sellke

Power-law distributions occur in many situations of scientific interest and have significant consequences for our understanding of natural and man-made phenomena. Unfortunately, the detection and characterization of power laws is…

Data Analysis, Statistics and Probability · Physics 2009-11-12 Aaron Clauset , Cosma Rohilla Shalizi , M. E. J. Newman

In many fields of research null hypothesis significance tests and p values are the accepted way of assessing the degree of certainty with which research results can be extrapolated beyond the sample studied. However, there are very serious…

Methodology · Statistics 2020-01-14 Michael Wood

We show that adding noise before publishing data effectively screens $p$-hacked findings: spurious explanations produced by fitting many statistical models (data mining). Noise creates "baits" that affect two types of researchers…

Theoretical Economics · Economics 2024-05-21 Federico Echenique , Kevin He

Comparing two population means of network data is of paramount importance in a wide range of scientific applications. Many existing network inference solutions focus on global testing of entire networks, without comparing individual network…

Methodology · Statistics 2019-10-10 Yin Xia , Lexin Li

We discuss systematically two versions of confidence regions: those based on p-values and those based on e-values, a recent alternative to p-values. Both versions can be applied to multiple hypothesis testing, and in this paper we are…

Statistics Theory · Mathematics 2024-03-05 Vladimir Vovk , Ruodu Wang