English
Related papers

Related papers: Fast Approximation of Small p-values in Permutatio…

200 papers

We study sorting of permutations by random swaps if each comparison gives the wrong result with some fixed probability $p<1/2$. We use this process as prototype for the behaviour of randomized, comparison-based optimization heuristics in…

Neural and Evolutionary Computing · Computer Science 2018-03-14 Tomáš Gavenčiak , Barbara Geissmann , Johannes Lengler

This paper investigates the use of stratified sampling as a variance reduction technique for approximating integrals over large dimensional spaces. The accuracy of this method critically depends on the choice of the space partition, the…

Probability · Mathematics 2009-09-15 Pierre Etoré , Gersende Fort , Benjamin Jourdain , Eric Moulines

We consider the situation when a learner faces a set of unknown discrete distributions $(p_k)_{k\in \mathcal K}$ defined over a common alphabet $\mathcal X$, and can build for each distribution $p_k$ an individual high-probability…

Machine Learning · Statistics 2024-07-23 Odalric-Ambrym Maillard , Mohammad Sadegh Talebi

Comparing large covariance matrices has important applications in modern genomics, where scientists are often interested in understanding whether relationships (e.g., dependencies or co-regulations) among a large number of genes vary…

Methodology · Statistics 2017-04-04 Jinyuan Chang , Wen Zhou , Wen-Xin Zhou , Lan Wang

The quality of the inferences we make from pathogen sequence data is determined by the number and composition of pathogen sequences that make up the sample used to drive that inference. However, there remains limited guidance on how to best…

Populations and Evolution · Quantitative Biology 2023-06-13 Lucy D'Agostino McGowan , Shirlee Wohl , Justin Lessler

Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational efficiency. If the…

Methodology · Statistics 2021-07-06 Jun Yu , HaiYing Wang , Mingyao Ai , Huiming Zhang

Given independent samples from P and Q, two-sample permutation tests allow one to construct exact level tests when the null hypothesis is P=Q. On the other hand, when comparing or testing particular parameters $\theta$ of P and Q, such as…

Statistics Theory · Mathematics 2013-04-23 EunYi Chung , Joseph P. Romano

Presented is an inductive formula for computing the sample moments of the distribution of Pearson's sample correlation over permutation of data. These exact formulas for the sample moments suggest the possibility of more precise and…

Statistics Theory · Mathematics 2021-08-31 Marc Jaffrey , Michael Dushkoff

A common method for deriving non-parametric tests is to reformulate a parametric test in terms of sample ranks. Despite being distribution free (even in finite samples), the resulting tests often display remarkable asymptotic power…

Statistics Theory · Mathematics 2022-08-10 Dan D. Erdmann-Pham , Jonathan Terhorst , Yun S. Song

Intuitively, if a density operator has small rank, then it should be easier to estimate from experimental data, since in this case only a few eigenvectors need to be learned. We prove two complementary results that confirm this intuition.…

Quantum Physics · Physics 2012-10-18 Steven T. Flammia , David Gross , Yi-Kai Liu , Jens Eisert

The accuracy of the recombination estimation method of Padhukasahasram et al. 2006 can be improved by including additional informative summary statistics in the rejection scheme and by simulating datasets under a fixed segregating sites…

Genomics · Quantitative Biology 2012-03-27 Badri Padhukasahasram

Quantitative cancer image analysis relies on the accurate delineation of tumours, a very specialised and time-consuming task. For this reason, methods for automated segmentation of tumours in medical imaging have been extensively developed…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Saúl Alonso-Monsalve , Leigh H. Whitehead , Adam Aurisano , Lorena Escudero Sanchez

In a clinical trial, the random allocation aims to balance prognostic factors between arms, preventing true confounders. However, residual differences due to chance may introduce near-confounders. Adjusting on prognostic factors is…

Methodology · Statistics 2024-11-18 Joe de Keizer , Rémi Lenain , Raphaël Porcher , Sarah Zoha , Arthur Chatton , Yohann Foucher

Posterior predictive p-values (ppps) have become popular tools for Bayesian model assessment, being general-purpose and easy to use. However, interpretation can be difficult because their distribution is not uniform under the hypothesis…

Methodology · Statistics 2024-02-01 Sally Paganin , Perry de Valpine

Many data-fitting applications require the solution of an optimization problem involving a sum of large number of functions of high dimensional parameter. Here, we consider the problem of minimizing a sum of $n$ functions over a convex…

Optimization and Control · Mathematics 2016-02-29 Farbod Roosta-Khorasani , Michael W. Mahoney

Hypothesis tests calibrated by (re)sampling methods (such as permutation, rank and bootstrap tests) are useful tools for statistical analysis, at the computational cost of requiring Monte-Carlo sampling for calibration. It is common and…

Methodology · Statistics 2024-09-30 Ivo V. Stoepker , Rui M. Castro

One way to investigate the precision of estimates likely to result from planned experiments and planned epidemiological studies is to simulate a large number of possible outcomes and analyse the sets of possible results. This appears to be…

Computation · Statistics 2013-06-28 G. K. Robinson , L. M. Ryan

We present fastrerandomize, an R package for fast, scalable rerandomization in experimental design. Rerandomization improves precision by discarding treatment assignments that fail a prespecified covariate-balance criterion, but existing…

Computation · Statistics 2026-01-09 Rebecca Goldstein , Connor T. Jerzak , Aniket Kamat , Fucheng Warren Zhu

Finkelstein-Schoenfeld, Buyse, Pocock, and other authors have developed generalizations of the Mann-Whitney test that allow for pairwise patient comparisons to include a hierarchy of measurements. Various authors present either asymptotic…

Computation · Statistics 2019-11-26 William N. Anderson , Johan Verbeeck

Balancing covariates is critical for credible and efficient randomized experiments. Rerandomization addresses this by repeatedly generating treatment assignments until covariate balance meets a prespecified threshold. By shrinking this…

Methodology · Statistics 2026-02-10 Jiuyao Lu , Tianruo Zhang , Ke Zhu