English
Related papers

Related papers: Distribution-Free Pointwise Adjusted P-Values for …

200 papers

In this work, we introduce statistical testing under distributional shifts. We are interested in the hypothesis $P^* \in H_0$ for a target distribution $P^*$, but observe data from a different distribution $Q^*$. We assume that $P^*$ is…

Methodology · Statistics 2022-05-03 Nikolaj Thams , Sorawit Saengkyongam , Niklas Pfister , Jonas Peters

Quantile and quantile effect functions are important tools for descriptive and causal analyses due to their natural and intuitive interpretation. Existing inference methods for these functions do not apply to discrete random variables. This…

Methodology · Statistics 2018-09-03 Victor Chernozhukov , Iván Fernández-Val , Blaise Melly , Kaspar Wüthrich

The theory of testing statistical functionals is developed for non-parametric two-sample problems. For differentiable real-valued statistical functionals, some tests for the one-sided and two-sided cases are proposed and studied. The…

Statistics Theory · Mathematics 2025-07-14 Vladimir Ostrovski

Multiple testing with false discovery rate (FDR) control has been widely conducted in the ``discrete paradigm" where p-values have discrete and heterogeneous null distributions. However, in this scenario existing FDR procedures often lose…

Methodology · Statistics 2019-07-23 Xiongzhi Chen , R. W. Doerge , Sanat K. Sarkar

We extend conformal prediction methodology beyond the case of exchangeable data. In particular, we show that a weighted version of conformal prediction can be used to compute distribution-free prediction intervals for problems in which the…

Methodology · Statistics 2020-07-08 Ryan J. Tibshirani , Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas

In Functional Data Analysis, data are commonly assumed to be smooth functions on a fixed interval of the real line. In this work, we introduce a comprehensive framework for the analysis of functional data, whose domain is a two-dimensional…

Methodology · Statistics 2019-08-02 Eardi Lila , John A. D. Aston

Methods of merging several p-values into a single p-value are important in their own right and widely used in multiple hypothesis testing. This paper is the first to systematically study the admissibility (in Wald's sense) of p-merging…

Statistics Theory · Mathematics 2021-03-30 Vladimir Vovk , Bin Wang , Ruodu Wang

Simulation-based inference methods that feature correct conditional coverage of confidence sets based on observations that have been compressed to a scalar test statistic require accurate modeling of either the p-value function or the…

Machine Learning · Statistics 2025-08-18 Ali Al Kadhim , Harrison B. Prosper

Testing equality of two multivariate distributions is a classical problem for which many non-parametric tests have been proposed over the years. Most of the popular two-sample tests, which are asymptotically distribution-free, are based…

Statistics Theory · Mathematics 2019-04-17 Bhaswar B. Bhattacharya

The classical theory for the meta-analysis of $p$-values is based on the assumption that if the overall null hypothesis is true, then all $p$-values used in a chosen combined test statistic are genuine, i.e., are observations from…

Computation · Statistics 2024-10-08 Rui Santos , M. Fátima Brilhante , Sandra Mendonça

Although several nonparametric tests are available for testing population identical distributions or equal means in multiple groups problem, the Van der Waerden test has asymptotically the same efficiency as the classical one-way analysis…

Methodology · Statistics 2022-03-07 Elsayed Elamir

In meta analysis, multiple hypothesis testing and many other methods, p-values are utilized as inputs and assumed to be uniformly distributed over the unit interval under the null hypotheses. If data used to generate p-values have discrete…

Methodology · Statistics 2026-02-24 Joshua Habiger , Pratyaydipta Rudra

Null Hypothesis Significance Testing (NHST) has long been central to the scientific project, guiding theory development and supporting evidence-based intervention and decision-making. Recent years, however, have seen growing awareness of…

Methodology · Statistics 2020-10-16 Fintan Costello , Paul Watts

We build a valid p-value based on a concentration inequality for bounded random variables introduced by Pelekis, Ramon and Wang. The motivation behind this work is the calibration of predictive algorithms in a distribution-free setting. The…

Machine Learning · Statistics 2024-05-16 Joaquin Alvarez

Change point tests for abrupt changes in the mean of functional data, i.e., random elements in infinite-dimensional Hilbert spaces, are either based on dimension reduction techniques, e.g., based on principal components, or directly based…

Statistics Theory · Mathematics 2026-01-23 Claudia Kirch , Hedvika Ranošová , Martin Wendler

This paper is motivated by medical studies in which the same patients with multiple sclerosis are examined at several successive visits and described by fractional anisotropy tract profiles, which can be represented as functions. Since the…

Methodology · Statistics 2023-06-07 Katarzyna Kuryło , Łukasz Smaga

P-values are widely used in both the social and natural sciences to quantify the statistical significance of observed results. The recent surge of big data research has made the p-value an even more popular tool to test the significance of…

Applications · Statistics 2023-01-05 Bertie Vidgen , Taha Yasseri

We consider the problem of constructing nonparametric undirected graphical models for high-dimensional functional data. Most existing statistical methods in this context assume either a Gaussian distribution on the vertices or linear…

Statistics Theory · Mathematics 2021-03-22 Eftychia Solea , Holger Dette

We investigate the problem of testing the global null in the high-dimensional regression models when the feature dimension $p$ grows proportionally to the number of observations $n$. Despite a number of prior work studying this problem,…

Methodology · Statistics 2020-10-06 Yue Li , Ilmun Kim , Yuting Wei

Let $(X,Y)$ be a random variable consisting of an observed feature vector $X\in \mathcal{X}$ and an unobserved class label $Y\in \{1,2,...,L\}$ with unknown joint distribution. In addition, let $\mathcal{D}$ be a training data set…

Statistics Theory · Mathematics 2008-06-26 Lutz Duembgen , Bernd-Wolfgang Igl , Axel Munk