English
Related papers

Related papers: Asymptotic Online FWER Control for Dependent Test …

200 papers

We derive new algorithms for online multiple testing that provably control false discovery exceedance (FDX) while achieving orders of magnitude more power than previous methods. This statistical advance is enabled by the development of new…

Methodology · Statistics 2021-06-03 Ziyu Xu , Aaditya Ramdas

In this paper we introduce and investigate a new rejection curve for asymptotic control of the false discovery rate (FDR) in multiple hypotheses testing problems. We first give a heuristic motivation for this new curve and propose some…

Statistics Theory · Mathematics 2009-03-31 Helmut Finner , Thorsten Dickhaus , Markus Roters

Multi-arm multi-stage (MAMS) trials have gained popularity to enhance the efficiency of clinical trials, potentially reducing both duration and costs. This paper focuses on designing MAMS trials where no control treatment exists. This can…

Methodology · Statistics 2025-02-12 Peter Greenstreet , Thomas Jaki , Alun Bedding , Pavel Mozgunov

To maintain the desired quality of a product or service it is necessary to monitor the process that results in the product or service. This monitoring method is called Statistical Process Management, or Statistical Process Control. It is in…

Methodology · Statistics 2019-01-15 W. J. Conover , Victor G. Tercero , Alvaro E. Cordero-Franco

When testing many hypotheses, often we do not have strong expectations about the directions of the effects. In some situations however, the alternative hypotheses are that the parameters lie in a certain direction or interval, and it is in…

Methodology · Statistics 2026-03-02 Jesse Hemerik

In this paper, we have established a general framework of multistage hypothesis tests which applies to arbitrarily many mutually exclusive and exhaustive composite hypotheses. Within the new framework, we have constructed specific…

Statistics Theory · Mathematics 2013-11-05 Xinjia Chen

In multiple testing scenarios, typically the sign of a parameter is inferred when its estimate exceeds some significance threshold in absolute value. Typically, the significance threshold is chosen to control the experimentwise type I error…

Methodology · Statistics 2018-01-03 Chaoyu Yu , Peter D. Hoff

In any parametric inference problem, the robustness of the procedure is a real concern. A procedure which retains a high degree of efficiency under the model and simultaneously provides stable inference under data contamination is…

Methodology · Statistics 2020-01-01 Ayanendranath Basu , Abhijit Mandal , Nirian Martin , Leandro Pardo

We construct an asymptotic prediction interval for the population-wise error rate (PWER), which is a multiple type I error criterion for clinical trials with overlapping patient populations. The PWER is the probability that a randomly…

Methodology · Statistics 2026-02-09 Remi Luschei , Werner Brannath

Multiple hypothesis testing is a core problem in statistical inference and arises in almost every scientific field. Given a set of null hypotheses $\mathcal{H}(n) = (H_1,\dotsc, H_n)$, Benjamini and Hochberg introduced the false discovery…

Statistics Theory · Mathematics 2017-07-10 Adel Javanmard , Andrea Montanari

An important aspect of multiple hypothesis testing is controlling the significance level, or the level of Type I error. When the test statistics are not independent it can be particularly challenging to deal with this problem, without…

Statistics Theory · Mathematics 2009-03-04 Sandy Clarke , Peter Hall

Multi-stream sequential change detection involves simultaneously monitoring many streams of data and trying to detect when their distributions change, if at all. Here, we theoretically study multiple testing issues that arise from detecting…

Statistics Theory · Mathematics 2025-02-04 Sanjit Dandapanthula , Aaditya Ramdas

In many large multiple testing problems the hypotheses are divided into families. Given the data, families with evidence for true discoveries are selected, and hypotheses within them are tested. Neither controlling the error-rate in each…

Statistics Theory · Mathematics 2011-06-21 Yoav Benjamini , Marina Bogomolov

In complex clinical trials, multiple research objectives are often grouped into sets of objectives based on their inherent hierarchical relationships. Consequently, the hypotheses formulated to address these objectives are grouped into…

Methodology · Statistics 2016-11-11 Zhiying Qiu , Wenge Guo , Sanat Sarkar

Many high-dimensional hypothesis tests aim to globally examine marginal or low-dimensional features of a high-dimensional joint distribution, such as testing of mean vectors, covariance matrices and regression coefficients. This paper…

Statistics Theory · Mathematics 2020-02-04 Yinqiu He , Gongjun Xu , Chong Wu , Wei Pan

We study an online multiple testing problem where the hypotheses arrive sequentially in a stream. The test statistics are independent and assumed to have the same distribution under their respective null hypotheses. We investigate two…

Statistics Theory · Mathematics 2017-05-30 Shiyun Chen , Ery Arias-Castro

Online controlled experiments, now commonly known as A/B testing, are crucial to causal inference and data driven decision making in many internet based businesses. While a simple comparison between a treatment (the feature under test) and…

Applications · Statistics 2015-01-05 Yu Guo , Alex Deng

Test of independence is of fundamental importance in modern data analysis, with broad applications in variable selection, graphical models, and causal inference. When the data is high dimensional and the potential dependence signal is…

Methodology · Statistics 2023-06-13 Zhanrui Cai , Jing Lei , Kathryn Roeder

Multiple testing is a fundamental problem in high-dimensional statistical inference. Although many methods have been proposed to control false discoveries, it is still a challenging task when the tests are correlated to each other. To…

Statistics Theory · Mathematics 2022-07-06 Meng Mei , Yuan Jiang

We investigate the nonparametric, composite hypothesis testing problem for arbitrary unknown distributions in the asymptotic regime where both the sample size and the number of hypotheses grow exponentially large. Such asymptotic analysis…

Information Theory · Computer Science 2019-01-30 Qunwei Li , Tiexing Wang , Donald J. Bucci , Yingbin Liang , Biao Chen , Pramod K. Varshney