English
Related papers

Related papers: Nobody Puts Bonferroni in a Corner

200 papers

Scale-free networks play a fundamental role in the study of complex networks and various applied fields due to their ability to model a wide range of real-world systems. A key characteristic of these networks is their degree distribution,…

Physics and Society · Physics 2025-01-14 Nixon Jerez-Lillo , Francisco A. Rodrigues , Paulo H. Ferreira , Pedro L. Ramos

Multiple hypothesis testing problems arise naturally in science. In this paper, we introduce the new Fast Closed Testing (FACT) method for multiple testing, controlling the family-wise error rate. This error rate is state of the art in many…

Methodology · Statistics 2020-01-22 Edgar Dobriban

The topic of multiple hypotheses testing now has a potpourri of novel theories and ubiquitous applications in diverse scientific fields. However, the universal utility of this field often hinders the possibility of having a generalized…

Statistics Theory · Mathematics 2025-04-25 Monitirtha Dey , Subir Kumar Bhandari

Major internet companies routinely perform tens of thousands of A/B tests each year. Such large-scale sequential experimentation has resulted in a recent spurt of new algorithms that can provably control the false discovery rate (FDR) in a…

Methodology · Statistics 2019-11-06 Jinjin Tian , Aaditya Ramdas

This article studies the problem of online non-parametric change point detection in multivariate data streams. We approach the problem through the lens of kernel-based two-sample testing and introduce a sequential testing procedure based on…

Machine Learning · Statistics 2025-10-31 Florian Kalinke , Shakeel Gavioli-Akilagun

Existing safety assurance research has primarily focused on training-phase alignment to instill safe behaviors into LLMs. However, recent studies have exposed these methods' susceptibility to diverse jailbreak attacks. Concurrently,…

Machine Learning · Computer Science 2025-07-10 Ruizhong Qiu , Gaotang Li , Tianxin Wei , Jingrui He , Hanghang Tong

Refining one's hypotheses in the light of data is a common scientific practice; however, the dependency on the data introduces selection bias and can lead to specious statistical analysis. An approach for addressing this is via conditioning…

Machine Learning · Computer Science 2020-03-03 Jen Ning Lim , Makoto Yamada , Wittawat Jitkrittum , Yoshikazu Terada , Shigeyuki Matsui , Hidetoshi Shimodaira

Multi-stream sequential change detection involves simultaneously monitoring many streams of data and trying to detect when their distributions change, if at all. Here, we theoretically study multiple testing issues that arise from detecting…

Statistics Theory · Mathematics 2025-02-04 Sanjit Dandapanthula , Aaditya Ramdas

We study online control of an unknown nonlinear dynamical system that is approximated by a time-invariant linear system with model misspecification. Our study focuses on robustness, a measure of how much deviation from the assumed linear…

Optimization and Control · Mathematics 2022-04-06 Xinyi Chen , Udaya Ghai , Elad Hazan , Alexandre Megretski

In this paper, we consider the problem of simultaneously testing many two-sided hypotheses when rejections of null hypotheses are accompanied by claims of the direction of the alternative. The fundamental goal is to construct methods that…

Statistics Theory · Mathematics 2017-03-21 Anjana Grandhi , Wenge Guo , Joseph P. Romano

Robust design has been widely recognized as a leading method in reducing variability and improving quality. Most of the engineering statistics literature mainly focuses on finding "point estimates" of the optimum operating conditions for…

Methodology · Statistics 2013-08-14 Chanseok Park

We consider offline detection of a single changepoint in binary and count time-series. We compare exact tests based on the cumulative sum (CUSUM) and the likelihood ratio (LR) statistics, and a new proposal that combines exact two-sample…

Methodology · Statistics 2020-08-21 Shyamal K. De , Soumendu Sundar Mukherjee

In 2025, we identified a methodological issue in the bootstrapped differences of times series (BDOTS) first introduced in 2017 resulting in a significant inflation of the family-wise error rate. The goal of the present manuscript is…

Applications · Statistics 2025-03-25 Collin Nolte

Randomized controlled trials generate experimental variation that can credibly identify causal effects, but often suffer from limited scale, while observational datasets are large, but often violate desired identification assumptions. To…

Econometrics · Economics 2023-12-27 George Z. Gui

Measurements of line-of-sight dependent clustering via the galaxy power spectrum's multipole moments constitute a powerful tool for testing theoretical models in large-scale structure. Recent work shows that this measurement, including a…

Cosmology and Nongalactic Astrophysics · Physics 2017-07-19 Nick Hand , Yin Li , Zachary Slepian , Uros Seljak

We propose a nonparametric sequential test that aims to address two practical problems pertinent to online randomized experiments: (i) how to do a hypothesis test for complex metrics; (ii) how to prevent type $1$ error inflation under…

Machine Learning · Statistics 2017-06-28 Vineet Abhishek , Shie Mannor

Permutation-based partial-correlation tests guarantee finite-sample Type I error control under any fixed design and exchangeable noise, yet their power can collapse when the permutation-augmented design aligns too closely with the covariate…

Methodology · Statistics 2025-06-04 Tianyi Wang , Guanghui Wang , Zhaojun Wang , Changliang Zou

Traditional federated learning uses the number of samples to calculate the weights of each client model and uses this fixed weight value to fusion the global model. However, in practical scenarios, each client's device and data…

Machine Learning · Computer Science 2024-03-20 Leiming Chen , Weishan Zhang , Cihao Dong , Sibo Qiao , Ziling Huang , Yuming Nie , Zhaoxiang Hou , Chee Wei Tan

This work applies universal adaptive control to control barrier functions to achieve forward invariance of a safe set despite the presence of unmatched parametric uncertainties. The approach combines two ideas. The first is to construct a…

Systems and Control · Electrical Eng. & Systems 2022-08-17 Brett T. Lopez , Jean-Jacques Slotine

Practical or scientific considerations often lead to selecting a subset of parameters as ``important.'' Inferences about those parameters often are based on the same data used to select them in the first place. That can make the reported…

Methodology · Statistics 2019-06-04 Yoav Benjamini , Yotam Hechtlinger , Philip B. Stark