English
Related papers

Related papers: Multi-Metric Adaptive Experimental Design under Fi…

200 papers

Multistage design has been used in a wide range of scientific fields. By allocating sensing resources adaptively, one can effectively eliminate null locations and localize signals with a smaller study budget. We formulate a…

Methodology · Statistics 2024-06-17 Weinan Wang , Bowen Gang , Wenguang Sun

Online controlled experiments (A/B testing) are fundamental to data-driven decision-making in many companies. Improving the sensitivity of these experiments under fixed sample size constraints requires reducing the variance of the average…

Methodology · Statistics 2026-03-24 Zhexiao Lin , Pablo Crespo

In the setting of multi-armed trials, adaptive designs are a popular way to increase estimation efficiency, identify optimal treatments, or maximize rewards to individuals. Recent work has considered the case of estimating the effects of K…

Methodology · Statistics 2026-02-10 Evan T. R. Rosenman , Kristen B. Hunter

In multiple testing problems, where a large number of hypotheses are tested simultaneously, false discovery rate (FDR) control can be achieved with the well-known Benjamini-Hochberg procedure, which adapts to the amount of signal present in…

Methodology · Statistics 2017-09-14 Ang Li , Rina Foygel Barber

The e-value is gaining traction as a robust alternative to p-values and Bayes factors for quantifying statistical evidence. e-values are a promising method for adaptive clinical trials due to their anytime-validity: e-values ensure type I…

Methodology · Statistics 2026-05-28 Stef Baas , Judith ter Schure , Joost van Rosmalen

A/B testing is gaining attention in the automotive sector as a promising tool to measure causal effects from software changes. Different from the web-facing businesses, where A/B testing has been well-established, the automotive domain…

Software Engineering · Computer Science 2021-11-12 Yuchu Liu , David Issa Mattos , Jan Bosch , Helena Holmström Olsson , Jonn Lantz

The accelerated failure time (AFT) models have proved useful in many contexts, though heavy censoring (as for example in cancer survival) and high dimensionality (as for example in microarray data) cause difficulties for model fitting and…

Methodology · Statistics 2013-12-10 Md Hasinur Rahaman Khan , J. Ewart H. Shaw

A major bottleneck in characterizing the failure modes of generative AI systems is the cost and time of annotation and evaluation. Consequently, adaptive testing paradigms have gained popularity, where one opportunistically decides which…

Artificial Intelligence · Computer Science 2026-05-11 Siyu Zhou , Patrick Vossler , Venkatesh Sivaraman , Yifan Mai , Jean Feng

Recently a new experimental approach, the hybrid experimental design (HED), was introduced to enable investigators to answer scientific questions about building behavioral interventions in which human-delivered and digital components are…

Methodology · Statistics 2026-02-26 Mengbing Li , Inbal Nahum-Shani , Walter Dempsey

Adaptive clinical trials rely on interim analyses, flexible stopping, and data-dependent design modifications that complicate statistical guarantees when fixed-horizon test statistics are repeatedly inspected or reused after adaptations.…

Methodology · Statistics 2026-02-09 Alexandra Sokolova , Vadim Sokolov

This PhD thesis covers breakthroughs in several areas of adaptive experiment design: (i) (Chapter 2) Novel clinical trial designs and statistical methods in the era of precision medicine. (ii) (Chapter 3) Multi-armed bandit theory, with…

Methodology · Statistics 2022-05-20 Michael Sklar

One of the challenges in the design of confirmatory trials is to deal with uncertainties regarding the optimal target population for a novel drug. Adaptive enrichment designs (AED) which allow for a data-driven selection of one or more…

Applications · Statistics 2020-09-15 Anh Nguyen Duc , Dominik Heinzmann , Claude Berge , Marcel Wolbers

We introduce Deep Adaptive Design (DAD), a method for amortizing the cost of adaptive Bayesian experimental design that allows experiments to be run in real-time. Traditional sequential Bayesian optimal experimental design approaches…

Machine Learning · Statistics 2021-06-14 Adam Foster , Desi R. Ivanova , Ilyas Malik , Tom Rainforth

Randomized experiments play a major role in data-driven decision making across many different fields and disciplines. In medicine, for example, randomized controlled trials (RCTs) are the backbone of clinical trial methodology for testing…

Applications · Statistics 2016-08-30 Andrew W. Correia

A semi-parametric joint Value-at-Risk (VaR) and Expected Shortfall (ES) forecasting framework employing multiple realized measures is developed. The proposed framework extends the realized exponential GARCH model to be semi-parametrically…

Risk Management · Quantitative Finance 2024-12-06 Rangika Peiris , Chao Wang , Richard Gerlach , Minh-Ngoc Tran

A new realized conditional autoregressive Value-at-Risk (VaR) framework is proposed, through incorporating a measurement equation into the original quantile regression model. The framework is further extended by employing various Expected…

Risk Management · Quantitative Finance 2021-01-18 Chao Wang , Richard Gerlach , Qian Chen

Testing and evaluation are expensive but critical steps in the development of connected and automated vehicles (CAVs). In this paper, we develop an adaptive sampling framework to efficiently evaluate the accident rate of CAVs, particularly…

Robotics · Computer Science 2023-06-02 Xianliang Gong , Shuo Feng , Yulin Pan

We consider an experiment with at least two stages or batches and $O(N)$ subjects per batch. First, we propose a semiparametric treatment effect estimator that efficiently pools information across the batches, and show it asymptotically…

Methodology · Statistics 2023-09-28 Harrison H. Li , Art B. Owen

Adaptive interventions (AIs) are increasingly becoming popular in medical and behavioral sciences. An AI is a sequence of individualized intervention options that specify for whom and under what conditions different intervention options…

Applications · Statistics 2018-12-18 Palash Ghosh , Inbal Nahum-Shani , Bonnie Spring , Bibhas Chakraborty

Reducing the number of experimental units is one of the three pillars of the 3R principles (Replace, Reduce, Refine) in animal research. At the same time, statistical error rates need to be controlled to enable reliable inferences and…

Methodology · Statistics 2026-05-08 Leonhard Held , Fadoua Balabdaoui , Saverio Fontana , Samuel Pawel