中文
相关论文

相关论文: Robust Sequential Experimental Design for A/B Test…

200 篇论文

Many robot control scenarios involve assessing system robustness against a task specification. If either the controller or environment are composed of "black-box" components with unknown dynamics, we cannot rely on formal verification to…

机器人学 · 计算机科学 2022-02-23 Craig Innes , Subramanian Ramamoorthy

Sequential design is a highly active field of research in active learning which provides a general framework for designing computer experiments with limited computational budgets. It aims to create efficient surrogate models to replace…

统计方法学 · 统计学 2025-01-03 Paul Lartaud , Philippe Humbert , Josselin Garnier

Randomized experiments ensure robust causal inference that are critical to effective learning analytics research and practice. However, traditional randomized experiments, like A/B tests, are limiting in large scale digital learning…

应用统计 · 统计学 2019-02-04 Timothy NeCamp , Josh Gardner , Christopher Brooks

A/B testing, a widely used form of Randomized Controlled Trial (RCT), is a fundamental tool in business data analysis and experimental design. However, despite its intent to maintain randomness, A/B testing often faces challenges that…

统计方法学 · 统计学 2024-08-13 Zihao Zheng , Carol Liu

This paper presents a methodology for model based robust fault diagnosis and a methodology for input design to obtain optimal diagnosis of faults. The proposed algorithm is suitable for real time implementation. Issues of robustness are…

系统与控制 · 计算机科学 2020-01-16 Dhruv Khandelwal , Siep Weiland , Amol Khalate

A/B test, a simple type of controlled experiment, refers to the statistical procedure of experimenting to compare two treatments applied to test subjects. For example, many IT companies frequently conduct A/B tests on their users who are…

统计方法学 · 统计学 2026-05-12 Qiong Zhang , Lulu Kang

A/B experimentation is a known technique for data-driven product development and has demonstrated its value in web-facing businesses. With the digitalisation of the automotive industry, the focus in the industry is shifting towards…

软件工程 · 计算机科学 2021-07-07 Yuchu Liu , Jan Bosch , Helena Holmström Olsson , Jonn Lantz

Recent developments in sequential experimental design look to construct a policy that can efficiently navigate the design space, in a way that maximises the expected information gain. Whilst there is work on achieving tractable policies for…

机器学习 · 计算机科学 2025-08-20 Yasir Zubayr Barlas , Kizito Salako

Optimal design of experiments for Bayesian inverse problems has recently gained wide popularity and attracted much attention, especially in the computational science and Bayesian inversion communities. An optimal design maximizes a…

最优化与控制 · 数学 2023-05-09 Ahmed Attia , Sven Leyffer , Todd Munson

We propose a general methodology of sequential locally optimal design of experiments for explicit or implicit nonlinear models, as they abound in chemical engineering and, in particular, in vapor-liquid equilibrium modeling. As a sequential…

最优化与控制 · 数学 2024-03-15 Martin Bubel , Jochen Schmid , Volodymyr Kozachynskyi , Erik Esche , Michael Bortz

This paper presents a quasi-sequential optimal design framework for toxicology experiments, specifically applied to sea urchin embryos. The authors propose a novel approach combining robust optimal design with adaptive, stage-based testing…

统计方法学 · 统计学 2025-03-04 Elvis Han Cui , Michael Collins , Jessica Munson , Weng Kee Wong

This paper proposes risk-averse and risk-agnostic formulations to robust design in which solutions that satisfy the system requirements for a set of scenarios are pursued. These scenarios, which correspond to realizations of uncertain…

最优化与控制 · 数学 2025-11-07 Luis G. Crespo , Bret Stanford , Natalia Alexandrov

Existing sequential generalized estimating equation methodology for longitudinal and group-correlated data focuses on narrow hypotheses concerning treatment efficacy and often makes modeling assumptions that impede the desirable robustness…

统计方法学 · 统计学 2026-03-16 Nathan T. Provost , Abdus S. Wahed

A/B testing, or online experiment is a standard business strategy to compare a new product with an old one in pharmaceutical, technological, and traditional industries. Major challenges arise in online experiments of two-sided marketplace…

机器学习 · 计算机科学 2022-11-04 Chengchun Shi , Xiaoyu Wang , Shikai Luo , Hongtu Zhu , Jieping Ye , Rui Song

A computer code can simulate a system's propagation of variation from random inputs to output measures of quality. Our aim here is to estimate a critical output tail probability or quantile without a large Monte Carlo experiment. Instead,…

机器学习 · 统计学 2019-08-16 Hao Chen , William J. Welch

Experimental design is an approach for selecting samples among a given set so as to obtain the best estimator for a given criterion. In the context of linear regression, several optimal designs have been derived, each associated with a…

统计理论 · 数学 2021-01-01 Geovani Rizk , Igor Colin , Albert Thomas , Moez Draief

This article studies the benefits of using spatially randomized experimental designs which partition the experimental area into distinct, non-overlapping units with treatments assigned randomly. Such designs offer improved policy evaluation…

统计理论 · 数学 2025-11-18 Ying Yang , Chengchun Shi , Fang Yao , Shouyang Wang , Hongtu Zhu

Group sequential designs drive innovation in clinical, industrial, and corporate settings. Early stopping for failure in sequential designs conserves experimental resources, whereas early stopping for success accelerates access to improved…

统计方法学 · 统计学 2025-11-27 Luke Hagar , Shirin Golchi , Marina B. Klein

Adaptive and sequential experiment design is a well-studied area in numerous domains. We survey and synthesize the work of the online statistical learning paradigm referred to as multi-armed bandits integrating the existing research as a…

机器学习 · 统计学 2015-11-04 Giuseppe Burtini , Jason Loeppky , Ramon Lawrence

Adaptive experiments are used extensively in online platforms, healthcare and biotechnology, and a variety of other settings. In many of these applications, the main goal is not to precisely estimate a treatment effect, but to demonstrate…