English
Related papers

Related papers: Beyond ATE: Multi-Criteria Design for A/B Testing

200 papers

We consider the problem of multiple hypothesis testing with generic side information: for each hypothesis $H_i$ we observe both a p-value $p_i$ and some predictor $x_i$ encoding contextual information about the hypothesis. For large-scale…

Methodology · Statistics 2018-07-26 Lihua Lei , William Fithian

Federated learning (FL) enables collaborative model training across distributed clients without sharing raw data, making it a promising approach for privacy-preserving machine learning. However, ensuring differential privacy (DP) in FL…

Machine Learning · Computer Science 2025-03-28 Kanishka Ranaweera , David Smith , Pubudu N. Pathirana , Ming Ding , Thierry Rakotoarivelo , Aruna Seneviratne

Minimising cycle time without inducing quality defects is a major challenge in the injection moulding (IM). Design of Experiment methods (DoE) have been widely studied for optimisation of the IM, however existing methods have limitations,…

Systems and Control · Electrical Eng. & Systems 2024-12-05 Mandana Kariminejad , David Tormey , Caitríona Ryan , Christopher O'Hara , Albert Weinert , Marion McAfee

Model-based design of experiments (MBDOE) is essential for efficient parameter estimation in nonlinear dynamical systems. However, conventional adaptive MBDOE requires costly posterior inference and design optimization between each…

Machine Learning · Statistics 2026-03-25 Arno Strouwen , Sebastian Micluţa-Câmpeanu

Learning optimal policies from historical data enables personalization in a wide variety of applications including healthcare, digital recommendations, and online education. The growing policy learning literature focuses on settings where…

Machine Learning · Statistics 2022-11-17 Ruohan Zhan , Zhimei Ren , Susan Athey , Zhengyuan Zhou

This paper presents a new model-free algorithm for episodic finite-horizon Markov Decision Processes (MDP), Adaptive Multi-step Bootstrap (AMB), which enjoys a stronger gap-dependent regret bound. The first innovation is to estimate the…

Machine Learning · Computer Science 2021-07-05 Haike Xu , Tengyu Ma , Simon S. Du

Incentive design constitutes a foundational paradigm for influencing the behavior of strategic agents, wherein a system planner (principal) publicly commits to an incentive mechanism designed to align individual objectives with collective…

Optimization and Control · Mathematics 2026-04-08 Georgios Vasileiou , Lantian Zhang , Silun Zhang

The average treatment effect (ATE) is widely used to evaluate the effectiveness of drugs and other medical interventions. In safety-critical applications like medicine, reliable inferences about the ATE typically require valid uncertainty…

Machine Learning · Computer Science 2025-10-13 Maresa Schröder , Justin Hartenstein , Stefan Feuerriegel

We propose a general framework for studying adaptive regret bounds in the online learning framework, including model selection bounds and data-dependent bounds. Given a data- or model-dependent bound we ask, "Does there exist some algorithm…

Machine Learning · Computer Science 2020-02-14 Dylan J. Foster , Alexander Rakhlin , Karthik Sridharan

Privacy is crucial in many applications of machine learning. Legal, ethical and societal issues restrict the sharing of sensitive data making it difficult to learn from datasets that are partitioned between many parties. One important…

Machine Learning · Statistics 2018-09-21 Christina Heinze-Deml , Brian McWilliams , Nicolai Meinshausen

In multi-armed bandits with network interference (MABNI), the action taken by one node can influence the rewards of others, creating complex interdependence. While existing research on MABNI largely concentrates on minimizing regret, it…

Machine Learning · Computer Science 2025-10-14 Zichen Wang , Haoyang Hong , Chuanhao Li , Haoxuan Li , Zhiheng Zhang , Huazheng Wang

Contextual bandits serve as a fundamental model for many sequential decision making tasks. The most popular theoretically justified approaches are based on the optimism principle. While these algorithms can be practical, they are known to…

Machine Learning · Computer Science 2020-03-17 Botao Hao , Tor Lattimore , Csaba Szepesvari

Recent literature on online learning has focused on developing adaptive algorithms that take advantage of a regularity of the sequence of observations, yet retain worst-case performance guarantees. A complementary direction is to develop…

Machine Learning · Computer Science 2015-01-27 Ali Jadbabaie , Alexander Rakhlin , Shahin Shahrampour , Karthik Sridharan

We study a nonparametric contextual bandit problem where the expected reward functions belong to a H\"older class with smoothness parameter $\beta$. We show how this interpolates between two extremes that were previously studied in…

Machine Learning · Statistics 2020-09-14 Yichun Hu , Nathan Kallus , Xiaojie Mao

The ''Propose-Test-Release'' (PTR) framework is a classic recipe for designing differentially private (DP) algorithms that are data-adaptive, i.e. those that add less noise when the input dataset is nice. We extend PTR to a more general…

Machine Learning · Computer Science 2023-01-03 Rachel Redberg , Yuqing Zhu , Yu-Xiang Wang

Multi-Objective Alignment (MOA) aims to align LLMs' responses with multiple human preference objectives, with Direct Preference Optimization (DPO) emerging as a prominent approach. However, we find that DPO-based MOA approaches suffer from…

Machine Learning · Computer Science 2025-12-09 Moxin Li , Yuantao Zhang , Wenjie Wang , Wentao Shi , Zhuo Liu , Fuli Feng , Tat-Seng Chua

Scientific experimentation is largely driven by statistical hypothesis testing to determine significant differences in interventions. Traditionally, experimenters allocate samples uniformly between each intervention. However, such an…

Ranking algorithms are fundamental to various online platforms across e-commerce sites to content streaming services. Our research addresses the challenge of adaptively ranking items from a candidate pool for heterogeneous users, a key…

Machine Learning · Computer Science 2024-06-10 Jingyuan Wang , Perry Dong , Ying Jin , Ruohan Zhan , Zhengyuan Zhou

Major advances have been made regarding the utilization of artificial intelligence in health care. In particular, deep learning approaches have been successfully applied for automated and assisted disease diagnosis and prognosis based on…

Methodology · Statistics 2020-03-24 Max Westphal , Antonia Zapf , Werner Brannath

Online learning algorithms often face a fundamental trilemma: balancing regret guarantees between adversarial and stochastic settings and providing baseline safety against a fixed comparator. While existing methods excel in one or two of…

Machine Learning · Computer Science 2026-05-29 Ting Hu , Luanda Cai , Emmanouil-Vasileios Vlatakis-Gkaragkounis