English
Related papers

Related papers: Choosing Online Experiment Designs under Interfere…

200 papers

We formalize sequential decision-making with information acquisition as the probing-augmented user-centric selection (PUCS) framework, where a learner first probes a subset of arms to obtain side information on resources and rewards, and…

Machine Learning · Computer Science 2025-08-19 Tianyi Xu , Yiting Chen , Henger Li , Zheyong Bian , Emiliano Dall'Anese , Zizhan Zheng

Practitioners and academics have long appreciated the benefits of covariate balancing when they conduct randomized experiments. For web-facing firms running online A/B tests, however, it still remains challenging in balancing covariate…

Methodology · Statistics 2024-05-27 Jinglong Zhao , Zijie Zhou

Online experimentation, also known as A/B testing, is the gold standard for measuring product impacts and making business decisions in the tech industry. The validity and utility of experiments, however, hinge on unbiasedness and sufficient…

Applications · Statistics 2020-12-17 Min Liu , Jialiang Mao , Kang Kang

We consider a bandit recommendations problem in which an agent's preferences (representing selection probabilities over recommended items) evolve as a function of past selections, according to an unknown $\textit{preference model}$. In each…

Machine Learning · Computer Science 2024-02-07 Arpit Agarwal , William Brown

How should researchers select experimental sites when the deployment population differs from observed data? I formulate the problem of experimental site selection as an optimal transport problem, developing methods to minimize downstream…

Methodology · Statistics 2025-11-07 Adam Bouyamourn

Data-driven algorithm design, that is, choosing the best algorithm for a specific application, is a crucial problem in modern data science. Practitioners often optimize over a parameterized algorithm family, tuning parameters based on…

Machine Learning · Computer Science 2018-10-23 Maria-Florina Balcan , Travis Dick , Ellen Vitercik

In performative prediction, the deployment of a predictive model triggers a shift in the data distribution. As these shifts are typically unknown ahead of time, the learner needs to deploy a model to get feedback about the distribution it…

Machine Learning · Computer Science 2022-07-19 Meena Jagadeesan , Tijana Zrnic , Celestine Mendler-Dünner

In bandit settings, optimizing long-term regret metrics requires exploration, which corresponds to sometimes taking myopically sub-optimal actions. When a long-lived principal merely recommends actions to be executed by a sequence of…

Computer Science and Game Theory · Computer Science 2026-02-25 Ramya Ramalingam , Osbert Bastani , Aaron Roth

It is becoming increasingly important to understand the vulnerability of machine learning models to adversarial attacks. One of the fundamental problems in adversarial machine learning is to quantify how much training data is needed in the…

Machine Learning · Computer Science 2023-08-24 Pascale Gourdeau

We study how to adapt to smoothly-varying ('easy') environments in well-known online learning problems where acquiring information is expensive. For the problem of label efficient prediction, which is a budgeted version of prediction with…

Machine Learning · Computer Science 2019-12-09 Siddharth Mitra , Aditya Gopalan

We consider experiments for comparing treatments using units that are ordered linearly over time or space within blocks. In addition to the block effect, we assume that a trend effect influences the response. The latter is modeled as a…

Statistics Theory · Mathematics 2008-12-18 Dibyen Majumdar , John Stufken

Interference is ubiquitous when conducting causal experiments over networks. Except for certain network structures, causal inference on the network in the presence of interference is difficult due to the entanglement between the treatment…

Methodology · Statistics 2023-12-08 Chencheng Cai , Xu Zhang , Edoardo M. Airoldi

Online experiments (A/B tests) are widely regarded as the gold standard for evaluating recommender system variants and guiding launch decisions. However, a variety of biases can distort the results of the experiment and mislead…

Information Retrieval · Computer Science 2025-09-03 Chen Zheng , Zhenyu Zhao

Bandit algorithms are widely used in sequential decision problems to maximize the cumulative reward. One potential application is mobile health, where the goal is to promote the user's health through personalized interventions based on user…

Machine Learning · Statistics 2022-08-23 Gi-Soo Kim , Hyun-Joon Yang , Jane P. Kim

We consider a causal inference problem frequently encountered in online advertising systems, where a publisher (e.g., Instagram, TikTok) interacts repeatedly with human users and advertisers by sporadically displaying to each user an…

Machine Learning · Statistics 2026-02-06 Jia Yuan Yu

Experimentation platforms are essential to modern large technology companies, as they are used to carry out many randomized experiments daily. The classic assumption of no interference among users, under which the outcome of one user does…

In many engineered systems, agents make decisions under incomplete information, creating opportunities for a planner to influence decentralized behavior through signaling. We study how such signaling can be designed in parallel-network,…

Computer Science and Game Theory · Computer Science 2026-04-14 Yuwei Hu , Bryce L. Ferguson

Motivated by online retail, we consider the problem of selling one item (e.g., an ad slot) to two non-excludable buyers (say, a merchant and a brand). This problem captures, for example, situations where a merchant and a brand cooperatively…

Computer Science and Game Theory · Computer Science 2025-05-26 Gagan Aggarwal , Ashwinkumar Badanidiyuru , Paul Dütting , Federico Fusco

Exposure bias is a well-known issue in recommender systems where items and suppliers are not equally represented in the recommendation results. This is especially problematic when bias is amplified over time as a few items (e.g., popular…

Information Retrieval · Computer Science 2022-09-07 Masoud Mansoury , Bamshad Mobasher , Herke van Hoof

Recommendation systems when employed in markets play a dual role: they assist users in selecting their most desired items from a large pool and they help in allocating a limited number of items to the users who desire them the most. Despite…

Machine Learning · Computer Science 2022-08-01 Yigit Efe Erginbas , Soham Phade , Kannan Ramchandran