English
Related papers

Related papers: A/B Testing of Auctions

200 papers

When interpreting A/B tests, we typically focus only on the statistically significant results and take them by face value. This practice, termed post-selection inference in the statistical literature, may negatively affect both point…

Applications · Statistics 2021-06-01 Alex Deng , Yicheng Li , Jiannan Lu , Vivek Ramamurthy

A/B testing is widely used in modern technology companies for policy evaluation and product deployment, with the goal of comparing the outcomes under a newly-developed policy against a standard control. Various causal inference and…

Machine Learning · Statistics 2025-07-25 Jinjuan Wang , Qianglin Wen , Yu Zhang , Xiaodong Yan , Chengchun Shi

This paper studies inference in first-price and second-price sealed-bid auctions with many bidders, using an asymptotic framework where the number of bidders increases while the number of auctions remains fixed. Our approach enables…

Econometrics · Economics 2026-04-28 Federico A. Bugni , Yulong Wang

We study the question of setting and testing reserve prices in single item auctions when the bidders are not identical. At a high level, there are two generalizations of the standard second price auction: in the lazy version we first…

Computer Science and Game Theory · Computer Science 2016-02-26 Renato Paes Leme , Martin Pal , Sergei Vassilvitskii

A/B testing refers to the task of determining the best option among two alternatives that yield random outcomes. We provide distribution-dependent lower bounds for the performance of A/B testing that improve over the results currently…

Statistics Theory · Mathematics 2015-02-25 Emilie Kaufmann , Olivier Cappé , Aurélien Garivier

Edge computing as a promising technology provides lower latency, more efficient transmission, and faster speed of data processing since the edge servers are closer to the user devices. Each edge server with limited resources can offload…

Computer Science and Game Theory · Computer Science 2021-05-11 Houming Qiu , Kun Zhu , Nguyen Cong Luong , Changyan Yi , Dusit Niyato , Dong In Kim

In practice, most auction mechanisms are not strategy-proof, so equilibrium analysis is required to predict bidding behavior. In many auctions, though, an exact equilibrium is not known and one would like to understand whether -- manually…

Computer Science and Game Theory · Computer Science 2024-08-22 Fabian R. Pieroth , Tuomas Sandholm

We provide the first direct test of how the credibility of an auction format affects bidding behavior and final outcomes. To do so, we conduct a series of laboratory experiments where the role of the seller is played by a human subject who…

General Economics · Economics 2025-03-19 Ahrash Dianat , Mikhail Freer

We propose a general stochastic framework for modelling repeated auctions in the Real Time Bidding (RTB) ecosystem using point processes. The flexibility of the framework allows a variety of auction scenarios including configuration of…

Machine Learning · Statistics 2023-08-21 Seong Jin Lee , Bumsik Kim

In this paper, we study behavior of bidders in an experimental launch of a new advertising auction platform by Zillow, as Zillow switched from negotiated contracts to using auctions in several geographically isolated markets. A unique…

Computer Science and Game Theory · Computer Science 2017-04-03 Pooya Jalaly , Denis Nekipelov , Eva Tardos

We initiate the study of statistical inference and A/B testing for first-price pacing equilibria (FPPE). The FPPE model captures the dynamics resulting from large-scale first-price auction markets where buyers use pacing-based budget…

Statistics Theory · Mathematics 2023-06-30 Luofeng Liao , Christian Kroer

We propose a uniform approach for the design and analysis of prior-free competitive auctions and online auctions. Our philosophy is to view the benchmark function as a variable parameter of the model and study a broad class of functions…

Computer Science and Game Theory · Computer Science 2014-11-11 Ning Chen , Nick Gravin , Pinyan Lu

A/B testing has become the cornerstone of decision-making in online markets, guiding how platforms launch new features, optimize pricing strategies, and improve user experience. In practice, we typically employ the pairwise $t$-test to…

Machine Learning · Statistics 2025-10-29 Junpeng Gong , Chunkai Wang , Hao Li , Jinyong Ma , Haoxuan Li , Xu He

We improve the best known competitive ratio (from 1/4 to 1/2), for the online multi-unit allocation problem, where the objective is to maximize the single-price revenue. Moreover, the competitive ratio of our algorithm tends to 1, as the…

Computer Science and Game Theory · Computer Science 2009-01-13 Sourav Chakraborty , Nikhil Devanur

When developing a new networking algorithm, it is established practice to run a randomized experiment, or A/B test, to evaluate its performance. In an A/B test, traffic is randomly allocated between a treatment group, which uses the new…

Networking and Internet Architecture · Computer Science 2021-10-04 Bruce Spang , Veronica Hannan , Shravya Kunamalla , Te-Yuan Huang , Nick McKeown , Ramesh Johari

Contemporary real-world online ad auctions differ from canonical models [Edelman et al., 2007; Varian, 2009] in at least four ways: (1) values and click-through rates can depend upon users' search queries, but advertisers can only partially…

Machine Learning · Computer Science 2024-04-11 Ming Chen , Sareh Nabi , Marciano Siniscalchi

Internet search companies sell advertisement slots based on users' search queries via an auction. While there has been a lot of attention on the auction process and its game-theoretic aspects, our focus is on the advertisers. In particular,…

Data Structures and Algorithms · Computer Science 2007-05-23 Jon Feldman , S. Muthukrishnan , Martin Pal , Cliff Stein

We study procurement auctions, where an auctioneer seeks to acquire services from strategic sellers with private costs. The quality of services is measured by a submodular function known to the auctioneer. Our goal is to design…

Computer Science and Game Theory · Computer Science 2024-11-21 Yuan Deng , Amin Karbasi , Vahab Mirrokni , Renato Paes Leme , Grigoris Velegkas , Song Zuo

Today, many auctions are carried out with the help of intermediary platforms like Google and eBay. We refer to such auctions as platform-assisted auctions.Traditionally, the auction theory literature mainly focuses on designing auctions…

Computer Science and Game Theory · Computer Science 2025-01-07 Hao Chung , Ke Wu , Elaine Shi

Understanding bidding behavior in multi-unit auctions remains an ongoing challenge for researchers. Despite their widespread use, theoretical insights into the bidding behavior, revenue ranking, and efficiency of commonly used multi-unit…

Computer Science and Game Theory · Computer Science 2024-08-09 Peyman Khezr , Kendall Taylor