English
Related papers

Related papers: Online learning in repeated auctions

200 papers

In this paper, we study a special bandit setting of online stochastic linear optimization, where only one-bit of information is revealed to the learner at each round. This problem has found many applications including online advertisement…

Machine Learning · Computer Science 2015-09-28 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

We consider repeated multi-unit auctions with uniform pricing, which are widely used in practice for allocating goods such as carbon licenses. In each round, $K$ identical units of a good are sold to a group of buyers that have valuations…

Computer Science and Game Theory · Computer Science 2024-01-17 Simina Brânzei , Mahsa Derakhshan , Negin Golrezaei , Yanjun Han

We study a game between autobidding algorithms that compete in an online advertising platform. Each autobidder is tasked with maximizing its advertiser's total value over multiple rounds of a repeated auction, subject to budget and…

Computer Science and Game Theory · Computer Science 2024-12-03 Brendan Lucier , Sarath Pattathil , Aleksandrs Slivkins , Mengxiao Zhang

A popular approach to selling online advertising is by a waterfall, where a publisher makes sequential price offers to ad networks for an inventory, and chooses the winner in that order. The publisher picks the order and prices to maximize…

Machine Learning · Computer Science 2019-04-23 Branislav Kveton , Saied Mahdian , S. Muthukrishnan , Zheng Wen , Yikun Xian

We study the problem of online learning in two-sided non-stationary matching markets, where the objective is to converge to a stable match. In particular, we consider the setting where one side of the market, the arms, has fixed known set…

Machine Learning · Computer Science 2023-01-16 Deepan Muthirayan , Chinmay Maheshwari , Pramod P. Khargonekar , Shankar Sastry

We consider a setting where $n$ buyers, with combinatorial preferences over $m$ items, and a seller, running a priority-based allocation mechanism, repeatedly interact. Our goal, from observing limited information about the results of these…

Computer Science and Game Theory · Computer Science 2014-08-29 Avrim Blum , Yishay Mansour , Jamie Morgenstern

We study online decision making problems under resource constraints, where both reward and cost functions are drawn from distributions that may change adversarially over time. We focus on two canonical settings: $(i)$ online resource…

Machine Learning · Computer Science 2025-06-19 Francesco Emanuele Stradi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti , Christian Kroer

We study dynamic pricing where a seller repeatedly interacts with a strategic, non-myopic buyer who has a fixed private valuation and discounts future utility. Prior work focused exclusively on posted-price mechanisms, which only extract…

Computer Science and Game Theory · Computer Science 2026-04-28 Shiliang Zuo

We present and study models of adversarial online learning where the feedback observed by the learner is noisy, and the feedback is either full information feedback or bandit feedback. Specifically, we consider binary losses xored with the…

Machine Learning · Computer Science 2018-11-06 Alon Resler , Yishay Mansour

We consider the problem of learning optimal reserve price in repeated auctions against non-myopic bidders, who may bid strategically in order to gain in future rounds even if the single-round auctions are truthful. Previous algorithms,…

Computer Science and Game Theory · Computer Science 2018-05-01 Zhiyi Huang , Jinyan Liu , Xiangning Wang

We introduce a new numerical framework to learn optimal bidding strategies in repeated auctions when the seller uses past bids to optimize her mechanism. Crucially, we do not assume that the bidders know what optimization mechanism is used…

Computer Science and Game Theory · Computer Science 2021-02-09 Thomas Nedelec , Jules Baudet , Vianney Perchet , Noureddine El Karoui

This paper addresses the critical challenge of stochastic latent heterogeneity in online decision-making, where individuals' responses to actions vary not only with observable contexts but also with unobserved, randomly realized subgroups.…

Machine Learning · Computer Science 2025-11-17 Elynn Chen , Xi Chen , Wenbo Jing , Xiao Liu

With the advent and increasing consolidation of e-commerce, digital advertising has very recently replaced traditional advertising as the main marketing force in the economy. In the past four years, a particularly important development in…

Computer Science and Game Theory · Computer Science 2022-11-14 Wei Zhang , Yanjun Han , Zhengyuan Zhou , Aaron Flores , Tsachy Weissman

Repeated multi-unit auctions, where a seller allocates multiple identical items over many rounds, are common mechanisms in electricity markets and treasury auctions. We compare the two predominant formats: uniform-price and discriminatory…

Computer Science and Game Theory · Computer Science 2025-10-23 Marius Potfer , Vianney Perchet

We study stochastic linear bandits where, in each round, the learner receives a set of actions (i.e., feature vectors), from which it chooses an element and obtains a stochastic reward. The expected reward is a fixed but unknown linear…

Machine Learning · Computer Science 2024-06-04 Tianyuan Jin , Kyoungseok Jang , Nicolò Cesa-Bianchi

We study a repeated trading problem in which a mechanism designer facilitates trade between a single seller and multiple buyers. Our model generalizes the classic bilateral trade setting to a multi-buyer environment. Specifically, the…

Computer Science and Game Theory · Computer Science 2025-03-04 Anna Lunghi , Matteo Castiglioni , Alberto Marchesi

We present a new recommendation setting for picking out two items from a given set to be highlighted to a user, based on contextual input. These two items are presented to a user who chooses one of them, possibly stochastically, with a bias…

Machine Learning · Computer Science 2016-01-26 Daniel Barsky , Koby Crammer

Learning theory has largely focused on two main learning scenarios. The first is the classical statistical setting where instances are drawn i.i.d. from a fixed distribution and the second scenario is the online learning, completely…

Machine Learning · Statistics 2011-04-28 Alexander Rakhlin , Karthik Sridharan , Ambuj Tewari

We study the bidding problem in repeated uniform price multi-unit auctions from the perspective of a value-maximizing buyer. The buyer aims to maximize their cumulative value over $T$ rounds while adhering to per-round return-on-investment…

Data Structures and Algorithms · Computer Science 2025-10-07 Negin Golrezaei , Sourav Sahoo

Auctions with partially-revealed information about items are broadly employed in real-world applications, but the underlying mechanisms have limited theoretical support. In this work, we study a machine learning formulation of these types…

Machine Learning · Computer Science 2022-07-06 Wenshuo Guo , Michael I. Jordan , Ellen Vitercik