English
Related papers

Related papers: An Experimental Evaluation of Regret-Based Econome…

200 papers

We study a setting where agents use no-regret learning algorithms to participate in repeated auctions. \citet{kolumbus2022auctions} showed, rather surprisingly, that when bidders participate in second-price auctions using no-regret bidding…

Computer Science and Game Theory · Computer Science 2024-11-15 Gagan Aggarwal , Anupam Gupta , Andres Perlroth , Grigoris Velegkas

Feature-based dynamic pricing is an increasingly popular model of setting prices for highly differentiated products with applications in digital marketing, online sales, real estate and so on. The problem was formally studied as an online…

Machine Learning · Computer Science 2021-10-26 Jianyu Xu , Yu-Xiang Wang

We study regret minimization in repeated first-price auctions (FPAs), where a bidder observes only the realized outcome after each auction -- win or loss. This setup reflects practical scenarios in online display advertising where the…

Machine Learning · Computer Science 2026-03-19 Yuxiao Wen , Yanjun Han , Zhengyuan Zhou

Performance of adaptive control policies is assessed through the regret with respect to the optimal regulator, which reflects the increase in the operating cost due to uncertainty about the dynamics parameters. However, available results in…

Systems and Control · Computer Science 2020-03-24 Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

We study the problem of regret minimization in partially observable linear quadratic control systems when the model dynamics are unknown a priori. We propose ExpCommit, an explore-then-commit algorithm that learns the model Markov…

Machine Learning · Computer Science 2020-03-10 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

Advertisers increasingly use automated bidding to optimize their ad campaigns on online advertising platforms. Autobidding optimizes an advertiser's objective subject to various constraints, e.g. average ROI and budget constraints. In this…

Computer Science and Game Theory · Computer Science 2024-04-16 Gagan Aggarwal , Giannis Fikioris , Mingfei Zhao

Bilateral trade models the problem of intermediating between two rational agents -- a seller and a buyer -- both characterized by a private valuation for an item they want to trade. We study the online learning version of the problem, in…

Computer Science and Game Theory · Computer Science 2024-09-04 Martino Bernasconi , Matteo Castiglioni , Andrea Celli , Federico Fusco

Auctions with partially-revealed information about items are broadly employed in real-world applications, but the underlying mechanisms have limited theoretical support. In this work, we study a machine learning formulation of these types…

Machine Learning · Computer Science 2022-07-06 Wenshuo Guo , Michael I. Jordan , Ellen Vitercik

A regret minimizing set Q is a small size representation of a much larger database P so that user queries executed on Q return answers whose scores are not much worse than those on the full dataset. In particular, a k-regret minimizing set…

Data Structures and Algorithms · Computer Science 2017-02-10 Pankaj K. Agarwal , Nirman Kumar , Stavros Sintos , Subhash Suri

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

Machine Learning · Computer Science 2023-08-17 Mengfan Xu , Diego Klabjan

Inspired by real-time ad exchanges for online display advertising, we consider the problem of inferring a buyer's value distribution for a good when the buyer is repeatedly interacting with a seller through a posted-price mechanism. We…

Machine Learning · Computer Science 2013-11-28 Kareem Amin , Afshin Rostamizadeh , Umar Syed

Optimization models used to make discrete decisions often contain uncertain parameters that are context-dependent and estimated through prediction. To account for the quality of the decision made based on the prediction, decision-focused…

Machine Learning · Computer Science 2024-07-30 Noah Schutte , Krzysztof Postek , Neil Yorke-Smith

We study contextual bilateral trade under full feedback when trader valuations have bounded density but infinite variance. We first extend the self-bounding property of Bachoc et al. (ICML 2025) from bounded to real-valued valuations,…

Machine Learning · Statistics 2026-03-10 Hangyi Zhao

We study online learning in contextual pay-per-click auctions where at each of the $T$ rounds, the learner receives some context along with a set of ads and needs to make an estimate on their click-through rate (CTR) in order to run a…

Machine Learning · Computer Science 2023-10-10 Mengxiao Zhang , Haipeng Luo

Companies like Google and Microsoft run billions of auctions every day to sell advertising opportunities. Any change to the rules of these auctions can have a tremendous effect on the revenue of the company and the welfare of the…

Computer Science and Game Theory · Computer Science 2019-11-07 Saeed Alaei , Ashwinkumar Badanidiyuru , Mohammad Mahdian , Sadra Yazdanbod

We consider regret minimization in repeated games with non-convex loss functions. Minimizing the standard notion of regret is computationally intractable. Thus, we define a natural notion of regret which permits efficient optimization and…

Machine Learning · Computer Science 2017-11-06 Elad Hazan , Karan Singh , Cyril Zhang

In two-player zero-sum games, the learning dynamic based on optimistic Hedge achieves one of the best-known regret upper bounds among strongly-uncoupled learning dynamics. With an appropriately chosen learning rate, the social and…

Machine Learning · Computer Science 2025-10-14 Taira Tsuchiya

Recently the online advertising market has exhibited a gradual shift from second-price auctions to first-price auctions. Although there has been a line of works concerning online bidding strategies in first-price auctions, it still remains…

Computer Science and Game Theory · Computer Science 2022-05-31 Rui Ai , Chang Wang , Chenchen Li , Jinshan Zhang , Wenhan Huang , Xiaotie Deng

An important problem in sequential decision-making under uncertainty is to use limited data to compute a safe policy, i.e., a policy that is guaranteed to perform at least as well as a given baseline strategy. In this paper, we develop and…

Machine Learning · Statistics 2016-07-14 Marek Petrik , Yinlam Chow , Mohammad Ghavamzadeh

This work studies external regret in sequential prediction games with both positive and negative payoffs. External regret measures the difference between the payoff obtained by the forecasting strategy and the payoff of the best action. In…

Statistics Theory · Mathematics 2007-06-13 Nicolo Cesa-Bianchi , Yishay Mansour , Gilles Stoltz