English
Related papers

Related papers: Bandit Sequential Posted Pricing via Half-Concavit…

200 papers

We study regret minimization in repeated first-price auctions (FPAs), where a bidder observes only the realized outcome after each auction -- win or loss. This setup reflects practical scenarios in online display advertising where the…

Machine Learning · Computer Science 2026-03-19 Yuxiao Wen , Yanjun Han , Zhengyuan Zhou

We introduce and study a new class of stochastic bandit problems, referred to as predictive bandits. In each round, the decision maker first decides whether to gather information about the rewards of particular arms (so that their rewards…

Machine Learning · Computer Science 2020-04-03 Simon Lindståhl , Alexandre Proutiere , Andreas Johnsson

Linear contextual bandit is a popular online learning problem. It has been mostly studied in centralized learning settings. With the surging demand of large-scale decentralized model learning, e.g., federated learning, how to retain regret…

Machine Learning · Computer Science 2021-10-05 Chuanhao Li , Hongning Wang

This work addresses learning online fair division under uncertainty, where a central planner sequentially allocates items without precise knowledge of agents' values or utilities. Departing from conventional online algorithm, the planner…

Machine Learning · Computer Science 2023-11-16 Hakuei Yamada , Junpei Komiyama , Kenshi Abe , Atsushi Iwasaki

We consider combinatorial online learning with subset choices when only relative feedback information from subsets is available, instead of bandit or semi-bandit feedback which is absolute. Specifically, we study two regret minimisation…

Machine Learning · Computer Science 2020-02-28 Aadirupa Saha , Aditya Gopalan

Selling a single item to $n$ self-interested buyers is a fundamental problem in economics, where the two objectives typically considered are welfare maximization and revenue maximization. Since the optimal mechanisms are often impractical…

Computer Science and Game Theory · Computer Science 2024-11-06 Billy Jin , Thomas Kesselheim , Will Ma , Sahil Singla

We study sequential bilateral trade where sellers and buyers valuations are completely arbitrary (i.e., determined by an adversary). Sellers and buyers are strategic agents with private valuations for the good and the goal is to design a…

Computer Science and Game Theory · Computer Science 2024-10-11 Yossi Azar , Amos Fiat , Federico Fusco

Motivated by online retail, we consider the problem of selling one item (e.g., an ad slot) to two non-excludable buyers (say, a merchant and a brand). This problem captures, for example, situations where a merchant and a brand cooperatively…

Computer Science and Game Theory · Computer Science 2025-05-26 Gagan Aggarwal , Ashwinkumar Badanidiyuru , Paul Dütting , Federico Fusco

A line of recent work provides welfare guarantees of simple combinatorial auction formats, such as selling m items via simultaneous second price auctions (SiSPAs) (Christodoulou et al. 2008, Bhawalkar and Roughgarden 2011, Feldman et al.…

Computer Science and Game Theory · Computer Science 2016-04-07 Constantinos Daskalakis , Vasilis Syrgkanis

In a low-rank linear bandit problem, the reward of an action (represented by a matrix of size $d_1 \times d_2$) is the inner product between the action and an unknown low-rank matrix $\Theta^*$. We propose an algorithm based on a novel…

Machine Learning · Statistics 2020-10-20 Yangyi Lu , Amirhossein Meisami , Ambuj Tewari

In this paper, we study the stochastic version of the one-sided full information bandit problem, where we have $K$ arms $[K] = \{1, 2, \ldots, K\}$, and playing arm $i$ would gain reward from an unknown distribution for arm $i$ while…

Machine Learning · Computer Science 2019-06-21 Haoyu Zhao , Wei Chen

We study the problem of online dynamic pricing with two types of fairness constraints: a "procedural fairness" which requires the proposed prices to be equal in expectation among different groups, and a "substantive fairness" which requires…

Machine Learning · Computer Science 2022-09-27 Jianyu Xu , Dan Qiao , Yu-Xiang Wang

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

Machine Learning · Computer Science 2023-08-17 Mengfan Xu , Diego Klabjan

Most recommender systems recommend a list of items. The user examines the list, from the first item to the last, and often chooses the first attractive item and does not examine the rest. This type of user behavior can be modeled by the…

Machine Learning · Computer Science 2016-07-01 Shi Zong , Hao Ni , Kenny Sung , Nan Rosemary Ke , Zheng Wen , Branislav Kveton

We consider the problem of online allocation subject to a long-term fairness penalty. Contrary to existing works, however, we do not assume that the decision-maker observes the protected attributes -- which is often unrealistic in practice.…

Machine Learning · Computer Science 2023-12-05 Mathieu Molina , Nicolas Gast , Patrick Loiseau , Vianney Perchet

Peer prediction mechanisms are often adopted to elicit truthful contributions from crowd workers when no ground-truth verification is available. Recently, mechanisms of this type have been developed to incentivize effort exertion, in…

Computer Science and Game Theory · Computer Science 2016-12-05 Yang Liu , Yiling Chen

Bilateral trade models the task of intermediating between two strategic agents, a seller and a buyer, willing to trade a good for which they hold private valuations. We study this problem from the perspective of a broker, in a regret…

Computer Science and Game Theory · Computer Science 2025-09-29 Simone Di Gregorio , Paul Dütting , Federico Fusco , Chris Schwiegelshohn

This paper studies Vickrey first-price auctions under binary feedback. Leveraging the enhanced performance of machine learning algorithms, the new algorithm uses past information to improve the regret bounds of the BROAD-OMD algorithm.…

Machine Learning · Computer Science 2025-07-09 Jason Tandiary

We study repeated first-price auctions and general repeated Bayesian games between two players, where one player, the learner, employs a no-regret learning algorithm, and the other player, the optimizer, knowing the learner's algorithm,…

Computer Science and Game Theory · Computer Science 2024-02-14 Aviad Rubinstein , Junyao Zhao

Contextual bandit with linear reward functions is among one of the most extensively studied models in bandit and online learning research. Recently, there has been increasing interest in designing \emph{locally private} linear contextual…

Machine Learning · Statistics 2024-04-16 Jiachun Li , David Simchi-Levi , Yining Wang