English
Related papers

Related papers: Contextual Dynamic Pricing with Strategic Buyers

200 papers

The usage of automated learning agents is becoming increasingly prevalent in many online economic applications such as online auctions and automated trading. Motivated by such applications, this paper is dedicated to fundamental modeling…

Computer Science and Game Theory · Computer Science 2023-01-04 Yoav Kolumbus , Noam Nisan

In this study, we apply reinforcement learning techniques and propose what we call reinforcement mechanism design to tackle the dynamic pricing problem in sponsored search auctions. In contrast to previous game-theoretical approaches that…

Computer Science and Game Theory · Computer Science 2017-11-29 Weiran Shen , Binghui Peng , Hanpeng Liu , Michael Zhang , Ruohan Qian , Yan Hong , Zhi Guo , Zongyao Ding , Pengjun Lu , Pingzhong Tang

We consider the problem of a single seller repeatedly selling a single item to a single buyer (specifically, the buyer has a value drawn fresh from known distribution $D$ in every round). Prior work assumes that the buyer is fully rational…

Computer Science and Game Theory · Computer Science 2017-11-28 Mark Braverman , Jieming Mao , Jon Schneider , S. Matthew Weinberg

We study the impact of predictions in online Linear Quadratic Regulator control with both stochastic and adversarial disturbances in the dynamics. In both settings, we characterize the optimal policy and derive tight bounds on the minimum…

Optimization and Control · Mathematics 2021-01-11 Chenkai Yu , Guanya Shi , Soon-Jo Chung , Yisong Yue , Adam Wierman

Maximizing long-term rewards is the primary goal in sequential decision-making problems. The majority of existing methods assume that side information is freely available, enabling the learning agent to observe all features' states before…

Machine Learning · Computer Science 2023-07-19 Saeed Ghoorchian , Evgenii Kortukov , Setareh Maghsudi

This paper studies an online selection problem, where a seller seeks to sequentially sell multiple copies of an item to arriving buyers. We consider an adversarial setting, making no modeling assumptions about buyers' valuations for the…

Computer Science and Game Theory · Computer Science 2024-10-11 Bo Sun , Hossein Nekouyan Jazi , Xiaoqi Tan , Raouf Boutaba

We develop a decision making framework to cast the problem of learning a ranking policy for search or recommendation engines in a two-sided e-commerce marketplace as an expected reward optimization problem using observational data. As a…

Information Retrieval · Computer Science 2024-10-08 Ehsan Ebrahimzadeh , Nikhil Monga , Hang Gao , Alex Cozzi , Abraham Bagherjeiran

Real-world systems often involve some pool of users choosing between a set of services. With the increase in popularity of online learning algorithms, these services can now self-optimize, leveraging data collected on users to maximize some…

Machine Learning · Computer Science 2024-03-12 Eliot Shekhtman , Sarah Dean

In repeated interaction problems with adaptive agents, our objective often requires anticipating and optimizing over the space of possible agent responses. We show that many problems of this form can be cast as instances of online…

Machine Learning · Computer Science 2024-06-28 William Brown , Christos Papadimitriou , Tim Roughgarden

With the rise of the digital economy and an explosion of available information about consumers, effective personalization of goods and services has become a core business focus for companies to improve revenues and maintain a competitive…

Machine Learning · Computer Science 2022-11-04 Zhaonan Qu , Isabella Qian , Zhengyuan Zhou

We study a problem of an online retailer who observes the unit sales of a product, and dynamically changes the retail price, in order to maximize the expected revenue. Assuming the demand of the product is price sensitive, we are interested…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Chengcheng Liu , Mátyás A. Sustik

Environments with fixed adjustment costs such as transaction costs or \lq menu costs\rq$ $ are widespread within economic systems. The presence of fixed minimal adjustment costs produces adjustment stickiness so that agents must choose a…

Optimization and Control · Mathematics 2019-10-09 David Mguni

This paper studies the performative policy learning problem, where agents adjust their features in response to a released policy to improve their potential outcomes, inducing an endogenous distribution shift. There has been growing interest…

Machine Learning · Computer Science 2025-02-25 Qianyi Chen , Ying Chen , Bo Li

The contextual duelling bandit problem models adaptive recommender systems, where the algorithm presents a set of items to the user, and the user's choice reveals their preference. This setup is well suited for implicit choices users make…

Machine Learning · Computer Science 2025-08-27 Suryanarayana Sankagiri , Jalal Etesami , Pouria Fatemi , Matthias Grossglauser

The performance of an energy system under a real-time pricing mechanism depends on the consumption behavior of its customers, which involves uncertainties. In this paper, we consider a system operator that charges its customers with a…

Systems and Control · Computer Science 2016-11-17 Ceyhun Eksin , Hakan Delic , Alejandro Ribeiro

Motivated by online retail, we consider the problem of selling one item (e.g., an ad slot) to two non-excludable buyers (say, a merchant and a brand). This problem captures, for example, situations where a merchant and a brand cooperatively…

Computer Science and Game Theory · Computer Science 2025-05-26 Gagan Aggarwal , Ashwinkumar Badanidiyuru , Paul Dütting , Federico Fusco

We study the problem of agent selection in causal strategic learning under multiple decision makers and address two key challenges that come with it. Firstly, while much of prior work focuses on studying a fixed pool of agents that remains…

Artificial Intelligence · Computer Science 2024-02-06 Kiet Q. H. Vo , Muneeb Aadil , Siu Lun Chau , Krikamol Muandet

In this paper, the problem of optimal dynamic pricing for retail electricity with an unknown demand model is considered. Under the day-ahead dynamic pricing (a.k.a. real time pricing) mechanism, a retailer obtains electricity in a…

Optimization and Control · Mathematics 2014-04-07 Liyan Jia , Lang Tong , Qing Zhao

Internet advertisers (buyers) repeatedly procure ad impressions from ad platforms (sellers) with the aim to maximize total conversion (i.e. ad value) while respecting both budget and return-on-investment (ROI) constraints for efficient…

Computer Science and Game Theory · Computer Science 2023-02-08 Negin Golrezaei , Patrick Jaillet , Jason Cheuk Nam Liang , Vahab Mirrokni

We study the aggregate welfare and individual regret guarantees of dynamic \emph{pacing algorithms} in the context of repeated auctions with budgets. Such algorithms are commonly used as bidding agents in Internet advertising platforms,…

Computer Science and Game Theory · Computer Science 2026-01-06 Jason Gaitonde , Yingkai Li , Bar Light , Brendan Lucier , Aleksandrs Slivkins