English
Related papers

Related papers: Optimal Bidding Strategy without Exploration in Re…

200 papers

Reinforcement learning can greatly benefit from the use of options as a way of encoding recurring behaviours and to foster exploration. An important open problem is how can an agent autonomously learn useful options when solving particular…

Machine Learning · Computer Science 2020-01-07 Manuel Del Verme , Bruno Castro da Silva , Gianluca Baldassarre

Sponsored search in E-commerce platforms such as Amazon, Taobao and Tmall provides sellers an effective way to reach potential buyers with most relevant purpose. In this paper, we study the auction mechanism optimization problem in…

Computer Science and Game Theory · Computer Science 2018-08-02 Gang Bai , Zhihui Xie , Liang Wang

In this paper, we study the optimal stopping problem in the so-called exploratory framework, in which the agent takes actions randomly conditioning on current state and an entropy-regularized term is added to the reward functional. Such a…

Optimization and Control · Mathematics 2023-09-04 Yuchao Dong

We study the problem of auction design for advertising platforms that face strategic advertisers who are bidding across platforms. Each advertiser's goal is to maximize their total value or conversions while satisfying some constraint(s)…

Computer Science and Game Theory · Computer Science 2024-05-07 Gagan Aggarwal , Andres Perlroth , Ariel Schvartzman , Mingfei Zhao

A fundamental economic question is that of designing revenue-maximizing mechanisms in dynamic environments. This paper considers a simple yet compelling market model to tackle this question, where forward-looking buyers arrive at the market…

Theoretical Economics · Economics 2024-10-16 Jose Correa , Andres Cristi , Laura Vargas Koch

We consider the problem of bid prediction in repeated auctions and evaluate the performance of econometric methods for learning agents using a dataset from a mainstream sponsored search auction marketplace. Sponsored search auctions is a…

Computer Science and Game Theory · Computer Science 2020-11-02 Gali Noti , Vasilis Syrgkanis

The majority of online marketplaces offer promotion programs to sellers to acquire additional customers for their products. These programs typically allow sellers to allocate advertising budgets to promote their products, with higher…

Computer Science and Game Theory · Computer Science 2025-02-05 Anastasiia Soboleva , Alexander Ledovsky , Yuriy Dorn , Egor Samosvat , Andrey Tikhanov , Fyodor Prazdnikov

Optimal mechanisms have been provided in quite general multi-item settings, as long as each bidder's type distribution is given explicitly by listing every type in the support along with its associated probability. In the implicit setting,…

Computer Science and Game Theory · Computer Science 2015-03-09 Constantinos Daskalakis , Alan Deckelbaum , Christos Tzamos

Many scenarios where agents with restrictions compete for resources can be cast as maximum matching problems on bipartite graphs. Our focus is on resource allocation problems where agents may have restrictions that make them incompatible…

Artificial Intelligence · Computer Science 2022-09-13 Yohai Trabelsi , Abhijin Adiga , Sarit Kraus , S. S. Ravi

Bid shading plays a crucial role in Real-Time Bidding (RTB) by adaptively adjusting the bid to avoid advertisers overspending. Existing mainstream two-stage methods, which first model bid landscapes and then optimize surplus using…

Computer Science and Game Theory · Computer Science 2026-04-30 Yinqiu Huang , Hao Ma , Wenshuai Chen , Zongwei Wang , Shuli Wang , Yongqiang Zhang , Xue Wei , Yinhua Zhu , Haitao Wang , Xingxing Wang

Online bidding is a classic optimization problem, with several applications in online decision-making, the design of interruptible systems, and the analysis of approximation algorithms. In this work, we study online bidding under…

Computer Science and Game Theory · Computer Science 2025-10-30 Spyros Angelopoulos , Bertrand Simon

When deploying artificial agents in real-world environments where they interact with humans, it is crucial that their behavior is aligned with the values, social norms or other requirements of that environment. However, many environments…

Machine Learning · Computer Science 2023-05-05 Mattijs Baert , Pietro Mazzaglia , Sam Leroux , Pieter Simoens

Real-time bidding, as one of the most popular mechanisms for selling online ad slots, facilitates advertisers to reach their potential customers. The goal of bidding optimization is to maximize the advertisers' return on investment (ROI)…

Computer Science and Game Theory · Computer Science 2019-03-01 Manxing Du , Alexander I. Cowen-Rivers , Ying Wen , Phu Sakulwongtana , Jun Wang , Mats Brorsson , Radu State

There are two major ways of selling impressions in display advertising. They are either sold in spot through auction mechanisms or in advance via guaranteed contracts. The former has achieved a significant automation via real-time bidding…

Computer Science and Game Theory · Computer Science 2015-12-11 Bowei Chen , Shuai Yuan , Jun Wang

Online advertising in E-commerce platforms provides sellers an opportunity to achieve potential audiences with different target goals. Ad serving systems (like display and search advertising systems) that assign ads to pages should satisfy…

Machine Learning · Computer Science 2019-10-09 Chao Wei , Weiru Zhang , Shengjie Sun , Fei Li , Xiaonan Meng , Yi Hu , Hao Wang

Real time bidding (RTB) enables demand side platforms (bidders) to scale ad campaigns across multiple publishers affiliated to an RTB ad exchange. While driving multiple campaigns for mobile app install ads via RTB, the bidder typically has…

Computer Science and Game Theory · Computer Science 2018-11-13 Anit Kumar Sahu , Shaunak Mishra , Narayan Bhamidipati

Algorithms increasingly automate bidding in online auctions, raising concerns about tacit bid suppression and revenue shortfalls. Prior work identifies individual mechanisms behind algorithmic bid suppression, but it remains unclear which…

General Economics · Economics 2026-03-24 Pranjal Rawat

In this work, we investigate the online learning problem of revenue maximization in ad auctions, where the seller needs to learn the click-through rates (CTRs) of each ad candidate and charge the price of the winner through a pay-per-click…

Information Retrieval · Computer Science 2024-03-05 Zhe Feng , Christopher Liaw , Zixin Zhou

In online advertising, the inherent complexity and dynamic nature of advertising environments necessitate the use of auto-bidding services to assist advertisers in bid optimization. This complexity is further compounded in multi-channel…

Artificial Intelligence · Computer Science 2026-02-27 Xinxin Yang , Yangyang Tang , Yikun Zhou , Yaolei Liu , Yun Li , Bo Yang

Internet live streaming is widely used in online entertainment and e-commerce, where live advertising is an important marketing tool for anchors. An advertising campaign hopes to maximize the effect (such as conversions) under constraints…

Machine Learning · Statistics 2025-08-11 Bo Yang , Ruixuan Luo , Junqi Jin , Han Zhu