English
Related papers

Related papers: Improving Real-Time Bidding in Online Advertising …

200 papers

Standard Markov decision process (MDP) and reinforcement learning algorithms optimize the policy with respect to the expected gain. We propose an algorithm which enables to optimize an alternative objective: the probability that the gain is…

Machine Learning · Computer Science 2023-03-06 Vincent Corlay , Jean-Christophe Sibel

In many repeated auction settings, participants care not only about how frequently they win but also how their winnings are distributed over time. This problem arises in various practical domains where avoiding congested demand is crucial,…

Computer Science and Game Theory · Computer Science 2025-06-13 Giannis Fikioris , Robert Kleinberg , Yoav Kolumbus , Raunak Kumar , Yishay Mansour , Éva Tardos

Bid shading plays a crucial role in Real-Time Bidding (RTB) by adaptively adjusting the bid to avoid advertisers overspending. Existing mainstream two-stage methods, which first model bid landscapes and then optimize surplus using…

Computer Science and Game Theory · Computer Science 2026-04-30 Yinqiu Huang , Hao Ma , Wenshuai Chen , Zongwei Wang , Shuli Wang , Yongqiang Zhang , Xue Wei , Yinhua Zhu , Haitao Wang , Xingxing Wang

In online advertising, recommender systems try to propose items from a list of products to potential customers according to their interests. Such systems have been increasingly deployed in E-commerce due to the rapid growth of information…

Artificial Intelligence · Computer Science 2021-02-02 Milad Vaali Esfahaani , Yanbo Xue , Peyman Setoodeh

The emergence of real-time auction in online advertising has drawn huge attention of modeling the market competition, i.e., bid landscape forecasting. The problem is formulated as to forecast the probability distribution of market price for…

Information Retrieval · Computer Science 2019-05-14 Kan Ren , Jiarui Qin , Lei Zheng , Zhengyu Yang , Weinan Zhang , Yong Yu

Online bidding serves as a fundamental information system in mobile ecosystems, facilitating real-time ad allocation across billions of devices while optimizing both platform performance and user experience through data-driven decision…

Computer Science and Game Theory · Computer Science 2026-01-07 Huanyu Yan , Yu Huo , Min Lu , Weitong Ou , Xingyan Shi , Ruihe Shi , Xiaoying Tang

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Machine Learning · Computer Science 2019-06-28 Xiangyu Zhao , Liang Zhang , Long Xia , Zhuoye Ding , Dawei Yin , Jiliang Tang

Inspired by the developments in deep generative models, we propose a model-based RL approach, coined Reinforced Deep Markov Model (RDMM), designed to integrate desirable properties of a reinforcement learning algorithm acting as an…

Trading and Market Microstructure · Quantitative Finance 2020-11-10 Tadeu A. Ferreira

Artificial intelligence algorithms are increasingly used by firms to set prices. Previous research shows that they can exhibit collusive behaviour, but how quickly they can do so has so far remained an open question. I show that a modern…

General Economics · Economics 2026-04-20 Kevin Michael Frick

Online advertising has recently grown into a highly competitive and complex multi-billion-dollar industry, with advertisers bidding for ad slots at large scales and high frequencies. This has resulted in a growing need for efficient…

Machine Learning · Computer Science 2023-07-04 Zhe Feng , Swati Padmanabhan , Di Wang

Advertisers usually enjoy the flexibility to choose criteria like target audience, geographic area and bid price when planning an campaign for online display advertising, while they lack forecast information on campaign performance to…

Machine Learning · Computer Science 2022-02-25 Jun Chen , Cheng Chen , Huayue Zhang , Qing Tan

Simultaneous ascending auctions present agents with the exposure problem: bidding to acquire a bundle risks the possibility of obtaining an undesired subset of the goods. Auction theory provides little guidance for dealing with this…

Computer Science and Game Theory · Computer Science 2012-07-09 Anna Osepayshvili , Michael P. Wellman , Daniel Reeves , Jeffrey K. MacKie-Mason

Optimal designs are usually model-dependent and likely to be sub-optimal if the postulated model is not correctly specified. In practice, it is common that a researcher has a list of candidate models at hand and a design has to be found…

Statistics Theory · Mathematics 2023-03-29 Mingyao Ai , Holger Dette , Zhengfu Liu , Jun Yu

This paper develops a novel multi-agent reinforcement learning (MARL) framework for reinsurance treaty bidding, addressing long-standing inefficiencies in traditional broker-mediated placement processes. We pose the core research question:…

Artificial Intelligence · Computer Science 2026-03-24 Stella C. Dong , James R. Finlay

Accurate prediction of house price, a vital aspect of the residential real estate sector, is of substantial interest for a wide range of stakeholders. However, predicting house prices is a complex task due to the significant variability…

Machine Learning · Computer Science 2024-09-10 Md Hasebul Hasan , Md Abid Jahan , Mohammed Eunus Ali , Yuan-Fang Li , Timos Sellis

The $\textit{data market design}$ problem is a problem in economic theory to find a set of signaling schemes (statistical experiments) to maximize expected revenue to the information seller, where each experiment reveals some of the…

Computer Science and Game Theory · Computer Science 2023-11-01 Sai Srivatsa Ravindranath , Yanchen Jiang , David C. Parkes

Auto-bidding is widely used in advertising systems, serving a diverse range of advertisers. Generative bidding is increasingly gaining traction due to its strong planning capabilities and generalizability. Unlike traditional reinforcement…

Machine Learning · Computer Science 2025-08-26 Yunshan Peng , Wenzheng Shu , Jiahao Sun , Yanxiang Zeng , Jinan Pang , Wentao Bai , Yunke Bai , Xialong Liu , Peng Jiang

In this work, we investigate the online learning problem of revenue maximization in ad auctions, where the seller needs to learn the click-through rates (CTRs) of each ad candidate and charge the price of the winner through a pay-per-click…

Information Retrieval · Computer Science 2024-03-05 Zhe Feng , Christopher Liaw , Zixin Zhou

Wind power producers (WPPs) participating in short-term power markets face significant imbalance costs due to their non-dispatchable and variable production. While some WPPs have a large enough market share to influence prices with their…

Machine Learning · Computer Science 2026-03-12 Shobhit Singhal , Marta Fochesato , Liviu Aolaritei , Florian Dörfler

We study the problem of learning to bid when the bidder's value is dynamic, i.e., when the current value depends on past outcomes. Specifically, we consider a bidder participating in repeated second-price auctions whose value depends on the…

Machine Learning · Computer Science 2026-05-28 Benjamin Heymann , Otmane Sakhi