English
Related papers

Related papers: JD-BP: A Joint-Decision Generative Framework for A…

200 papers

In this paper, we study the problem of learning to bid in repeated first-price auctions with budget constraints. In each period, the decision maker needs to submit a bid to win the auction and maximize the total collected reward, subject to…

Optimization and Control · Mathematics 2026-03-10 Zeng Fu , Jiashuo Jiang , Yuan Zhou

In programmatic advertising, ad slots are usually sold using second-price (SP) auctions in real-time. The highest bidding advertiser wins but pays only the second-highest bid (known as the winning price). In SP, for a single item, the…

Machine Learning · Computer Science 2020-01-22 Aritra Ghosh , Saayan Mitra , Somdeb Sarkhel , Jason Xie , Gang Wu , Viswanathan Swaminathan

Online bidding serves as a fundamental information system in mobile ecosystems, facilitating real-time ad allocation across billions of devices while optimizing both platform performance and user experience through data-driven decision…

Computer Science and Game Theory · Computer Science 2026-01-07 Huanyu Yan , Yu Huo , Min Lu , Weitong Ou , Xingyan Shi , Ruihe Shi , Xiaoying Tang

Over the past decade, bidding in power markets has attracted widespread attention. Reinforcement Learning (RL) has been widely used for power market bidding as a powerful AI tool to make decisions under real-world uncertainties. However,…

Machine Learning · Computer Science 2024-10-16 Jinyu Liu , Hongye Guo , Yun Li , Qinghu Tang , Fuquan Huang , Tunan Chen , Haiwang Zhong , Qixin Chen

Text-to-image generation models have achieved remarkable progress in preference optimization, yet achieving robust alignment across diverse reward models remains a significant challenge. Existing multi-reward fusion approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Ying Ba , Tianyu Zhang , Mohan Zhou , Yalong Bai , Wenyi Mo , Guiwei Zhang , Bing Su , Ji-Rong Wen

We study the aggregate welfare and individual regret guarantees of dynamic \emph{pacing algorithms} in the context of repeated auctions with budgets. Such algorithms are commonly used as bidding agents in Internet advertising platforms,…

Computer Science and Game Theory · Computer Science 2026-01-06 Jason Gaitonde , Yingkai Li , Bar Light , Brendan Lucier , Aleksandrs Slivkins

We study the problem of finding the optimal bidding strategy for an advertiser in a multi-platform auction setting. The competition on a platform is captured by a value and a cost function, mapping bidding strategies to value and cost…

Computer Science and Game Theory · Computer Science 2025-02-27 Gagan Aggarwal , Anupam Gupta , Xizhi Tan , Mingfei Zhao

Group-buying ads seeking a minimum number of customers before the deal expiry are increasingly used by the daily-deal providers. Unlike the traditional web ads, the advertiser's profits for group-buying ads depends on the time to expiry and…

Computer Science and Game Theory · Computer Science 2012-06-05 Raju Balakrishnan , Rushi P Bhatt

Auction-based recommender systems are prevalent in online advertising platforms, but they are typically optimized to allocate recommendation slots based on immediate expected return metrics, neglecting the downstream effects of…

Information Retrieval · Computer Science 2023-08-01 Ruiyang Xu , Jalaj Bhandari , Dmytro Korenkevych , Fan Liu , Yuchen He , Alex Nikulkov , Zheqing Zhu

We propose a new Markov Decision Process (MDP) model for ad auctions to capture the user response to the quality of ads, with the objective of maximizing the long-term discounted revenue. By incorporating user response, our model takes into…

Computer Science and Game Theory · Computer Science 2024-05-07 Yang Cai , Zhe Feng , Christopher Liaw , Aranyak Mehta , Grigoris Velegkas

Recently the online advertising market has exhibited a gradual shift from second-price auctions to first-price auctions. Although there has been a line of works concerning online bidding strategies in first-price auctions, it still remains…

Computer Science and Game Theory · Computer Science 2022-05-31 Rui Ai , Chang Wang , Chenchen Li , Jinshan Zhang , Wenhan Huang , Xiaotie Deng

In this paper, we develop a new method for finding an optimal biddingstrategy in sequential auctions, using a dynamic programming technique. Theexisting method assumes that the utility of a user is represented in anadditive form. Thus, the…

Computer Science and Game Theory · Computer Science 2013-01-14 Hiromitsu Hattori , Makoto Yokoo , Yuko Sakurai , Toramatsu Shintani

This paper studies Vickrey first-price auctions under binary feedback. Leveraging the enhanced performance of machine learning algorithms, the new algorithm uses past information to improve the regret bounds of the BROAD-OMD algorithm.…

Machine Learning · Computer Science 2025-07-09 Jason Tandiary

In display ad auctions of Real-Time Bid-ding (RTB), a typical Demand-Side Platform (DSP)bids based on the predicted probability of click and conversion right after an ad impression. Recent studies find such a strategy is suboptimal and…

Information Retrieval · Computer Science 2022-03-01 Daisuke Moriwaki , Yuta Hayakawa , Akira Matsui , Yuta Saito , Isshu Munemasa , Masashi Shibata

In the Real-Time Bidding (RTB), advertisers are increasingly relying on bid optimization to gain more conversions (i.e trade or arrival). Currently, the efficiency of bid optimization is still challenged by the (1) sparse feedback, (2) the…

Computer Science and Game Theory · Computer Science 2022-06-28 Xiao Wang , Shaoguo Liu , Yidong Jia , Yuxin Fu , Yufang Yu , Liang Wang , Bo Zheng

Real-time bidding (RTB) has become a critical way of online advertising. In RTB, an advertiser can participate in bidding ad impressions to display its advertisements. The advertiser determines every impression's bidding price according to…

Machine Learning · Computer Science 2021-10-12 Mengjuan Liu , Jinyu Liu , Zhengning Hu , Yuchen Ge , Xuyun Nie

Internet live streaming is widely used in online entertainment and e-commerce, where live advertising is an important marketing tool for anchors. An advertising campaign hopes to maximize the effect (such as conversions) under constraints…

Machine Learning · Statistics 2025-08-11 Bo Yang , Ruixuan Luo , Junqi Jin , Han Zhu

First-price auctions have largely replaced traditional bidding approaches based on Vickrey auctions in programmatic advertising. As far as learning is concerned, first-price auctions are more challenging because the optimal bidding strategy…

Machine Learning · Computer Science 2021-11-23 Juliette Achddou , Olivier Cappé , Aurélien Garivier

Internet advertisers (buyers) repeatedly procure ad impressions from ad platforms (sellers) with the aim to maximize total conversion (i.e. ad value) while respecting both budget and return-on-investment (ROI) constraints for efficient…

Computer Science and Game Theory · Computer Science 2023-02-08 Negin Golrezaei , Patrick Jaillet , Jason Cheuk Nam Liang , Vahab Mirrokni

In online ad markets, a rising number of advertisers are employing bidding agencies to participate in ad auctions. These agencies are specialized in designing online algorithms and bidding on behalf of their clients. Typically, an agency…

Computer Science and Game Theory · Computer Science 2023-06-14 Yurong Chen , Qian Wang , Zhijian Duan , Haoran Sun , Zhaohua Chen , Xiang Yan , Xiaotie Deng