English
Related papers

Related papers: ROI-Constrained Bidding via Curriculum-Guided Baye…

200 papers

Online Real-Time Bidding (RTB) is a complex auction game among which advertisers struggle to bid for ad impressions when a user request occurs. Considering display cost, Return on Investment (ROI), and other influential Key Performance…

Artificial Intelligence · Computer Science 2022-07-07 Haolin Zhou , Chaoqi Yang , Xiaofeng Gao , Qiong Chen , Gongshen Liu , Guihai Chen

Recently, auto-bidding technique has become an essential tool to increase the revenue of advertisers. Facing the complex and ever-changing bidding environments in the real-world advertising system (RAS), state-of-the-art auto-bidding…

Machine Learning · Computer Science 2022-10-14 Zhiyu Mou , Yusen Huo , Rongquan Bai , Mingzhou Xie , Chuan Yu , Jian Xu , Bo Zheng

Over the past decade, bidding in power markets has attracted widespread attention. Reinforcement Learning (RL) has been widely used for power market bidding as a powerful AI tool to make decisions under real-world uncertainties. However,…

Machine Learning · Computer Science 2024-10-16 Jinyu Liu , Hongye Guo , Yun Li , Qinghu Tang , Fuquan Huang , Tunan Chen , Haiwang Zhong , Qixin Chen

Real-time bidding is the new paradigm of programmatic advertising. An advertiser wants to make the intelligent choice of utilizing a \textbf{Demand-Side Platform} to improve the performance of their ad campaigns. Existing approaches are…

Artificial Intelligence · Computer Science 2022-09-14 Yining Lu , Changjie Lu , Naina Bandyopadhyay , Manoj Kumar , Gaurav Gupta

Real-Time Bidding (RTB) display advertising is a method for purchasing display advertising inventory in auctions that occur within milliseconds. The performance of RTB campaigns is generally measured with a series of Key Performance…

Computer Science and Game Theory · Computer Science 2020-07-02 Michael Tashman , Jiayi Xie , John Hoffman , Lee Winikor , Rouzbeh Gerami

Managing millions of digital auctions is an essential task for modern advertising auction systems. The main approach to managing digital auctions is an autobidding approach, which depends on the Click-Through Rate and Conversion Rate…

Computer Science and Game Theory · Computer Science 2025-10-13 Andrey Pudovikov , Alexandra Khirianova , Ekaterina Solodneva , Gleb Molodtsov , Aleksandr Katrutsa , Yuriy Dorn , Egor Samosvat

Reinforcement Learning from Verifiable Rewards (RLVR) suffers from exploration inefficiency, where models struggle to generate successful rollouts, resulting in minimal learning signal. This challenge is particularly severe for tasks that…

Machine Learning · Computer Science 2026-03-20 Saaket Agashe , Jayanth Srinivasa , Gaowen Liu , Ramana Kompella , Xin Eric Wang

The ad-trading desks of media-buying agencies are increasingly relying on complex algorithms for purchasing advertising inventory. In particular, Real-Time Bidding (RTB) algorithms respond to many auctions -- usually Vickrey auctions --…

Optimization and Control · Mathematics 2016-06-20 Joaquin Fernandez-Tapia , Olivier Guéant , Jean-Michel Lasry

We consider the problem of bidding in online advertising, where an advertiser aims to maximize value while adhering to budget and Return-on-Spend (RoS) constraints. Unlike prior work that assumes knowledge of the value generated by winning…

Machine Learning · Computer Science 2025-03-06 Sushant Vijayan , Zhe Feng , Swati Padmanabhan , Karthikeyan Shanmugam , Arun Suggala , Di Wang

Internet advertisers (buyers) repeatedly procure ad impressions from ad platforms (sellers) with the aim to maximize total conversion (i.e. ad value) while respecting both budget and return-on-investment (ROI) constraints for efficient…

Computer Science and Game Theory · Computer Science 2023-02-08 Negin Golrezaei , Patrick Jaillet , Jason Cheuk Nam Liang , Vahab Mirrokni

Auto-bidding plays a crucial role in facilitating online advertising by automatically providing bids for advertisers. Reinforcement learning (RL) has gained popularity for auto-bidding. However, most current RL auto-bidding methods are…

Machine Learning · Computer Science 2024-10-10 Jiayan Guo , Yusen Huo , Zhilin Zhang , Tianyu Wang , Chuan Yu , Jian Xu , Yan Zhang , Bo Zheng

We utilize an offline reinforcement learning (RL) model for sequential targeted promotion in the presence of budget constraints in a real-world business environment. In our application, the mobile app aims to boost customer retention by…

Machine Learning · Computer Science 2022-07-19 Fanglin Chen , Xiao Liu , Bo Tang , Feiyu Xiong , Serim Hwang , Guomian Zhuang

In this work, we investigate the online learning problem of revenue maximization in ad auctions, where the seller needs to learn the click-through rates (CTRs) of each ad candidate and charge the price of the winner through a pay-per-click…

Information Retrieval · Computer Science 2024-03-05 Zhe Feng , Christopher Liaw , Zixin Zhou

We consider un-discounted reinforcement learning (RL) in Markov decision processes (MDPs) under drifting non-stationarity, i.e., both the reward and state transition distributions are allowed to evolve over time, as long as their respective…

Machine Learning · Computer Science 2020-06-26 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

In online advertising, advertisers participate in ad auctions to acquire ad opportunities, often by utilizing auto-bidding tools provided by demand-side platforms (DSPs). The current auto-bidding algorithms typically employ reinforcement…

Machine Learning · Computer Science 2024-04-09 Haoming Li , Yusen Huo , Shuai Dou , Zhenzhe Zheng , Zhilin Zhang , Chuan Yu , Jian Xu , Fan Wu

Auto-bidding systems are widely used in advertising to automatically determine bid values under constraints such as total budget and Return-on-Spend (RoS) targets. Existing works often assume that the value of an ad impression, such as the…

Machine Learning · Computer Science 2026-02-03 Jiale Han , Chun Gan , Chengcheng Zhang , Jie He , Zhangang Lin , Ching Law , Xiaowu Dai

Real-time bidding (RTB) has become a new norm in display advertising where a publisher uses auction models to sell online user's page view to advertisers. In RTB, the ad with the highest bid price will be displayed to the user. This ad…

Computer Science and Game Theory · Computer Science 2018-05-23 Xiang Chen

Real-time advertising allows advertisers to bid for each impression for a visiting user. To optimize specific goals such as maximizing revenue and return on investment (ROI) led by ad placements, advertisers not only need to estimate the…

Machine Learning · Statistics 2018-11-02 Junqi Jin , Chengru Song , Han Li , Kun Gai , Jun Wang , Weinan Zhang

In computational advertising, a challenging problem is how to recommend the bid for advertisers to achieve the best return on investment (ROI) given budget constraint. This paper presents a bid recommendation scenario that discovers the…

Information Retrieval · Computer Science 2022-12-29 Deguang Kong , Konstantin Shmakov , Jian Yang

Real-Time Bidding is nowadays one of the most promising systems in the online advertising ecosystem. In the presented study, the performance of RTB campaigns is improved by optimising the parameters of the users' profiles and the…

Machine Learning · Computer Science 2019-10-30 Luis Miralles , M. Atif Qureshi , Brian Mac Namee