English
Related papers

Related papers: MoTiAC: Multi-Objective Actor-Critics for Real-Tim…

200 papers

Bid optimization for online advertising from single advertiser's perspective has been thoroughly investigated in both academic research and industrial practice. However, existing work typically assume competitors do not change their bids,…

Artificial Intelligence · Computer Science 2021-06-09 Ziyu Guan , Hongchang Wu , Qingyu Cao , Hao Liu , Wei Zhao , Sheng Li , Cai Xu , Guang Qiu , Jian Xu , Bo Zheng

Real-Time Bidding (RTB) enables advertisers to place competitive bids on impression opportunities instantaneously, striving for cost-effectiveness in a highly competitive landscape. Although RTB has widely benefited from the utilization of…

Artificial Intelligence · Computer Science 2025-02-04 Leng Cai , Junxuan He , Yikai Li , Junjie Liang , Yuanping Lin , Ziming Quan , Yawen Zeng , Jin Xu

Today, billions of display ad impressions are purchased on a daily basis through a public auction hosted by real time bidding (RTB) exchanges. A decision has to be made for advertisers to submit a bid for each selected RTB ad request in…

Computer Science and Game Theory · Computer Science 2013-05-15 Kuang-Chih Lee , Ali Jalali , Ali Dasdan

In online display advertising, guaranteed contracts and real-time bidding (RTB) are two major ways to sell impressions for a publisher. For large publishers, simultaneously selling impressions through both guaranteed contracts and in-house…

Computer Science and Game Theory · Computer Science 2022-03-15 Di Wu , Cheng Chen , Xiujun Chen , Junwei Pan , Xun Yang , Qing Tan , Jian Xu , Kuang-Chih Lee

In online display advertising, guaranteed contracts and real-time bidding (RTB) are two major ways to sell impressions for a publisher. Despite the increasing popularity of RTB, there is still half of online display advertising revenue…

Artificial Intelligence · Computer Science 2018-09-11 Di Wu , Cheng Chen , Xun Yang , Xiujun Chen , Qing Tan , Jian Xu , Kun Gai

In the Real-Time Bidding (RTB), advertisers are increasingly relying on bid optimization to gain more conversions (i.e trade or arrival). Currently, the efficiency of bid optimization is still challenged by the (1) sparse feedback, (2) the…

Computer Science and Game Theory · Computer Science 2022-06-28 Xiao Wang , Shaoguo Liu , Yidong Jia , Yuxin Fu , Yufang Yu , Liang Wang , Bo Zheng

Digital advertising platforms operate millisecond-level auctions through Real-Time Bidding (RTB) systems, where advertisers compete for ad impressions through algorithmic bids. This dynamic mechanism enables precise audience targeting but…

Machine Learning · Computer Science 2025-08-11 Pusen Dong , Chenglong Cao , Xinyu Zhou , Jirong You , Linhe Xu , Feifan Xu , Shuo Yuan

Traditional Reinforcement Learning (RL) policies are typically implemented with fixed control rates, often disregarding the impact of control rate selection. This can lead to inefficiencies as the optimal control rate varies with task…

Robotics · Computer Science 2024-08-13 Dong Wang , Giovanni Beltrame

Multi-task reinforcement learning (MTRL) has shown great promise in many real-world applications. Existing MTRL algorithms often aim to learn a policy that optimizes individual objective functions simultaneously with a given prior…

Machine Learning · Computer Science 2024-12-24 Yudan Wang , Peiyao Xiao , Hao Ban , Kaiyi Ji , Shaofeng Zou

Incrementality, which is used to measure the causal effect of showing an ad to a potential customer (e.g. a user in an internet platform) versus not, is a central object for advertisers in online advertising platforms. This paper…

Machine Learning · Computer Science 2023-01-18 Ashwinkumar Badanidiyuru , Zhe Feng , Tianxi Li , Haifeng Xu

Real-time bidding (RTB) has become a major paradigm of display advertising. Each ad impression generated from a user visit is auctioned in real time, where demand-side platform (DSP) automatically provides bid price usually relying on the…

Information Retrieval · Computer Science 2022-12-26 Zhimeng Jiang , Kaixiong Zhou , Mi Zhang , Rui Chen , Xia Hu , Soo-Hyun Choi

The optimization of bidding strategies for online advertising slot auctions presents a critical challenge across numerous digital marketplaces. A significant obstacle to the development, evaluation, and refinement of real-time autobidding…

Markov Decision Processes (MDPs), the mathematical framework underlying most algorithms in Reinforcement Learning (RL), are often used in a way that wrongfully assumes that the state of an agent's environment does not change during action…

Machine Learning · Computer Science 2019-12-13 Simon Ramstedt , Christopher Pal

In this work, we investigate the online learning problem of revenue maximization in ad auctions, where the seller needs to learn the click-through rates (CTRs) of each ad candidate and charge the price of the winner through a pay-per-click…

Information Retrieval · Computer Science 2024-03-05 Zhe Feng , Christopher Liaw , Zixin Zhou

Displaying banner advertisements (in short, ads) on webpages has usually been discussed as an Internet economics topic where a publisher uses auction models to sell an online user's page view to advertisers and the one with the highest bid…

Computer Science and Game Theory · Computer Science 2017-08-02 Xiang Chen , Bowei Chen , Mohan Kankanhalli

Substantial advancements to model-based reinforcement learning algorithms have been impeded by the model-bias induced by the collected data, which generally hurts performance. Meanwhile, their inherent sample efficiency warrants utility for…

This paper describes an engine to optimize web publisher revenues from second-price auctions. These auctions are widely used to sell online ad spaces in a mechanism called real-time bidding (RTB). Optimization within these auctions is…

Computer Science and Game Theory · Computer Science 2020-06-15 Pedro Chahuara , Nicolas Grislain , Grégoire Jauvion , Jean-Michel Renders

Algorithmic trading refers to executing buy and sell orders for specific assets based on automatically identified trading opportunities. Strategies based on reinforcement learning (RL) have demonstrated remarkable capabilities in addressing…

Trading and Market Microstructure · Quantitative Finance 2024-07-03 Xi Cheng , Jinghao Zhang , Yunan Zeng , Wenfang Xue

Managing millions of digital auctions is an essential task for modern advertising auction systems. The main approach to managing digital auctions is an autobidding approach, which depends on the Click-Through Rate and Conversion Rate…

Computer Science and Game Theory · Computer Science 2025-10-13 Andrey Pudovikov , Alexandra Khirianova , Ekaterina Solodneva , Gleb Molodtsov , Aleksandr Katrutsa , Yuriy Dorn , Egor Samosvat

Real-Time Bidding is nowadays one of the most promising systems in the online advertising ecosystem. In the presented study, the performance of RTB campaigns is improved by optimising the parameters of the users' profiles and the…

Machine Learning · Computer Science 2019-10-30 Luis Miralles , M. Atif Qureshi , Brian Mac Namee