English
Related papers

Related papers: Deep Reinforcement Learning for Sponsored Search R…

200 papers

With the continuous development of machine learning technology, major e-commerce platforms have launched recommendation systems based on it to serve a large number of customers with different needs more efficiently. Compared with…

Machine Learning · Computer Science 2020-12-14 Yang Yu , Zhenhao Gu , Rong Tao , Jingtian Ge , Kenglun Chang

Auction-based recommender systems are prevalent in online advertising platforms, but they are typically optimized to allocate recommendation slots based on immediate expected return metrics, neglecting the downstream effects of…

Information Retrieval · Computer Science 2023-08-01 Ruiyang Xu , Jalaj Bhandari , Dmytro Korenkevych , Fan Liu , Yuchen He , Alex Nikulkov , Zheqing Zhu

Online advertising platforms use automated auctions to connect advertisers with potential customers, requiring effective bidding strategies to maximize profits. Accurate ad impact estimation requires considering three key factors: delayed…

Machine Learning · Computer Science 2025-10-24 Yuwei Cheng , Zifeng Zhao , Haifeng Xu

Being an emerging paradigm for display advertising, Real-Time Bidding (RTB) drives the focus of the bidding strategy from context to users' interest by computing a bid for each impression in real time. The data mining work and particularly…

Computer Science and Game Theory · Computer Science 2015-05-22 Weinan Zhang , Shuai Yuan , Jun Wang , Xuehua Shen

Real-time Bidding (RTB) advertisers wish to \textit{know in advance} the expected cost and yield of ad campaigns to avoid trial-and-error expenses. However, Campaign Performance Forecasting (CPF), a sequence modeling task involving tens of…

Information Retrieval · Computer Science 2024-05-20 XiaoYu Wang , YongHui Guo , Hui Sheng , Peili Lv , Chi Zhou , Wei Huang , ShiQin Ta , Dongbo Huang , XiuJin Yang , Lan Xu , Hao Zhou , Yusheng Ji

Real-Time Bidding is nowadays one of the most promising systems in the online advertising ecosystem. In the presented study, the performance of RTB campaigns is improved by optimising the parameters of the users' profiles and the…

Machine Learning · Computer Science 2019-10-30 Luis Miralles , M. Atif Qureshi , Brian Mac Namee

In online advertising, display ads are increasingly being placed based on real-time auctions where the advertiser who wins gets to serve the ad. This is called real-time bidding (RTB). In RTB, auctions have very tight time constraints on…

Machine Learning · Statistics 2014-05-14 Bjarne Ørum Fruergaard , Toke Jansen Hansen , Lars Kai Hansen

We study the online learning problem of a bidder who participates in repeated auctions. With the goal of maximizing his T-period payoff, the bidder determines the optimal allocation of his budget among his bids for $K$ goods at each period.…

Computer Science and Game Theory · Computer Science 2017-11-20 Sevi Baltaoglu , Lang Tong , Qing Zhao

Display advertising is an important online advertising type where banner advertisements (shortly ad) on websites are usually measured by how many times they are viewed by online users. There are two major channels to sell ad views. They can…

Computer Science and Game Theory · Computer Science 2017-01-20 Bowei Chen

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

Since 2019, most ad exchanges and sell-side platforms (SSPs), in the online advertising industry, shifted from second to first price auctions. Due to the fundamental difference between these auctions, demand-side platforms (DSPs) have had…

Online display advertising platforms service numerous advertisers by providing real-time bidding (RTB) for the scale of billions of ad requests every day. The bidding strategy handles ad requests cross multiple channels to maximize the…

Machine Learning · Computer Science 2024-08-21 Hao Wang , Bo Tang , Chi Harold Liu , Shangqin Mao , Jiahong Zhou , Zipeng Dai , Yaqi Sun , Qianlong Xie , Xingxing Wang , Dong Wang

Bid shading plays a crucial role in Real-Time Bidding (RTB) by adaptively adjusting the bid to avoid advertisers overspending. Existing mainstream two-stage methods, which first model bid landscapes and then optimize surplus using…

Computer Science and Game Theory · Computer Science 2026-04-30 Yinqiu Huang , Hao Ma , Wenshuai Chen , Zongwei Wang , Shuli Wang , Yongqiang Zhang , Xue Wei , Yinhua Zhu , Haitao Wang , Xingxing Wang

Tradable credit schemes (TCS) are an increasingly studied alternative to congestion pricing, given their revenue neutrality and ability to address issues of equity through the initial credit allocation. Modeling TCS to aid future design and…

Machine Learning · Computer Science 2025-04-14 Xiaoyi Wu , Ravi Seshadri , Filipe Rodrigues , Carlos Lima Azevedo

Recently, auto-bidding technique has become an essential tool to increase the revenue of advertisers. Facing the complex and ever-changing bidding environments in the real-world advertising system (RAS), state-of-the-art auto-bidding…

Machine Learning · Computer Science 2022-10-14 Zhiyu Mou , Yusen Huo , Rongquan Bai , Mingzhou Xie , Chuan Yu , Jian Xu , Bo Zheng

Online advertising in recommendation platforms has gained significant attention, with a predominant focus on channel recommendation and budget allocation strategies. However, current offline reinforcement learning (RL) methods face…

Information Retrieval · Computer Science 2025-07-10 Langming Liu , Wanyu Wang , Chi Zhang , Bo Li , Hongzhi Yin , Xuetao Wei , Wenbo Su , Bo Zheng , Xiangyu Zhao

Learning to bid in repeated first-price auctions is a fundamental problem at the interface of game theory and machine learning, which has seen a recent surge in interest due to the transition of display advertising to first-price auctions.…

Computer Science and Game Theory · Computer Science 2024-07-09 Rachitesh Kumar , Jon Schneider , Balasubramanian Sivan

Long-sequence decision-making, which is usually addressed through reinforcement learning (RL), is a critical component for optimizing strategic operations in dynamic environments, such as real-time bidding in computational advertising. The…

Artificial Intelligence · Computer Science 2026-01-16 Xiaowei Lv , Zhilin Zhang , Yijun Li , Yusen Huo , Siyuan Ju , Xuyan Li , Chunxiang Hong , Tianyu Wang , Yongcai Wang , Peng Sun , Chuan Yu , Jian Xu , Bo Zheng

We introduce AdCraft, a novel benchmark environment for the Reinforcement Learning (RL) community distinguished by its stochastic and non-stationary properties. The environment simulates bidding and budgeting dynamics within Search Engine…

Machine Learning · Computer Science 2023-11-16 Maziar Gomrokchi , Owen Levin , Jeffrey Roach , Jonah White

We study the allocation of reconfigurable intelligent surfaces (RISs) in a multi-cell wireless network, where base stations compete for control of shared RIS units deployed at the cell edges. These RISs, provided by an independent operator,…

Networking and Internet Architecture · Computer Science 2026-03-06 Martin Mark Zan , Stefan Schwarz