English
Related papers

Related papers: Real-Time Bidding with Multi-Agent Reinforcement L…

200 papers

The optimization of bidding strategies for online advertising slot auctions presents a critical challenge across numerous digital marketplaces. A significant obstacle to the development, evaluation, and refinement of real-time autobidding…

Managing millions of digital auctions is an essential task for modern advertising auction systems. The main approach to managing digital auctions is an autobidding approach, which depends on the Click-Through Rate and Conversion Rate…

Computer Science and Game Theory · Computer Science 2025-10-13 Andrey Pudovikov , Alexandra Khirianova , Ekaterina Solodneva , Gleb Molodtsov , Aleksandr Katrutsa , Yuriy Dorn , Egor Samosvat

In the real world, people/entities usually find matches independently and autonomously, such as finding jobs, partners, roommates, etc. It is possible that this search for matches starts with no initial knowledge of the environment. We…

Machine Learning · Computer Science 2021-12-07 Kshitija Taywade , Judy Goldsmith , Brent Harrison

We consider a multichannel random access system in which each user accesses a single channel at each time slot to communicate with an access point (AP). Users arrive to the system at random and be activated for a certain period of time…

Signal Processing · Electrical Eng. & Systems 2021-05-11 Muhammad Sohaib , Jongjin Jeong , Sang-Woon Jeon

Traditional auction theory posits that bid value exhibits a positive correlation with the probability of securing the auctioned object in ascending auctions. However, under uncertainty and incomplete information, as is characteristic in…

Theoretical Economics · Economics 2025-12-19 Dipankar Das

Retrieval systems primarily address the challenge of matching user queries with the most relevant advertisements, playing a crucial role in e-commerce search advertising. The diversity of user needs and expressions often produces massive…

Computation and Language · Computer Science 2025-06-05 Zhenhui Liu , Chunyuan Yuan , Ming Pang , Zheng Fang , Li Yuan , Xue Jiang , Changping Peng , Zhangang Lin , Zheng Luo , Jingping Shao

We consider an online matching problem with concave returns. This problem is a significant generalization of the Adwords allocation problem and has vast applications in online advertising. In this problem, a sequence of items arrive…

Data Structures and Algorithms · Computer Science 2015-06-09 Xiao Alison Chen , Zizhuo Wang

Bid shading plays a crucial role in Real-Time Bidding (RTB) by adaptively adjusting the bid to avoid advertisers overspending. Existing mainstream two-stage methods, which first model bid landscapes and then optimize surplus using…

Computer Science and Game Theory · Computer Science 2026-04-30 Yinqiu Huang , Hao Ma , Wenshuai Chen , Zongwei Wang , Shuli Wang , Yongqiang Zhang , Xue Wei , Yinhua Zhu , Haitao Wang , Xingxing Wang

Internet search companies sell advertisement slots based on users' search queries via an auction. While there has been a lot of attention on the auction process and its game-theoretic aspects, our focus is on the advertisers. In particular,…

Data Structures and Algorithms · Computer Science 2007-05-23 Jon Feldman , S. Muthukrishnan , Martin Pal , Cliff Stein

Online advertising platforms often face a common challenge: the cold start problem. Insufficient behavioral data (clicks) makes accurate click-through rate (CTR) forecasting of new ads challenging. CTR for "old" items can also be…

Machine Learning · Computer Science 2025-02-05 Anastasiia Soboleva , Andrey Pudovikov , Roman Snetkov , Alina Babenko , Egor Samosvat , Yuriy Dorn

While it is relatively easy to start an online advertising campaign, obtaining a high Key Performance Indicator (KPI) can be challenging. A large body of work on this subject has already been performed and platforms known as DSPs are…

Computer Science and Game Theory · Computer Science 2018-08-10 Gianluca Micchi , Saeid Soheily-Khah , Jacob Turner

Finding optimal adversarial attack strategies is an important topic in reinforcement learning and the Markov decision process. Previous studies usually assume one all-knowing coordinator (attacker) for whom attacking different recipient…

Machine Learning · Computer Science 2024-03-05 Ziqing Lu , Guanlin Liu , Lifeng Lai , Weiyu Xu

Automated bidding, an emerging intelligent decision making paradigm powered by machine learning, has become popular in online advertising. Advertisers in automated bidding evaluate the cumulative utilities and have private financial…

Computer Science and Game Theory · Computer Science 2023-08-22 Yidan Xing , Zhilin Zhang , Zhenzhe Zheng , Chuan Yu , Jian Xu , Fan Wu , Guihai Chen

In online advertising, a set of potential advertisements can be ranked by a certain auction system where usually the top-1 advertisement would be selected and displayed at an advertising space. In this paper, we show a selection bias issue…

Information Retrieval · Computer Science 2022-06-09 Shinya Suzumura , Hitoshi Abe

In this work we consider a generalization of the well-known multivehicle routing problem: given a network, a set of agents occupying a subset of its nodes, and a set of tasks, we seek a minimum cost sequence of movements subject to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-27 Jamison W. Weber , Dhanush R. Giriyan , Devendra R. Parkar , Dimitri P. Bertsekas , Andréa W. Richa

Improving the efficiency of dispatching orders to vehicles is a research hotspot in online ride-hailing systems. Most of the existing solutions for order-dispatching are centralized controlling, which require to consider all possible…

Multiagent Systems · Computer Science 2019-10-08 Ming Zhou , Jiarui Jin , Weinan Zhang , Zhiwei Qin , Yan Jiao , Chenxi Wang , Guobin Wu , Yong Yu , Jieping Ye

Recommendation systems when employed in markets play a dual role: they assist users in selecting their most desired items from a large pool and they help in allocating a limited number of items to the users who desire them the most. Despite…

Machine Learning · Computer Science 2022-08-01 Yigit Efe Erginbas , Soham Phade , Kannan Ramchandran

Pay-per-click advertising includes various formats (\emph{e.g.}, search, contextual, social) with a total investment of more than 200 billion USD per year worldwide. An advertiser is given a daily budget to allocate over several, even…

Machine Learning · Computer Science 2020-03-04 Alessandro Nuara , Francesco Trovò , Nicola Gatti , Marcello Restelli

With the rise of online e-commerce platforms, more and more customers prefer to shop online. To sell more products, online platforms introduce various modules to recommend items with different properties such as huge discounts. A web page…

Machine Learning · Computer Science 2020-09-01 Xu He , Bo An , Yanghua Li , Haikai Chen , Rundong Wang , Xinrun Wang , Runsheng Yu , Xin Li , Zhirong Wang

Being an emerging paradigm for display advertising, Real-Time Bidding (RTB) drives the focus of the bidding strategy from context to users' interest by computing a bid for each impression in real time. The data mining work and particularly…

Computer Science and Game Theory · Computer Science 2015-05-22 Weinan Zhang , Shuai Yuan , Jun Wang , Xuehua Shen