English
Related papers

Related papers: Generative Auto-Bidding with Value-Guided Explorat…

200 papers

Auto-bidding services optimize real-time bidding strategies for advertisers under key performance indicator (KPI) constraints such as target return on investment and budget. However, uncertainties such as model prediction errors and…

Computer Science and Game Theory · Computer Science 2026-04-08 Linghui Meng , Chun Gan , Shengsheng Niu , Chengcheng Zhang , Chenchen Li , Chuan Yang , Yi Mao , Xin Zhu , Jie He , Zhangang Lin , Ching Law

Real-time bidding (RTB) has become a major paradigm of display advertising. Each ad impression generated from a user visit is auctioned in real time, where demand-side platform (DSP) automatically provides bid price usually relying on the…

Information Retrieval · Computer Science 2022-12-26 Zhimeng Jiang , Kaixiong Zhou , Mi Zhang , Rui Chen , Xia Hu , Soo-Hyun Choi

Reinforcement learning (RL) is an effective technique for training decision-making agents through interactions with their environment. The advent of deep learning has been associated with highly notable successes with sequential decision…

Machine Learning · Computer Science 2021-05-25 Michael Tashman , John Hoffman , Jiayi Xie , Fengdan Ye , Atefeh Morsali , Lee Winikor , Rouzbeh Gerami

In the realm of online advertising, advertisers partake in ad auctions to obtain advertising slots, frequently taking advantage of auto-bidding tools provided by demand-side platforms. To improve the automation of these bidding systems, we…

Machine Learning · Computer Science 2025-06-30 Hao Jiang , Yongxiang Tang , Yanxiang Zeng , Pengjia Yuan , Yanhua Cheng , Teng Sha , Xialong Liu , Peng Jiang

The majority of online display ads are served through real-time bidding (RTB) --- each ad display impression is auctioned off in real-time when it is just being generated from a user visit. To place an ad automatically and optimally, it is…

Machine Learning · Computer Science 2017-01-13 Han Cai , Kan Ren , Weinan Zhang , Kleanthis Malialis , Jun Wang , Yong Yu , Defeng Guo

Generative adversarial imitation learning (GAIL) has attracted increasing attention in the field of robot learning. It enables robots to learn a policy to achieve a task demonstrated by an expert while simultaneously estimating the reward…

Machine Learning · Computer Science 2019-11-04 Kyoichiro Kobayashi , Takato Horii , Ryo Iwaki , Yukie Nagai , Minoru Asada

We address online learning in complex auction settings, such as sponsored search auctions, where the value of the bidder is unknown to her, evolving in an arbitrary manner and observed only if the bidder wins an allocation. We leverage the…

Computer Science and Game Theory · Computer Science 2018-06-04 Zhe Feng , Chara Podimata , Vasilis Syrgkanis

This paper proposes a diffusion-based auto-bidding framework that leverages graph representations to model large-scale auction environments. In such settings, agents must dynamically optimize bidding strategies under constraints defined by…

Machine Learning · Computer Science 2025-04-22 Dom Huh , Prasant Mohapatra

Generative engines (GEs) are reshaping information access by replacing ranked links with citation-grounded answers, yet current Generative Engine Optimization (GEO) methods optimize each instance in isolation, unable to accumulate or…

Artificial Intelligence · Computer Science 2026-04-22 Beining Wu , Fuyou Mao , Jiong Lin , Cheng Yang , Jiaxuan Lu , Yifu Guo , Siyu Zhang , Yifan Wu , Ying Huang , Fu Li

Auto-bidding systems aim to maximize marketing value while satisfying strict efficiency constraints such as Target Cost-Per-Action (CPA). Although Decision Transformers provide powerful sequence modeling capabilities, applying them to this…

Machine Learning · Computer Science 2026-02-10 Binglin Wu , Yingyi Zhang , Xianneng Li , Ruyue Deng , Chuan Yue , Weiru Zhang , Xiaoyi Zeng

Online auction scenarios, such as bidding searches on advertising platforms, often require bidders to participate repeatedly in auctions for identical or similar items. Most previous studies have only considered the process by which the…

Computer Science and Game Theory · Computer Science 2024-02-28 Yudong Hu , Congying Han , Tiande Guo , Hao Xiao

We consider an agent who is involved in a Markov decision process and receives a vector of outcomes every round. Her objective is to maximize a global concave reward function on the average vectorial outcome. The problem models applications…

Machine Learning · Computer Science 2019-05-17 Wang Chi Cheung

Sponsored search is an important monetization channel for search engines, in which an auction mechanism is used to select the ads shown to users and determine the prices charged from advertisers. There have been several pieces of work in…

Computer Science and Game Theory · Computer Science 2014-06-05 Di He , Wei Chen , Liwei Wang , Tie-Yan Liu

Online advertising has become a core revenue driver for the internet industry, with ad auctions playing a crucial role in ensuring platform revenue and advertiser incentives. Traditional auction mechanisms, like GSP, rely on the independent…

Computer Science and Game Theory · Computer Science 2024-12-17 Ruitao Zhu , Yangsu Liu , Dagui Chen , Zhenjia Ma , Chufeng Shi , Zhenzhe Zheng , Jie Zhang , Jian Xu , Bo Zheng , Fan Wu

Learning-based methods are increasingly popular for search algorithms in single-criterion optimization problems. In contrast, for multiple-criteria optimization there are significantly fewer approaches despite the existence of numerous…

Artificial Intelligence · Computer Science 2021-08-04 Kevin Osanlou , Christophe Guettier , Andrei Bursuc , Tristan Cazenave , Eric Jacopin

In Bayesian single-item auctions, a monotone bidding strategy--one that prescribes a higher bid for a higher value type--can be equivalently represented as a partition of the quantile space into consecutive intervals corresponding to…

Computer Science and Game Theory · Computer Science 2026-02-10 Junyao Zhao

In this study, we apply reinforcement learning techniques and propose what we call reinforcement mechanism design to tackle the dynamic pricing problem in sponsored search auctions. In contrast to previous game-theoretical approaches that…

Computer Science and Game Theory · Computer Science 2017-11-29 Weiran Shen , Binghui Peng , Hanpeng Liu , Michael Zhang , Ruohan Qian , Yan Hong , Zhi Guo , Zongyao Ding , Pengjun Lu , Pingzhong Tang

With the widespread adoption of electric vehicles (EVs), navigating for EV drivers to select a cost-effective charging station has become an important yet challenging issue due to dynamic traffic conditions, fluctuating electricity prices,…

Machine Learning · Computer Science 2025-02-28 Tianyang Qi , Shibo Chen , Jun Zhang

Generative search engines represent a transition from traditional ranking-based retrieval to Large Language Model (LLM)-based synthesis, transforming optimization goals from ranking prominence towards content inclusion. Generative Engine…

Artificial Intelligence · Computer Science 2026-03-24 Jiaqi Yuan , Jialu Wang , Zihan Wang , Qingyun Sun , Ruijie Wang , Jianxin Li

By employing large language models (LLMs) to retrieve documents and generate natural language responses, Generative Engines, such as Google AI overview and ChatGPT, provide significantly enhanced user experiences and have rapidly become the…

Information Retrieval · Computer Science 2025-10-14 Yujiang Wu , Shanshan Zhong , Yubin Kim , Chenyan Xiong