English
Related papers

Related papers: Constraint-Aware Generative Auto-bidding via Paret…

200 papers

In modern advertising platforms, learning algorithms are deployed by budget-constrained bidders to maximize their accumulated value. These algorithms often offer classical utility guarantees like no-regret, i.e., the agent's utility is at…

Computer Science and Game Theory · Computer Science 2026-02-23 Giannis Fikioris , Robert Kleinberg , Yoav Kolumbus , Yishay Mansour , Eva Tardos

We study online learning in contextual pay-per-click auctions where at each of the $T$ rounds, the learner receives some context along with a set of ads and needs to make an estimate on their click-through rate (CTR) in order to run a…

Machine Learning · Computer Science 2023-10-10 Mengxiao Zhang , Haipeng Luo

We study revenue optimization learning algorithms for repeated posted-price auctions where a seller interacts with a single strategic buyer that holds a fixed private valuation for a good and seeks to maximize his cumulative discounted…

Computer Science and Game Theory · Computer Science 2018-02-09 Alexey Drutsa

Auto-bidding is a critical tool for advertisers to improve advertising performance. Recent progress has demonstrated that AI-Generated Bidding (AIGB), which learns a conditional generative planner from offline data, achieves superior…

Machine Learning · Computer Science 2026-03-04 Zhiyu Mou , Yiqin Lv , Miao Xu , Qi Wang , Yixiu Mao , Jinghao Chen , Qichen Ye , Chao Li , Rongquan Bai , Chuan Yu , Jian Xu , Bo Zheng

For many applications of reinforcement learning it can be more convenient to specify both a reward function and constraints, rather than trying to design behavior through the reward function. For example, systems that physically interact…

Machine Learning · Computer Science 2017-05-31 Joshua Achiam , David Held , Aviv Tamar , Pieter Abbeel

Online advertising has become a core revenue driver for the internet industry, with ad auctions playing a crucial role in ensuring platform revenue and advertiser incentives. Traditional auction mechanisms, like GSP, rely on the independent…

Computer Science and Game Theory · Computer Science 2024-12-17 Ruitao Zhu , Yangsu Liu , Dagui Chen , Zhenjia Ma , Chufeng Shi , Zhenzhe Zheng , Jie Zhang , Jian Xu , Bo Zheng , Fan Wu

Constrained generative modeling is fundamental to applications such as robotic control and autonomous driving, where models must respect physical laws and safety-critical constraints. In real-world settings, these constraints rarely take…

Machine Learning · Computer Science 2026-03-10 Xiaoxuan Liang , Saeid Naderiparizi , Yunpeng Liu , Berend Zwartsenberg , Frank Wood

We consider a dynamic pricing problem for repeated contextual second-price auctions with multiple strategic buyers who aim to maximize their long-term time discounted utility. The seller has limited information on buyers' overall demand…

Machine Learning · Computer Science 2023-02-08 Negin Golrezaei , Patrick Jaillet , Jason Cheuk Nam Liang

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

Constrained reinforcement learning has achieved promising progress in safety-critical fields where both rewards and constraints are considered. However, constrained reinforcement learning methods face challenges in striking the right…

Machine Learning · Computer Science 2024-10-29 Jianmina Ma , Jingtian Ji , Yue Gao

Convergence (virtual) bidding is an important part of two-settlement electric power markets as it can effectively reduce discrepancies between the day-ahead and real-time markets. Consequently, there is extensive research into the bidding…

Optimization and Control · Mathematics 2023-02-09 Letif Mones , Sean Lovett

This paper introduces a novel contextual bandit algorithm for personalized pricing under utility fairness constraints in scenarios with uncertain demand, achieving an optimal regret upper bound. Our approach, which incorporates dynamic…

Machine Learning · Statistics 2023-11-29 Xi Chen , David Simchi-Levi , Yining Wang

Online convex optimization (OCO) with time-varying constraints is a critical framework for sequential decision-making in dynamic networked systems, where learners must minimize cumulative loss while satisfying regions of feasibility that…

Machine Learning · Computer Science 2026-03-17 Xiufeng Liu , Qian Chen , Zhijin Wang , Ruyu Liu

Constraint handling plays a key role in solving realistic complex optimization problems. Though intensively discussed in the last few decades, existing constraint handling techniques predominantly rely on human experts' designs, which more…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Qianhao Zhu , Sijie Ma , Zeyuan Ma , Hongshu Guo , Yue-Jiao Gong

We consider the problem of bidding in online advertising, where an advertiser aims to maximize value while adhering to budget and Return-on-Spend (RoS) constraints. Unlike prior work that assumes knowledge of the value generated by winning…

Machine Learning · Computer Science 2025-03-06 Sushant Vijayan , Zhe Feng , Swati Padmanabhan , Karthikeyan Shanmugam , Arun Suggala , Di Wang

Auto-bidding, with its strong capability to optimize bidding decisions within dynamic and competitive online environments, has become a pivotal strategy for advertising platforms. Existing approaches typically employ rule-based strategies…

Machine Learning · Computer Science 2025-04-28 Jingtong Gao , Yewen Li , Shuai Mao , Peng Jiang , Nan Jiang , Yejing Wang , Qingpeng Cai , Fei Pan , Peng Jiang , Kun Gai , Bo An , Xiangyu Zhao

In many data-driven online decision systems, actions determine not only operational costs but also the data availability for future learning -- a phenomenon termed Prediction-Induced Censoring (PIC). This challenge is particularly acute in…

Systems and Control · Electrical Eng. & Systems 2026-02-23 Yan Chen , Ruyi Huang , Cheng Liu

The transition to First-Price Auctions (FPA) in digital advertising has spurred significant research, yet existing work typically assumes access to a valuation oracle, ignoring the reality that values must be inferred from censored data.…

Machine Learning · Computer Science 2026-05-12 Zihao Hu , Yuxiao Wen , Yuan Yao , Jiheng Zhang , Zhengyuan Zhou

Budget management strategies in repeated auctions have received growing attention in online advertising markets. However, previous work on budget management in online bidding mainly focused on second-price auctions. The rapid shift from…

Computer Science and Game Theory · Computer Science 2023-04-27 Qian Wang , Zongjun Yang , Xiaotie Deng , Yuqing Kong

First-price auctions have recently gained significant traction in digital advertising markets, exemplified by Google's transition from second-price to first-price auctions. Unlike in second-price auctions, where bidding one's private…

Machine Learning · Computer Science 2025-10-07 Zihao Hu , Xiaoyu Fan , Yuan Yao , Jiheng Zhang , Zhengyuan Zhou