English
Related papers

Related papers: Online Learning under Budget and ROI Constraints v…

200 papers

Practical online learning tasks are often naturally defined on unconstrained domains, where optimal algorithms for general convex losses are characterized by the notion of comparator adaptivity. In this paper, we design such algorithms in…

Machine Learning · Computer Science 2022-10-13 Zhiyu Zhang , Ashok Cutkosky , Ioannis Ch. Paschalidis

Bilateral trade models the problem of facilitating trades between a seller and a buyer having private valuations for the item being sold. In the online version of the problem, the learner faces a new seller and buyer at each time step, and…

Computer Science and Game Theory · Computer Science 2024-05-29 Solenne Gaucher , Martino Bernasconi , Matteo Castiglioni , Andrea Celli , Vianney Perchet

We provide the first sub-linear space and sub-linear regret algorithm for online learning with expert advice (against an oblivious adversary), addressing an open question raised recently by Srinivas, Woodruff, Xu and Zhou (STOC 2022). We…

Data Structures and Algorithms · Computer Science 2022-11-09 Binghui Peng , Fred Zhang

In real-world machine learning applications, there is a cost associated with sampling of different features. Budgeted learning can be used to select which feature-values to acquire from each instance in a dataset, such that the best model…

Machine Learning · Computer Science 2019-03-14 Eran Fainman , Bracha Shapira , Lior Rokach , Yisroel Mirsky

Advertisers increasingly use automated bidding to optimize their ad campaigns on online advertising platforms. Autobidding optimizes an advertiser's objective subject to various constraints, e.g. average ROI and budget constraints. In this…

Computer Science and Game Theory · Computer Science 2024-04-16 Gagan Aggarwal , Giannis Fikioris , Mingfei Zhao

Bilateral trade models the problem of intermediating between two rational agents -- a seller and a buyer -- both characterized by a private valuation for an item they want to trade. We study the online learning version of the problem, in…

Computer Science and Game Theory · Computer Science 2024-09-04 Martino Bernasconi , Matteo Castiglioni , Andrea Celli , Federico Fusco

First-price auctions have very recently swept the online advertising industry, replacing second-price auctions as the predominant auction mechanism on many platforms. This shift has brought forth important challenges for a bidder: how…

Machine Learning · Computer Science 2025-09-26 Yanjun Han , Zhengyuan Zhou , Aaron Flores , Erik Ordentlich , Tsachy Weissman

We address online linear optimization problems when the possible actions of the decision maker are represented by binary vectors. The regret of the decision maker is the difference between her realized loss and the best loss she would have…

Machine Learning · Computer Science 2013-04-02 Jean-Yves Audibert , Sébastien Bubeck , Gábor Lugosi

We address online learning in complex auction settings, such as sponsored search auctions, where the value of the bidder is unknown to her, evolving in an arbitrary manner and observed only if the bidder wins an allocation. We leverage the…

Computer Science and Game Theory · Computer Science 2018-06-04 Zhe Feng , Chara Podimata , Vasilis Syrgkanis

We study the problem of learning to bid when the bidder's value is dynamic, i.e., when the current value depends on past outcomes. Specifically, we consider a bidder participating in repeated second-price auctions whose value depends on the…

Machine Learning · Computer Science 2026-05-28 Benjamin Heymann , Otmane Sakhi

We consider the problem of bidding in online advertising, where an advertiser aims to maximize value while adhering to budget and Return-on-Spend (RoS) constraints. Unlike prior work that assumes knowledge of the value generated by winning…

Machine Learning · Computer Science 2025-03-06 Sushant Vijayan , Zhe Feng , Swati Padmanabhan , Karthikeyan Shanmugam , Arun Suggala , Di Wang

Online bidding is a classic optimization problem, with several applications in online decision-making, the design of interruptible systems, and the analysis of approximation algorithms. In this work, we study online bidding under…

Computer Science and Game Theory · Computer Science 2025-10-30 Spyros Angelopoulos , Bertrand Simon

Budget management strategies in repeated auctions have received growing attention in online advertising markets. However, previous work on budget management in online bidding mainly focused on second-price auctions. The rapid shift from…

Computer Science and Game Theory · Computer Science 2023-04-27 Qian Wang , Zongjun Yang , Xiaotie Deng , Yuqing Kong

We study online learning in constrained Markov decision processes (CMDPs) with adversarial losses and stochastic hard constraints, under bandit feedback. We consider three scenarios. In the first one, we address general CMDPs, where we…

Machine Learning · Computer Science 2025-02-10 Francesco Emanuele Stradi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Most microeconomic models of interest involve optimizing a piecewise linear function. These include contract design in hidden-action principal-agent problems, selling an item in posted-price auctions, and bidding in first-price auctions.…

Computer Science and Game Theory · Computer Science 2025-03-04 Francesco Bacchiocchi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Today's online advertisers procure digital ad impressions through interacting with autobidding platforms: advertisers convey high level procurement goals via setting levers such as budget, target return-on-investment, max cost per click,…

Information Retrieval · Computer Science 2023-07-13 Jason Cheuk Nam Liang , Haihao Lu , Baoyu Zhou

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

Machine Learning · Computer Science 2024-01-03 Piao Hu , Jiashuo Jiang , Guodong Lyu , Hao Su

We consider online convex optimization with stochastic constraints where the objective functions are arbitrarily time-varying and the constraint functions are independent and identically distributed (i.i.d.) over time. Both the objective…

Optimization and Control · Mathematics 2019-08-02 Xiaohan Wei , Hao Yu , Michael J. Neely

In this work, we introduce a learning model designed to meet the needs of applications in which computational resources are limited, and robustness and interpretability are prioritized. Learning problems can be formulated as constrained…

Systems and Control · Electrical Eng. & Systems 2025-09-26 Christos Mavridis , John Baras

Online kernel selection is a fundamental problem of online kernel methods.In this paper,we study online kernel selection with memory constraint in which the memory of kernel selection and online prediction procedures is limited to a fixed…

Machine Learning · Computer Science 2025-03-25 Junfan Li , Shizhong Liao