中文
相关论文

相关论文: Online Contextual Decision-Making with a Smart Pre…

200 篇论文

In this work, we consider a distributed online convex optimization problem, with time-varying (potentially adversarial) constraints. A set of nodes, jointly aim to minimize a global objective function, which is the sum of local convex…

最优化与控制 · 数学 2021-05-06 Pranay Sharma , Prashant Khanduri , Lixin Shen , Donald J. Bucci , Pramod K. Varshney

In many repeated auction settings, participants care not only about how frequently they win but also how their winnings are distributed over time. This problem arises in various practical domains where avoiding congested demand is crucial,…

计算机科学与博弈论 · 计算机科学 2025-06-13 Giannis Fikioris , Robert Kleinberg , Yoav Kolumbus , Raunak Kumar , Yishay Mansour , Éva Tardos

We present an algorithm guaranteeing dynamic regret bounds for online omniprediction with long term constraints. The goal in this recently introduced problem is for a learner to generate a sequence of predictions which are broadcast to a…

机器学习 · 计算机科学 2025-10-09 Yahav Bechavod , Jiuyao Lu , Aaron Roth

We study the problem of online binary classification where strategic agents can manipulate their observable features in predefined ways, modeled by a manipulation graph, in order to receive a positive classification. We show this setting…

机器学习 · 计算机科学 2024-06-26 Saba Ahmadi , Avrim Blum , Kunhe Yang

We investigate decentralized online convex optimization (D-OCO), in which a set of local learners are required to minimize a sequence of global loss functions using only local computations and communications. Previous studies have…

机器学习 · 计算机科学 2024-12-12 Yuanyu Wan , Tong Wei , Bo Xue , Mingli Song , Lijun Zhang

The performance of online convex optimization algorithms in a dynamic environment is often expressed in terms of the dynamic regret, which measures the decision maker's performance against a sequence of time-varying comparators. In the…

机器学习 · 计算机科学 2022-02-28 Nima Eshraghi , Ben Liang

In online convex optimization (OCO), Lipschitz continuity of the functions is commonly assumed in order to obtain sublinear regret. Moreover, many algorithms have only logarithmic regret when these functions are also strongly convex.…

机器学习 · 计算机科学 2021-01-01 Yihan Zhou , Victor S. Portella , Mark Schmidt , Nicholas J. A. Harvey

Online safe reinforcement learning (RL) plays a key role in dynamic environments, with applications in autonomous driving, robotics, and cybersecurity. The objective is to learn optimal policies that maximize rewards while satisfying safety…

机器学习 · 计算机科学 2025-06-03 Jiahui Zhu , Kihyun Yu , Dabeen Lee , Xin Liu , Honghao Wei

This paper focuses on the contextual optimization problem where a decision is subject to some uncertain parameters and covariates that have some predictive power on those parameters are available before the decision is made. More…

最优化与控制 · 数学 2024-08-12 Zhaoen Li , Maoqi Liu , Zhi-Hai Zhang

We investigate online convex optimization in non-stationary environments and choose dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

机器学习 · 计算机科学 2024-04-09 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

We consider the setting of online convex optimization with adversarial time-varying constraints in which actions must be feasible w.r.t. a fixed constraint set, and are also required on average to approximately satisfy additional…

机器学习 · 计算机科学 2024-02-15 Dan Garber , Ben Kretzu

As foundation models grow in size, fine-tuning them becomes increasingly expensive. While GPU spot instances offer a low-cost alternative to on-demand resources, their volatile prices and availability make deadline-aware scheduling…

分布式、并行与集群计算 · 计算机科学 2025-12-25 Linggao Kong , Yuedong Xu , Lei Jiao , Chuan Xu

We study online prediction where regret of the algorithm is measured against a benchmark defined via evolving constraints. This framework captures online prediction on graphs, as well as other prediction problems with combinatorial…

机器学习 · 计算机科学 2015-06-15 Alexander Rakhlin , Karthik Sridharan

Motivated by the challenge of nonstationarity in sequential decision making, we study Online Convex Optimization (OCO) under the coupling of two problem structures: the domain is unbounded, and the comparator sequence $u_1,\ldots,u_T$ is…

机器学习 · 计算机科学 2023-10-27 Zhiyu Zhang , Ashok Cutkosky , Ioannis Ch. Paschalidis

We uncover a fairly general principle in online learning: If regret can be (approximately) expressed as a function of certain "sufficient statistics" for the data sequence, then there exists a special Burkholder function that 1) can be used…

机器学习 · 计算机科学 2018-03-22 Dylan J. Foster , Alexander Rakhlin , Karthik Sridharan

Stochastic Optimization (SO) is a classical approach for optimization under uncertainty that typically requires knowledge about the probability distribution of uncertain parameters. As the latter is often unknown, Distributionally Robust…

Bandit convex optimization (BCO) is a fundamental online learning framework with partial feedback, where the learner observes only the loss incurred at the chosen decision point in each round. In this work, we investigate whether optimistic…

机器学习 · 计算机科学 2026-05-22 Shuche Wang , Adarsh Barik , Vincent Y. F. Tan

Some of the most compelling applications of online convex optimization, including online prediction and classification, are unconstrained: the natural feasible set is R^n. Existing algorithms fail to achieve sub-linear regret in this…

机器学习 · 计算机科学 2012-11-13 Matthew Streeter , H. Brendan McMahan

We consider the problem of online resource allocation with average budget constraints. At each time point the decision maker makes an irrevocable decision of whether to accept or reject a request before the next request arrives with the…

统计方法学 · 统计学 2025-09-29 Ruicheng Ao , Hongyu Chen , David Simchi-Levi , Feng Zhu

This paper studies the online optimal control problem with time-varying convex stage costs for a time-invariant linear dynamical system, where a finite lookahead window of accurate predictions of the stage costs are available at each time.…

最优化与控制 · 数学 2019-10-23 Yingying Li , Xin Chen , Na Li