English
Related papers

Related papers: Smoothed Online Optimization with Unreliable Predi…

200 papers

Smoothed online combinatorial optimization considers a learner who repeatedly chooses a combinatorial decision to minimize an unknown changing cost function with a penalty on switching decisions in consecutive rounds. We study smoothed…

Machine Learning · Computer Science 2023-01-18 Kai Wang , Zhao Song , Georgios Theocharous , Sridhar Mahadevan

In this paper, we revisit the problem of smoothed online learning, in which the online learner suffers both a hitting cost and a switching cost, and target two performance metrics: competitive ratio and dynamic regret with switching cost.…

Machine Learning · Computer Science 2021-05-19 Lijun Zhang , Wei Jiang , Shiyin Lu , Tianbao Yang

We consider Online Convex Optimization (OCO) in the setting where the costs are $m$-strongly convex and the online learner pays a switching cost for changing decisions between rounds. We show that the recently proposed Online Balanced…

Machine Learning · Computer Science 2019-04-05 Gautam Goel , Adam Wierman

We introduce the Smoothed Online Optimization for Target Tracking (SOOTT) problem, a new framework that integrates three key objectives in online decision-making under uncertainty: (1) tracking cost for following a dynamically moving…

Machine Learning · Computer Science 2025-09-09 Ali Zeynali , Mahsa Sahebdel , Qingsong Liu , Mohammad Hajiesmaili , Ramesh K. Sitaraman

We study Smoothed Online Convex Optimization, a version of online convex optimization where the learner incurs a penalty for changing her actions between rounds. Given a $\Omega(\sqrt{d})$ lower bound on the competitive ratio of any online…

Machine Learning · Computer Science 2018-07-10 Niangjun Chen , Gautam Goel , Adam Wierman

In this paper, we investigate an online prediction strategy named as Discounted-Normal-Predictor (Kapralov and Panigrahy, 2010) for smoothed online convex optimization (SOCO), in which the learner needs to minimize not only the hitting cost…

Machine Learning · Computer Science 2022-05-03 Lijun Zhang , Wei Jiang , Jinfeng Yi , Tianbao Yang

We study online optimization in a setting where an online learner seeks to optimize a per-round hitting cost, which may be non-convex, while incurring a movement cost when changing actions between rounds. We ask: \textit{under what general…

Machine Learning · Computer Science 2020-01-27 Yiheng Lin , Gautam Goel , Adam Wierman

Online algorithm selection (OAS) aims to adapt the optimization process to changes in the fitness landscape and is expected to outperform any single algorithm from a given portfolio. Although this expectation is supported by numerous…

Neural and Evolutionary Computing · Computer Science 2026-04-10 Denis Antipov , Carola Doerr

Fairness and action smoothness are two crucial considerations in many online optimization problems, but they have yet to be addressed simultaneously. In this paper, we study a new and challenging setting of fairness-regularized smoothed…

Machine Learning · Computer Science 2025-12-15 Pengfei Li , Yuelin Han , Adam Wierman , Shaolei Ren

We prove novel algorithmic guarantees for several online problems in the smoothed analysis model. In this model, at each time an adversary chooses an input distribution with density function bounded above by $\tfrac{1}{\sigma}$ times that…

Machine Learning · Computer Science 2021-08-20 Nika Haghtalab , Tim Roughgarden , Abhishek Shetty

We consider the fundamental problem of prediction with expert advice where the experts are "optimizable": there is a black-box optimization oracle that can be used to compute, in constant time, the leading expert in retrospect at any point…

Machine Learning · Computer Science 2016-01-28 Elad Hazan , Tomer Koren

In many sequential decision making applications, the change of decision would bring an additional cost, such as the wear-and-tear cost associated with changing server status. To control the switching cost, we introduce the problem of online…

Machine Learning · Computer Science 2021-03-23 Guanghui Wang , Yuanyu Wan , Tianbao Yang , Lijun Zhang

In this paper, we study oracle-efficient algorithms for beyond worst-case analysis of online learning. We focus on two settings. First, the smoothed analysis setting of [RST11,HRS22] where an adversary is constrained to generating samples…

Machine Learning · Computer Science 2022-11-23 Nika Haghtalab , Yanjun Han , Abhishek Shetty , Kunhe Yang

Smoothed online learning has emerged as a popular framework to mitigate the substantial loss in statistical and computational complexity that arises when one moves from classical to adversarial learning. Unfortunately, for some spaces, it…

Machine Learning · Statistics 2024-03-20 Adam Block , Alexander Rakhlin , Max Simchowitz

We introduce and study a class of online problems called online smoothed demand management $(\texttt{OSDM})$, motivated by paradigm shifts in grid integration and energy storage for large energy consumers such as data centers. In…

Data Structures and Algorithms · Computer Science 2026-02-23 Adam Lechowicz , Nicolas Christianson , Mohammad Hajiesmaili , Adam Wierman , Prashant Shenoy

We present new algorithms for optimizing non-smooth, non-convex stochastic objectives based on a novel analysis technique. This improves the current best-known complexity for finding a $(\delta,\epsilon)$-stationary point from…

Machine Learning · Computer Science 2025-08-08 Ashok Cutkosky , Harsh Mehta , Francesco Orabona

We study the smoothed online quadratic optimization (SOQO) problem where, at each round $t$, a player plays an action $x_t$ in response to a quadratic hitting cost and an additional squared $\ell_2$-norm cost for switching actions. This…

Optimization and Control · Mathematics 2024-03-26 Neelkamal Bhuyan , Debankur Mukherjee , Adam Wierman

A standard way to obtain convergence guarantees in stochastic convex optimization is to run an online learning algorithm and then output the average of its iterates: the actual iterates of the online learning algorithm do not come with…

Machine Learning · Statistics 2019-03-05 Ashok Cutkosky

Online strategic classification studies settings in which agents strategically modify their features to obtain favorable predictions. For example, given a classifier that determines loan approval based on credit scores, applicants may open…

Machine Learning · Computer Science 2026-02-09 Chase Hutton , Adam Melrod , Han Shao

We study online convex optimization in a setting where the learner seeks to minimize the sum of a per-round hitting cost and a movement cost which is incurred when changing decisions between rounds. We prove a new lower bound on the…

Machine Learning · Computer Science 2019-10-23 Gautam Goel , Yiheng Lin , Haoyuan Sun , Adam Wierman
‹ Prev 1 2 3 10 Next ›