English
Related papers

Related papers: Smoothed Online Optimization for Regression and Co…

200 papers

We consider algorithms for "smoothed online convex optimization" problems, a variant of the class of online convex optimization problems that is strongly related to metrical task systems. Prior literature on these problems has focused on…

Data Structures and Algorithms · Computer Science 2015-08-18 Lachlan L. H. Andrew , Siddharth Barman , Katrina Ligett , Minghong Lin , Adam Meyerson , Alan Roytman , Adam Wierman

This paper develops a persistently exciting input generating Online Feedback Optimization (OFO) controller that estimates the sensitivity of a process ensuring minimal deviations from the descent direction while converging. This eliminates…

Systems and Control · Electrical Eng. & Systems 2025-05-27 Tore Gude , Marta Anna Zagorowska , Lars Struen Imsland

In this paper, we propose an online convex optimization approach with two different levels of adaptivity. On a higher level, our approach is agnostic to the unknown types and curvatures of the online functions, while at a lower level, it…

Machine Learning · Computer Science 2024-04-17 Yu-Hu Yan , Peng Zhao , Zhi-Hua Zhou

We consider non-differentiable dynamic optimization problems such as those arising in robotics and subspace tracking. Given the computational constraints and the time-varying nature of the problem, a low-complexity algorithm is desirable,…

Optimization and Control · Mathematics 2019-02-20 Rishabh Dixit , Amrit Singh Bedi , Ruchi Tripathi , Ketan Rajawat

Bandit convex optimization (BCO) is a fundamental online learning framework with partial feedback, where the learner observes only the loss incurred at the chosen decision point in each round. In this work, we investigate whether optimistic…

Machine Learning · Computer Science 2026-05-22 Shuche Wang , Adarsh Barik , Vincent Y. F. Tan

Iterative steady-state solvers are widely used in computational fluid dynamics. Unfortunately, it is difficult to obtain steady-state solution for unstable problem caused by physical instability and numerical instability. Optimization is a…

Computational Engineering, Finance, and Science · Computer Science 2023-11-21 Wenbo Cao , Yilang Liu , Xianglin Shan , Chuanqiang Gao , Weiwei Zhang

Most existing distance metric learning methods assume perfect side information that is usually given in pairwise or triplet constraints. Instead, in many real-world applications, the constraints are derived from side information, such as…

Machine Learning · Computer Science 2012-03-19 Kaizhu Huang , Rong Jin , Zenglin Xu , Cheng-Lin Liu

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

This paper studies online nonstochastic control problems with adversarial and static constraints. We propose online nonstochastic control algorithms that achieve both sublinear regret and sublinear adversarial constraint violation while…

Machine Learning · Computer Science 2023-02-07 Xin Liu , Zixian Yang , Lei Ying

Online optimization problems arise in many resource allocation tasks, where the future demands for each resource and the associated utility functions change over time and are not known apriori, yet resources need to be allocated at every…

Optimization and Control · Mathematics 2015-02-06 Reza Eghbali , Jon Swenson , Maryam Fazel

Unconstrained Online Linear Optimization (OLO) is a practical problem setting to study the training of machine learning models. Existing works proposed a number of potential-based algorithms, but in general the design of these potential…

Machine Learning · Computer Science 2022-06-16 Zhiyu Zhang , Ashok Cutkosky , Ioannis Paschalidis

Bandit convex optimization (BCO) is a general framework for online decision making under uncertainty. While tight regret bounds for general convex losses have been established, existing algorithms achieving these bounds have prohibitive…

Machine Learning · Computer Science 2024-10-04 Arun Suggala , Y. Jennifer Sun , Praneeth Netrapalli , Elad Hazan

This paper presents a new regularization approach -- termed OpReg-Boost -- to boost the convergence and lessen the asymptotic error of online optimization and learning algorithms. In particular, the paper considers online algorithms for…

Machine Learning · Computer Science 2022-04-05 Nicola Bastianello , Andrea Simonetto , Emiliano Dall'Anese

We consider the setting of online convex optimization with adversarial time-varying constraints in which actions must be feasible w.r.t. a fixed constraint set, and are also required on average to approximately satisfy additional…

Machine Learning · Computer Science 2024-02-15 Dan Garber , Ben Kretzu

We formalize the problem of online learning-unlearning, where a model is updated sequentially in an online setting while accommodating unlearning requests between updates. After a data point is unlearned, all subsequent outputs must be…

Machine Learning · Computer Science 2025-05-14 Yaxi Hu , Bernhard Schölkopf , Amartya Sanyal

We consider the setting of online convex optimization (OCO) with \textit{exp-concave} losses. The best regret bound known for this setting is $O(n\log{}T)$, where $n$ is the dimension and $T$ is the number of prediction rounds (treating all…

Machine Learning · Computer Science 2023-02-10 Dan Garber , Ben Kretzu

Making use of predictions is a crucial, but under-explored, area of online algorithms. This paper studies a class of online optimization problems where we have external noisy predictions available. We propose a stochastic prediction error…

Machine Learning · Computer Science 2015-04-28 Niangjun Chen , Anish Agarwal , Adam Wierman , Siddharth Barman , Lachlan L. H. Andrew

This paper presents new projection-free algorithms for Online Convex Optimization (OCO) over a convex domain $\mathcal{K} \subset \mathbb{R}^d$. Classical OCO algorithms (such as Online Gradient Descent) typically need to perform Euclidean…

Optimization and Control · Mathematics 2023-06-21 Khashayar Gatmiry , Zakaria Mhammedi

In this paper, we consider online convex optimization (OCO) with time-varying loss and constraint functions. Specifically, the decision maker chooses sequential decisions based only on past information, meantime the loss and constraint…

Optimization and Control · Mathematics 2022-05-20 Haoyang Liu , Xiantao Xiao , Liwei Zhang

We investigate online convex optimization in non-stationary environments and choose dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

Machine Learning · Computer Science 2024-04-09 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou