中文
相关论文

相关论文: Online optimization and regret guarantees for non-…

200 篇论文

This paper studies the online optimal control problem with time-varying convex stage costs for a time-invariant linear dynamical system, where a finite lookahead window of accurate predictions of the stage costs are available at each time.…

最优化与控制 · 数学 2019-10-23 Yingying Li , Xin Chen , Na Li

In this paper, we investigate the online non-convex optimization problem which generalizes the classic {online convex optimization problem by relaxing the convexity assumption on the cost function. For this type of problem, the classic…

机器学习 · 计算机科学 2017-09-14 Lin Yang , Cheng Tan , Wing Shing Wong

This paper studies the problem of online performance optimization of constrained closed-loop control systems, where both the objective and the constraints are unknown black-box functions affected by exogenous time-varying contextual…

机器学习 · 计算机科学 2023-09-22 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

We consider online algorithms under both the competitive ratio criteria and the regret minimization one. Our main goal is to build a unified methodology that would be able to guarantee both criteria simultaneously. For a general class of…

机器学习 · 计算机科学 2019-04-09 Amit Daniely , Yishay Mansour

We consider the online convex optimization problem. In the setting of arbitrary sequences and finite set of parameters, we establish a new fast-rate quantile regret bound. Then we investigate the optimization into the L1-ball by…

统计理论 · 数学 2018-05-24 Pierre Gaillard , Olivier Wintenberger

We present an algorithm guaranteeing dynamic regret bounds for online omniprediction with long term constraints. The goal in this recently introduced problem is for a learner to generate a sequence of predictions which are broadcast to a…

机器学习 · 计算机科学 2025-10-09 Yahav Bechavod , Jiuyao Lu , Aaron Roth

This paper studies distributed online convex optimization with time-varying coupled constraints, motivated by distributed online control in network systems. Most prior work assumes a separability condition: the global objective and coupled…

最优化与控制 · 数学 2026-02-18 Zhaoye Pan , Haozhe Lei , Fan Zuo , Zilin Bian , Tao Li

This paper proposes a modular approach that combines the online convex optimization framework and reference governors to solve a constrained control problem featuring time-varying and a priori unknown cost functions. Compared to existing…

系统与控制 · 电气工程与系统科学 2025-07-14 Marko Nonhoff , Johannes Köhler , Matthias A. Müller

In this paper, we study fundamental problems of maximizing DR-submodular continuous functions that have real-world applications in the domain of machine learning, economics, operations research and communication systems. It captures a…

机器学习 · 计算机科学 2020-06-25 Nguyen Kim Thang , Abhinav Srivastav

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

机器学习 · 计算机科学 2024-05-21 Jiashuo Jiang

In online learning, the data is provided in a sequential order, and the goal of the learner is to make online decisions to minimize overall regrets. This note is concerned with continuous-time models and algorithms for several online…

机器学习 · 统计学 2024-05-20 Lexing Ying

We study non-convex delayed-noise online optimization problems by evaluating dynamic regret in the non-stationary setting when the loss functions are quasar-convex. In particular, we consider scenarios involving quasar-convex functions…

最优化与控制 · 数学 2026-01-08 Felipe Lara , Cristian Vega

We provide an online convex optimization algorithm with regret that interpolates between the regret of an algorithm using an optimal preconditioning matrix and one using a diagonal preconditioning matrix. Our regret bound is never worse…

机器学习 · 计算机科学 2019-05-31 Ashok Cutkosky , Tamas Sarlos

Smoothed online combinatorial optimization considers a learner who repeatedly chooses a combinatorial decision to minimize an unknown changing cost function with a penalty on switching decisions in consecutive rounds. We study smoothed…

机器学习 · 计算机科学 2023-01-18 Kai Wang , Zhao Song , Georgios Theocharous , Sridhar Mahadevan

Non-linear, especially convex, objective functions have been extensively studied in recent years in which approaches relies crucially on the convexity property of cost functions. In this paper, we present primal-dual approaches based on…

数据结构与算法 · 计算机科学 2017-08-17 Nguyen Kim Thang

Recently, much work has been done on extending the scope of online learning and incremental stochastic optimization algorithms. In this paper we contribute to this effort in two ways: First, based on a new regret decomposition and a…

机器学习 · 计算机科学 2017-09-12 Pooria Joulani , András György , Csaba Szepesvári

In this paper, we consider an online optimization process, where the objective functions are not convex (nor concave) but instead belong to a broad class of continuous submodular functions. We first propose a variant of the Frank-Wolfe…

机器学习 · 统计学 2018-02-19 Lin Chen , Hamed Hassani , Amin Karbasi

We propose the algorithms for online convex optimization which lead to cumulative squared constraint violations of the form $\sum\limits_{t=1}^T\big([g(x_t)]_+\big)^2=O(T^{1-\beta})$, where $\beta\in(0,1)$. Previous literature has focused…

机器学习 · 计算机科学 2019-02-08 Jianjun Yuan , Andrew Lamperski

This paper addresses Online Convex Optimization (OCO) problems where the constraints have additive perturbations that (i) vary over time and (ii) are not known at the time to make a decision. Perturbations may not be i.i.d. generated and…

最优化与控制 · 数学 2019-06-04 Víctor Valls , George Iosifidis , Douglas J. Leith , Leandros Tassiulas

We introduce a new online convex optimization algorithm that adaptively chooses its regularization function based on the loss functions observed so far. This is in contrast to previous algorithms that use a fixed regularization function…

机器学习 · 计算机科学 2010-07-08 H. Brendan McMahan , Matthew Streeter