中文
相关论文

相关论文: BAGEL: Projection-Free Algorithm for Adversarially…

200 篇论文

In this work, we explore online convex optimization (OCO) and introduce a new condition and analysis that provides fast rates by exploiting the curvature of feasible sets. In online linear optimization, it is known that if the average…

机器学习 · 计算机科学 2025-02-18 Taira Tsuchiya , Shinji Ito

We study the problem of online convex optimization (OCO) under unknown linear constraints that are either static, or stochastically time-varying. For this problem, we introduce an algorithm that we term Optimistically Safe OCO (OSOCO) and…

机器学习 · 计算机科学 2025-07-16 Spencer Hutchinson , Tianyi Chen , Mahnoosh Alizadeh

This paper considers a convex composite optimization problem with affine constraints, which includes problems that take the form of minimizing a smooth convex objective function over the intersection of (simple) convex sets, or regularized…

最优化与控制 · 数学 2023-02-23 Dan Garber , Tsur Livney , Shoham Sabach

Projection operations are a typical computation bottleneck in online learning. In this paper, we enable projection-free online learning within the framework of Online Convex Optimization with Memory (OCO-M) -- OCO-M captures how the history…

机器学习 · 计算机科学 2023-04-03 Hongyu Zhou , Zirui Xu , Vasileios Tzoumas

In the framework of online convex optimization, most iterative algorithms require the computation of projections onto convex sets, which can be computationally expensive. To tackle this problem HK12 proposed the study of projection-free…

机器学习 · 计算机科学 2022-12-16 Zhou Lu , Nataly Brukhim , Paula Gradu , Elad Hazan

In many online learning problems the computational bottleneck for gradient-based methods is the projection operation. For this reason, in many problems the most efficient algorithms are based on the Frank-Wolfe method, which replaces…

机器学习 · 计算机科学 2020-02-17 Elad Hazan , Edgar Minasyan

This paper addresses Online Convex Optimization (OCO) problems where the constraints have additive perturbations that (i) vary over time and (ii) are not known at the time to make a decision. Perturbations may not be i.i.d. generated and…

最优化与控制 · 数学 2019-06-04 Víctor Valls , George Iosifidis , Douglas J. Leith , Leandros Tassiulas

This paper considers online convex optimization over a complicated constraint set, which typically consists of multiple functional constraints and a set constraint. The conventional online projection algorithm (Zinkevich, 2003) can be…

最优化与控制 · 数学 2020-05-19 Hao Yu , Michael J. Neely

Learning at the edges has become increasingly important as large quantities of data are continually generated locally. Among others, this paradigm requires algorithms that are simple (so that they can be executed by local devices), robust…

机器学习 · 计算机科学 2024-02-06 Tuan-Anh Nguyen , Nguyen Kim Thang , Denis Trystram

A well-studied generalization of the standard online convex optimization (OCO) is constrained online convex optimization (COCO). In COCO, on every round, a convex cost function and a convex constraint function are revealed to the learner…

机器学习 · 计算机科学 2024-05-16 Abhishek Sinha , Rahul Vaze

The constrained version of the standard online convex optimization (OCO) framework, called COCO is considered, where on every round, a convex cost function and a convex constraint function are revealed to the learner after it chooses the…

机器学习 · 计算机科学 2025-02-11 Rahul Vaze , Abhishek Sinha

Constrained Online Convex Optimization (COCO) can be seen as a generalization of the standard Online Convex Optimization (OCO) framework. At each round, a cost function and constraint function are revealed after a learner chooses an action.…

机器学习 · 计算机科学 2025-05-30 Ricardo N. Ferreira , Cláudia Soares

When faced with multiple minima of an "inner-level" convex optimization problem, the convex bilevel optimization problem selects an optimal solution which also minimizes an auxiliary "outer-level" convex objective of interest. Bilevel…

最优化与控制 · 数学 2024-10-10 Khanh-Hung Giang-Tran , Nam Ho-Nguyen , Dabeen Lee

This work studies and develop projection-free algorithms for online learning with linear optimization oracles (a.k.a. Frank-Wolfe) for handling the constraint set. More precisely, this work (i) provides an improved (optimized) variant of an…

最优化与控制 · 数学 2026-05-20 Julien Weibel , Pierre Gaillard , Wouter M. Koolen , Adrien Taylor

In this paper we propose a framework for solving constrained online convex optimization problem. Our motivation stems from the observation that most algorithms proposed for online convex optimization require a projection onto the convex set…

机器学习 · 计算机科学 2012-10-01 Mehrdad Mahdavi , Rong Jin , Tianbao Yang

We study the problem of safe online convex optimization, where the action at each time step must satisfy a set of linear safety constraints. The goal is to select a sequence of actions to minimize the regret without violating the safety…

机器学习 · 计算机科学 2021-11-16 Sapana Chaudhary , Dileep Kalathil

We study Constrained Online Convex Optimization with Memory (COCO-M), where both the loss and the constraints depend on a finite window of past decisions made by the learner. This setting extends the previously studied unconstrained online…

机器学习 · 计算机科学 2026-03-24 Mohammed Abdullah , George Iosifidis , Salah Eddine Elayoubi , Tijani Chahed

To efficiently solve online problems with complicated constraints, projection-free algorithms including online frank-wolfe (OFW) and its variants have received significant interest recently. However, in the general case, existing efficient…

机器学习 · 计算机科学 2024-06-25 Yuanyu Wan , Lijun Zhang

We investigate decentralized online convex optimization (D-OCO), in which a set of local learners are required to minimize a sequence of global loss functions using only local computations and communications. Previous studies have…

机器学习 · 计算机科学 2024-12-12 Yuanyu Wan , Tong Wei , Bo Xue , Mingli Song , Lijun Zhang

In this paper, we develop a novel virtual-queue-based online algorithm for online convex optimization (OCO) problems with long-term and time-varying constraints and conduct a performance analysis with respect to the dynamic regret and…

最优化与控制 · 数学 2021-11-16 Qingsong Liu , Wenfei Wu , Longbo Huang , Zhixuan Fang