中文
相关论文

相关论文: Projection-free Adaptive Regret with Membership Or…

200 篇论文

This paper investigates projection-free algorithms for stochastic constrained multi-level optimization. In this context, the objective function is a nested composition of several smooth functions, and the decision set is closed and convex.…

最优化与控制 · 数学 2024-06-07 Wei Jiang , Sifan Yang , Wenhao Yang , Yibo Wang , Yuanyu Wan , Lijun Zhang

We revisit the challenge of designing online algorithms for the bandit convex optimization problem (BCO) which are also scalable to high dimensional problems. Hence, we consider algorithms that are \textit{projection-free}, i.e., based on…

机器学习 · 计算机科学 2019-10-09 Dan Garber , Ben Kretzu

The complexity in large-scale optimization can lie in both handling the objective function and handling the constraint set. In this respect, stochastic Frank-Wolfe algorithms occupy a unique position as they alleviate both computational…

最优化与控制 · 数学 2021-02-16 Cyrille W. Combettes , Christoph Spiegel , Sebastian Pokutta

The Frank-Wolfe algorithm is a classic method for constrained optimization problems. It has recently been popular in many machine learning applications because its projection-free property leads to more efficient iterations. In this paper,…

最优化与控制 · 数学 2020-10-23 Cheng Chen , Luo Luo , Weinan Zhang , Yong Yu

This paper considers distributed online convex constrained optimization, in which various agents in a multi-agent system cooperate to minimize a global cost function through communicating with neighbors over a time-varying network. When the…

最优化与控制 · 数学 2023-02-02 Wentao Zhang , Yang Shi , Baoyong Zhang , Deming Yuan

In this paper, the online variants of the classical Frank-Wolfe algorithm are considered. We consider minimizing the regret with a stochastic cost. The online algorithms only require simple iterative updates and a non-adaptive step size…

机器学习 · 统计学 2016-08-16 Jean Lafond , Hoi-To Wai , Eric Moulines

We investigate the problem of online learning with monotone and continuous DR-submodular reward functions, which has received great attention recently. To efficiently handle this problem, especially in the case with complicated decision…

机器学习 · 计算机科学 2023-05-31 Yucheng Liao , Yuanyu Wan , Chang Yao , Mingli Song

In this paper, we focus on solving a distributed convex aggregative optimization problem in a network, where each agent has its own cost function which depends not only on its own decision variables but also on the aggregated function of…

最优化与控制 · 数学 2022-07-26 Tongyu Wang , Peng Yi

In this paper, we introduce a new projection-free algorithm for Online Convex Optimization (OCO) with a state-of-the-art regret guarantee among separation-based algorithms. Existing projection-free methods based on the classical Frank-Wolfe…

机器学习 · 计算机科学 2024-10-08 Zakaria Mhammedi

In this paper, we consider an online optimization process, where the objective functions are not convex (nor concave) but instead belong to a broad class of continuous submodular functions. We first propose a variant of the Frank-Wolfe…

机器学习 · 统计学 2018-02-19 Lin Chen , Hamed Hassani , Amin Karbasi

Frank-Wolfe algorithm (FW) and its variants have gained a surge of interests in machine learning community due to its projection-free property. Recently people have reduced the gradient evaluation complexity of FW algorithm to…

机器学习 · 统计学 2018-05-22 Yan Li , Chao Qu , Huan Xu

To deal with non-stationary online problems with complex constraints, we investigate the dynamic regret of online Frank-Wolfe (OFW), which is an efficient projection-free algorithm for online convex optimization. It is well-known that in…

机器学习 · 计算机科学 2024-06-25 Yuanyu Wan , Lijun Zhang , Mingli Song

As a projection-free algorithm, Frank-Wolfe (FW) method, also known as conditional gradient, has recently received considerable attention in the machine learning community. In this dissertation, we study several topics on the FW variants…

最优化与控制 · 数学 2021-05-11 Mingrui Zhang

In this paper, we develop new efficient projection-free algorithms for Online Convex Optimization (OCO). Online Gradient Descent (OGD) is an example of a classical OCO algorithm that guarantees the optimal $O(\sqrt{T})$ regret bound.…

机器学习 · 计算机科学 2022-05-24 Zakaria Mhammedi

We consider the setting of online convex optimization with adversarial time-varying constraints in which actions must be feasible w.r.t. a fixed constraint set, and are also required on average to approximately satisfy additional…

机器学习 · 计算机科学 2024-02-15 Dan Garber , Ben Kretzu

We introduce a new projection-free (Frank-Wolfe) method for optimizing structured nonconvex functions that are expressed as a difference of two convex functions. This problem class subsumes smooth nonconvex minimization, positioning our…

最优化与控制 · 数学 2025-12-01 Hoomaan Maskan , Yikun Hou , Suvrit Sra , Alp Yurtsever

This paper focuses on convex constrained optimization problems, where the solution is subject to a convex inequality constraint. In particular, we aim at challenging problems for which both projection into the constrained domain and a…

最优化与控制 · 数学 2017-06-13 Tianbao Yang , Qihang Lin , Lijun Zhang

This paper addresses an online convex optimization problem where the cost function at each step depends on a history of past decisions (i.e., memory), and the decision maker has access to limited predictions of future cost values within a…

最优化与控制 · 数学 2025-12-29 Zhengmiao Wang , Zhi-Wei Liu , Ming Chi , Xiaoling Wang , Housheng Su , Lintao Ye

We investigate the robustness of the Frank-Wolfe method when gradients are computed inexactly and examine the relative computational cost of the linear minimization oracle (LMO) versus projection. For smooth nonconvex functions, we…

最优化与控制 · 数学 2026-01-27 Tao Hu

To address the uncertainty in function types, recent progress in online convex optimization (OCO) has spurred the development of universal algorithms that simultaneously attain minimax rates for multiple types of convex functions. However,…

机器学习 · 计算机科学 2024-05-31 Wenhao Yang , Yibo Wang , Peng Zhao , Lijun Zhang