English
Related papers

Related papers: A Generalized Frank-Wolfe Method With "Dual Averag…

200 papers

In the present paper, we formulate two versions of Frank--Wolfe algorithm or conditional gradient method to solve the DC optimization problem with an adaptive step size. The DC objective function consists of two components; the first is…

Optimization and Control · Mathematics 2026-02-02 R. Díaz Millán , O. P. Ferreira , J. Ugon

Some variant of the Frank-Wolfe method for convex optimization problems with adaptive selection of the step parameter corresponding to information about the smoothness of the objective function (the Lipschitz constant of the gradient).…

Optimization and Control · Mathematics 2023-08-01 G. V. Aivazian , F. S. Stonyakin , D. A. Pasechnyuk , M. S. Alkousa , A. M. Raigorodskii

A broad class of convex optimization problems can be formulated as a semidefinite program (SDP), minimization of a convex function over the positive-semidefinite cone subject to some affine constraints. The majority of classical SDP solvers…

Optimization and Control · Mathematics 2019-10-30 Francesco Locatello , Alp Yurtsever , Olivier Fercoq , Volkan Cevher

In this paper, we consider Frank-Wolfe-based algorithms for composite convex optimization problems with objective involving a logarithmically-homogeneous, self-concordant functions. Recent Frank-Wolfe-based methods for this class of…

Optimization and Control · Mathematics 2023-10-24 Nimita Shinde , Vishnu Narayanan , James Saunderson

Recently the away-step Frank-Wolfe algoritm for constrained multiobjective optimization has been shown linear convergence rate over a polytope which is generated by finite points set. In this paper we design a decomposition-invariant…

Optimization and Control · Mathematics 2024-09-10 Zhuoxin Fan , Liping Tang

We present and analyze a new generalized Frank-Wolfe method for the composite optimization problem $(P):{\min}_{x\in\mathbb{R}^n}\; f(\mathsf{A} x) + h(x)$, where $f$ is a $\theta$-logarithmically-homogeneous self-concordant barrier,…

Optimization and Control · Mathematics 2021-12-07 Renbo Zhao , Robert M. Freund

This article deals with multiobjective composite optimization problems that consist of simultaneously minimizing several objective functions, each of which is composed of a combination of smooth and non-smooth functions. To tackle these…

Optimization and Control · Mathematics 2023-02-28 P. B. Assunção , O. P. Ferreira , L. F. Prudente

We investigate the resolution of second-order, potential, and monotone mean field games with the generalized conditional gradient algorithm, an extension of the Frank-Wolfe algorithm. We show that the method is equivalent to the fictitious…

Optimization and Control · Mathematics 2023-08-22 Pierre Lavigne , Laurent Pfeiffer

The Frank-Wolfe (FW) method, which implements efficient linear oracles that minimize linear approximations of the objective function over a fixed compact convex set, has recently received much attention in the optimization and machine…

Optimization and Control · Mathematics 2024-01-19 Liaoyuan Zeng , Yongle Zhang , Guoyin Li , Ting Kei Pong , Xiaozhou Wang

In this paper, we consider large-scale linearly constrained composite convex optimization problem, whose objective is a sum of a smooth function and a possibly nonsmooth function. We propose a scalable \textbf{F}rank-\textbf{W}olfe based…

Optimization and Control · Mathematics 2015-10-13 Ya-Feng Liu , Xiangfeng Wang , Xin Liu , Shiqian Ma

We propose a novel Stochastic Frank-Wolfe (a.k.a. conditional gradient) algorithm for constrained smooth finite-sum minimization with a generalized linear prediction/structure. This class of problems includes empirical risk minimization…

Frank-Wolfe algorithms for convex minimization have recently gained considerable attention from the Optimization and Machine Learning communities, as their properties make them a suitable choice in a variety of applications. However, as…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Johan Suykens

Projection-free optimization via different variants of the Frank-Wolfe (FW) method has become one of the cornerstones in large scale optimization for machine learning and computational statistics. Numerous applications within these fields…

Optimization and Control · Mathematics 2021-08-03 Pavel Dvurechensky , Kamil Safin , Shimrit Shtern , Mathias Staudigl

We address a large-scale and nonconvex optimization problem, involving an aggregative term. This term can be interpreted as the sum of the contributions of N agents to some common good, with N large. We investigate a relaxation of this…

Optimization and Control · Mathematics 2023-06-19 J. Frédéric Bonnans , Kang Liu , Nadia Oudjane , Laurent Pfeiffer , Cheng Wan

We study Frank-Wolfe (FW) methods for constrained bilevel optimization when the lower-level problem is solved only approximately, yielding biased and inexact hypergradients. We analyze inexact variants of vanilla FW as well as away-step and…

Optimization and Control · Mathematics 2026-02-27 Anthony Palmieri , Francesco Rinaldi , Saverio Salzo , Sara Venturini

In this paper, we consider approximate Frank-Wolfe (FW) algorithms to solve convex optimization problems over graph-structured support sets where the linear minimization oracle (LMO) cannot be efficiently obtained in general. We first…

Optimization and Control · Mathematics 2022-06-20 Baojian Zhou , Yifan Sun

We develop a Frank-Wolfe algorithm with corrective steps, generalizing previous algorithms including blended conditional gradients, blended pairwise conditional gradients, and fully-corrective Frank-Wolfe. For this, we prove tight…

Optimization and Control · Mathematics 2026-05-21 Jannis Halbey , Seta Rakotomandimby , Mathieu Besançon , Sébastien Designolle , Sebastian Pokutta

This paper considers distributed stochastic optimization, in which a number of agents cooperate to optimize a global objective function through local computations and information exchanges with neighbors over a network. Stochastic…

Optimization and Control · Mathematics 2022-08-09 Jie Hou , Xianlin Zeng , Gang Wang , Jian Sun , Jie Chen

We study Frank-Wolfe algorithms - standard, pairwise, and away-steps - for efficient optimization of Dominant Set Clustering. We present a unified and computationally efficient framework to employ the different variants of Frank-Wolfe…

Machine Learning · Computer Science 2022-12-06 Carl Johnell , Morteza Haghir Chehreghani

The Frank-Wolfe algorithm has become a popular first-order optimization algorithm for it is simple and projection-free, and it has been successfully applied to a variety of real-world problems. Its main drawback however lies in its…

Optimization and Control · Mathematics 2020-06-25 Cyrille W. Combettes , Sebastian Pokutta