English
Related papers

Related papers: New Variants of Frank-Wolfe Algorithm for Video Co…

200 papers

We study Frank-Wolfe algorithms - standard, pairwise, and away-steps - for efficient optimization of Dominant Set Clustering. We present a unified and computationally efficient framework to employ the different variants of Frank-Wolfe…

Machine Learning · Computer Science 2022-12-06 Carl Johnell , Morteza Haghir Chehreghani

The complexity in large-scale optimization can lie in both handling the objective function and handling the constraint set. In this respect, stochastic Frank-Wolfe algorithms occupy a unique position as they alleviate both computational…

Optimization and Control · Mathematics 2021-02-16 Cyrille W. Combettes , Christoph Spiegel , Sebastian Pokutta

Decentralized optimization algorithms have received much attention due to the recent advances in network information processing. However, conventional decentralized algorithms based on projected gradient descent are incapable of handling…

Optimization and Control · Mathematics 2018-08-29 Hoi-To Wai , Jean Lafond , Anna Scaglione , Eric Moulines

The Frank-Wolfe algorithm is a classic method for constrained optimization problems. It has recently been popular in many machine learning applications because its projection-free property leads to more efficient iterations. In this paper,…

Optimization and Control · Mathematics 2020-10-23 Cheng Chen , Luo Luo , Weinan Zhang , Yong Yu

The Frank-Wolfe (FW) optimization algorithm has lately re-gained popularity thanks in particular to its ability to nicely handle the structured constraints appearing in machine learning applications. However, its convergence rate is known…

Optimization and Control · Mathematics 2015-11-19 Simon Lacoste-Julien , Martin Jaggi

The graph isomorphism problem looks deceptively simple, but although polynomial-time algorithms exist for certain types of graphs such as planar graphs and graphs with bounded degree or eigenvalue multiplicity, its complexity class is still…

Discrete Mathematics · Computer Science 2025-07-11 Stefan Klus , Patrick Gelß

Stochastic Frank-Wolfe is a classical optimization method for solving constrained optimization problems. On the other hand, recent optimizers such as Lion and Muon have gained quite significant popularity in deep learning. In this work,…

Optimization and Control · Mathematics 2026-02-03 Maria-Eleni Sfyraki , Jun-Kun Wang

Given a set of images containing objects from the same category, the task of image co-localization is to identify and localize each instance. This paper shows that this problem can be solved by a simple but intriguing idea, that is, a…

Computer Vision and Pattern Recognition · Computer Science 2016-07-26 Yao Li , Linqiao Liu , Chunhua Shen , Anton van den Hengel

Projection-free optimization via different variants of the Frank-Wolfe (FW), a.k.a. Conditional Gradient method has become one of the cornerstones in optimization for machine learning since in many cases the linear minimization oracle is…

Optimization and Control · Mathematics 2020-06-30 Pavel Dvurechensky , Petr Ostroukhov , Kamil Safin , Shimrit Shtern , Mathias Staudigl

Frank-Wolfe algorithms have recently regained the attention of the Machine Learning community. Their solid theoretical properties and sparsity guarantees make them a suitable choice for a wide range of problems in this field. In addition,…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Johan A. K. Suykens

This paper considers distributed stochastic optimization, in which a number of agents cooperate to optimize a global objective function through local computations and information exchanges with neighbors over a network. Stochastic…

Optimization and Control · Mathematics 2022-08-09 Jie Hou , Xianlin Zeng , Gang Wang , Jian Sun , Jie Chen

Some variant of the Frank-Wolfe method for convex optimization problems with adaptive selection of the step parameter corresponding to information about the smoothness of the objective function (the Lipschitz constant of the gradient).…

Optimization and Control · Mathematics 2023-08-01 G. V. Aivazian , F. S. Stonyakin , D. A. Pasechnyuk , M. S. Alkousa , A. M. Raigorodskii

In this paper we provide an introduction to the Frank-Wolfe algorithm, a method for smooth convex optimization in the presence of (relatively) complicated constraints. We will present the algorithm, introduce key concepts, and establish…

Optimization and Control · Mathematics 2023-11-30 Sebastian Pokutta

In this paper, we propose a generalized conditional gradient method for multiobjective optimization, which can be viewed as an improved extension of the classical Frank-Wolfe (conditional gradient) method for single-objective optimization.…

Optimization and Control · Mathematics 2025-03-25 Anteneh Getachew Gebrie , Ellen Hidemi Fukuda

We propose an enhanced zeroth-order stochastic Frank-Wolfe framework to address constrained finite-sum optimization problems, a structure prevalent in large-scale machine-learning applications. Our method introduces a novel double variance…

Machine Learning · Computer Science 2025-01-24 Haishan Ye , Yinghui Huang , Hao Di , Xiangyu Chang

Similarity and metric learning provides a principled approach to construct a task-specific similarity from weakly supervised data. However, these methods are subject to the curse of dimensionality: as the number of features grows large,…

Machine Learning · Statistics 2019-09-10 Kuan Liu , Aurélien Bellet

Temporal action localization aims to identify the boundaries and categories of actions in videos, such as scoring a goal in a football match. Single-frame supervision has emerged as a labor-efficient way to train action localizers as it…

Human-Computer Interaction · Computer Science 2023-12-11 Changjian Chen , Jiashu Chen , Weikai Yang , Haoze Wang , Johannes Knittel , Xibin Zhao , Steffen Koch , Thomas Ertl , Shixia Liu

Many methods have been developed to help people find the video contents they want efficiently. However, there are still some unsolved problems in this area. For example, given a query video and a reference video, how to accurately localize…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Yang Feng , Lin Ma , Wei Liu , Tong Zhang , Jiebo Luo

We develop a novel variant of the classical Frank-Wolfe algorithm, which we call spectral Frank-Wolfe, for convex optimization over a spectrahedron. The spectral Frank-Wolfe algorithm has a novel ingredient: it computes a few eigenvectors…

Optimization and Control · Mathematics 2020-08-18 Lijun Ding , Yingjie Fei , Qiantong Xu , Chengrun Yang

We present new results for the Frank-Wolfe method (also known as the conditional gradient method). We derive computational guarantees for arbitrary step-size sequences, which are then applied to various step-size rules, including simple…

Optimization and Control · Mathematics 2014-06-03 Robert M. Freund , Paul Grigas