English
Related papers

Related papers: Minding the Gaps for Block Frank-Wolfe Optimizatio…

200 papers

The Frank Wolfe algorithm (FW) is a popular projection-free alternative for solving large-scale constrained optimization problems. However, the FW algorithm suffers from a sublinear convergence rate when minimizing a smooth convex function…

Optimization and Control · Mathematics 2021-10-20 Robin Francis , Sundeep Prabhakar Chepuri

We consider continuous-time dynamics for distributed optimization with set constraints in the paper. To handle the computational complexity of projection-based dynamics due to solving a general quadratic optimization subproblem with…

Optimization and Control · Mathematics 2022-06-24 Guanpu Chen , Peng Yi , Yiguang Hong , Jie Chen

We introduce a new class of Frank-Wolfe algorithms for minimizing differentiable functionals over probability measures. This framework can be shown to encompass a diverse range of tasks in areas such as artificial intelligence,…

Computation · Statistics 2021-05-13 Carson Kent , Jose Blanchet , Peter Glynn

In recent years it was proved that simple modifications of the classical Frank-Wolfe algorithm (aka conditional gradient algorithm) for smooth convex minimization over convex and compact polytopes, converge with linear rate, assuming the…

Optimization and Control · Mathematics 2021-01-08 Dan Garber

We present an exact algorithm for mean-risk optimization subject to a budget constraint, where decision variables may be continuous or integer. The risk is measured by the covariance matrix and weighted by an arbitrary monotone function,…

Optimization and Control · Mathematics 2017-05-08 Christoph Buchheim , Marianna De Santis , Francesco Rinaldi , Long Trieu

We present a blended conditional gradient approach for minimizing a smooth convex function over a polytope P, combining the Frank--Wolfe algorithm (also called conditional gradient) with gradient-based steps, different from away steps and…

Optimization and Control · Mathematics 2025-03-24 Gábor Braun , Sebastian Pokutta , Dan Tu , Stephen Wright

In random allocation rules, typically first an optimal fractional point is calculated via solving a linear program. The calculated point represents a fractional assignment of objects or more generally packages of objects to agents. In order…

Computer Science and Game Theory · Computer Science 2016-08-16 Salman Fadaei

Similarity and metric learning provides a principled approach to construct a task-specific similarity from weakly supervised data. However, these methods are subject to the curse of dimensionality: as the number of features grows large,…

Machine Learning · Statistics 2019-09-10 Kuan Liu , Aurélien Bellet

We revisit the Frank-Wolfe (FW) optimization under strongly convex constraint sets. We provide a faster convergence rate for FW without line search, showing that a previously overlooked variant of FW is indeed faster than the standard…

Machine Learning · Computer Science 2019-02-01 Jarrid Rector-Brooks , Jun-Kun Wang , Barzan Mozafari

We consider an optimization problem over measures for emergency response to out-of-hospital cardiac arrest (OHCA), where the goal is to allocate volunteer resources across a spatial region to minimize the probability of death. The problem…

Optimization and Control · Mathematics 2025-07-15 Di Yu , Shane G. Henderson , Raghu Pasupathy

This paper aims at improving the classification accuracy of a Support Vector Machine (SVM) classifier with Sequential Minimal Optimization (SMO) training algorithm in order to properly classify failure and normal instances from oil and gas…

Machine Learning · Computer Science 2021-01-01 Zhiyuan Chen , Isa Dino , Nik Ahmad Akram

Structured constraints in Machine Learning have recently brought the Frank-Wolfe (FW) family of algorithms back in the spotlight. While the classical FW algorithm has poor local convergence properties, the Away-steps and Pairwise FW…

Optimization and Control · Mathematics 2022-09-09 Fabian Pedregosa , Geoffrey Negiar , Armin Askari , Martin Jaggi

This paper proposes a distributed stochastic projection-free algorithm for large-scale constrained finite-sum optimization whose constraint set is complicated such that the projection onto the constraint set can be expensive. The global…

Optimization and Control · Mathematics 2022-04-25 Xia Jiang , Xianlin Zeng , Lihua Xie , Jian Sun , Jie Chen

The Frank-Wolfe method is a popular method in sparse constrained optimization, due to its fast per-iteration complexity. However, the tradeoff is that its worst case global convergence is comparatively slow, and importantly, is…

Optimization and Control · Mathematics 2022-05-25 Zhaoyue Chen , Yifan Sun

The co-localization problem is a model that simultaneously localizes objects of the same class within a series of images or videos. In \cite{joulin2014efficient}, authors present new variants of the Frank-Wolfe algorithm (aka conditional…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Hamid Nazari

This paper presents a unified approach for maximizing continuous DR-submodular functions that encompasses a range of settings and oracle access types. Our approach includes a Frank-Wolfe type offline algorithm for both monotone and…

Machine Learning · Computer Science 2024-01-15 Mohammad Pedramfar , Christopher John Quinn , Vaneet Aggarwal

We develop new accelerated first-order algorithms in the Frank-Wolfe (FW) family for minimizing smooth convex functions over compact convex sets, with a focus on two prominent constraint classes: (1) polytopes and (2) matrix domains given…

Optimization and Control · Mathematics 2025-11-05 Dan Garber

We present the Structured Weighted Violations Perceptron (SWVP) algorithm, a new structured prediction algorithm that generalizes the Collins Structured Perceptron (CSP). Unlike CSP, the update rule of SWVP explicitly exploits the internal…

Machine Learning · Computer Science 2016-09-15 Rotem Dror , Roi Reichart

As edge computing capabilities increase, model learning deployments in diverse edge environments have emerged. In experimental design networks, introduced recently, network routing and rate allocation are designed to aid the transfer of…

Networking and Internet Architecture · Computer Science 2024-01-11 Yuanyuan Li , Lili Su , Carlee Joe-Wong , Edmund Yeh , Stratis Ioannidis

In the fixed budget thresholding bandit problem, an algorithm sequentially allocates a budgeted number of samples to different distributions. It then predicts whether the mean of each distribution is larger or lower than a given threshold.…

Machine Learning · Computer Science 2021-10-19 Reda Ouhamma , Rémy Degenne , Pierre Gaillard , Vianney Perchet