English
Related papers

Related papers: CCCP is Frank-Wolfe in disguise

200 papers

We study Frank-Wolfe algorithms - standard, pairwise, and away-steps - for efficient optimization of Dominant Set Clustering. We present a unified and computationally efficient framework to employ the different variants of Frank-Wolfe…

Machine Learning · Computer Science 2022-12-06 Carl Johnell , Morteza Haghir Chehreghani

Motivated principally by the low-rank matrix completion problem, we present an extension of the Frank-Wolfe method that is designed to induce near-optimal solutions on low-dimensional faces of the feasible region. This is accomplished by a…

Optimization and Control · Mathematics 2015-11-09 Robert M. Freund , Paul Grigas , Rahul Mazumder

In recent years it was proved that simple modifications of the classical Frank-Wolfe algorithm (aka conditional gradient algorithm) for smooth convex minimization over convex and compact polytopes, converge with linear rate, assuming the…

Optimization and Control · Mathematics 2021-01-08 Dan Garber

The analysis of Frank Wolfe (FW) variants is often complicated by the presence of different kinds of "good" and "bad" steps. In this article we aim to simplify the convergence analysis of some of these variants by getting rid of such a…

Optimization and Control · Mathematics 2022-11-22 Francesco Rinaldi , Damiano Zeffiro

Convexification based on convex envelopes is ubiquitous in the non-linear optimization literature. Thanks to considerable efforts of the optimization community for decades, we are able to compute the convex envelopes of a considerable…

Optimization and Control · Mathematics 2022-10-17 Javiera Barrera , Eduardo Moreno , Gonzalo Muñoz

The convex hull membership problem (CHMP) consists in deciding whether a certain point belongs to the convex hull of a finite set of points, a decision problem with important applications in computational geometry and in foundations of…

Optimization and Control · Mathematics 2022-09-05 Rafaela Filippozzi , Douglas S. Gonçalves , Luiz-Rafael Santos

Similarity and metric learning provides a principled approach to construct a task-specific similarity from weakly supervised data. However, these methods are subject to the curse of dimensionality: as the number of features grows large,…

Machine Learning · Statistics 2019-09-10 Kuan Liu , Aurélien Bellet

Chance-constrained programs (CCPs) constitute a difficult class of stochastic programs due to its possible nondifferentiability and nonconvexity even with simple linear random functionals. Existing approaches for solving the CCPs mainly…

Optimization and Control · Mathematics 2022-03-02 Ying Cui , Junyi Liu , Jong-Shi Pang

Frank-Wolfe methods are projection-free algorithms for constrained optimization whose practical performance often depends critically on the choice of step size. Classical closed-loop step-size rules typically require prior knowledge of a…

Optimization and Control · Mathematics 2026-05-29 Khanh-Hung Giang-Tran , Soroosh Shafiee , Nam Ho-Nguyen

Multi-category support vector machine (MC-SVM) is one of the most popular machine learning algorithms. There are lots of variants of MC-SVM, although different optimization algorithms were developed for different learning machines. In this…

Machine Learning · Computer Science 2021-11-10 Kenya Tajima , Yoshihiro Hirohashi , Esmeraldo Ronnie Rey Zara , Tsuyoshi Kato

We investigate a class of nonconvex optimization problems characterized by a feasible set consisting of level-bounded nonconvex regularizers, with a continuously differentiable objective. We propose a novel hybrid approach to tackle such…

Optimization and Control · Mathematics 2024-10-28 Xiangyu Yang , Hao Wang , Yichen Zhu , Xiao Wang

We discuss the problem of projecting a point onto an arbitrary hyperbolicity cone from both theoretical and numerical perspectives. While hyperbolicity cones are furnished with a generalization of the notion of eigenvalues, obtaining closed…

Optimization and Control · Mathematics 2026-03-04 Takayuki Nagano , Bruno F. Lourenço , Akiko Takeda

The k-sat problem is a prototypical constraint satisfaction problem. There are many algorithms to study k-sat problem, BP algorithm is famous one of them. But BP algorithm does not converge when $\alpha$(constraint density)is bigger than…

Data Analysis, Statistics and Probability · Physics 2014-06-18 Yusupjan Habibulla

We present new results for the Frank-Wolfe method (also known as the conditional gradient method). We derive computational guarantees for arbitrary step-size sequences, which are then applied to various step-size rules, including simple…

Optimization and Control · Mathematics 2014-06-03 Robert M. Freund , Paul Grigas

While counterfactual fairness of point predictors is well studied, its extension to prediction sets--central to fair decision-making under uncertainty--remains underexplored. On the other hand, conformal prediction (CP) provides efficient,…

Machine Learning · Computer Science 2026-03-13 Ozgur Guldogan , Neeraj Sarna , Yuanyuan Li , Michael Berger

Some variant of the Frank-Wolfe method for convex optimization problems with adaptive selection of the step parameter corresponding to information about the smoothness of the objective function (the Lipschitz constant of the gradient).…

Optimization and Control · Mathematics 2023-08-01 G. V. Aivazian , F. S. Stonyakin , D. A. Pasechnyuk , M. S. Alkousa , A. M. Raigorodskii

We study the enclosure method for the p-Calder\'on problem, which is a nonlinear generalization of the inverse conductivity problem due to Calder\'on that involves the p-Laplace equation. The method allows one to reconstruct the convex hull…

Analysis of PDEs · Mathematics 2015-03-17 Tommi Brander , Manas Kar , Mikko Salo

We consider the problem of minimizing a smooth and convex function over the $n$-dimensional spectrahedron -- the set of real symmetric $n\times n$ positive semidefinite matrices with unit trace, which underlies numerous applications in…

Optimization and Control · Mathematics 2026-03-03 Dan Garber

Coordinate descent algorithms are popular for huge-scale optimization problems due to their low cost per-iteration. Coordinate descent methods apply to problems where the constraint set is separable across coordinates. In this paper, we…

Optimization and Control · Mathematics 2023-04-28 Rahul Mazumder , Haoyue Wang

Mixed-integer nonlinear optimization encompasses a broad class of problems that present both theoretical and computational challenges. We propose a new type of method to solve these problems based on a branch-and-bound algorithm with convex…

Optimization and Control · Mathematics 2024-07-19 Deborah Hendrych , Hannah Troppens , Mathieu Besançon , Sebastian Pokutta