English
Related papers

Related papers: A Primal-Dual Frank-Wolfe Algorithm for Linear Pro…

200 papers

In this paper, we study the problem of minimizing a sum of convex objective functions, which are locally available to agents in a network. Distributed optimization algorithms make it possible for the agents to cooperatively solve the…

Optimization and Control · Mathematics 2020-03-31 Fatemeh Mansoori , Ermin Wei

Stochastic nonconvex-concave min-max saddle point problems appear in many machine learning and control problems including distributionally robust optimization, generative adversarial networks, and adversarial learning. In this paper, we…

Optimization and Control · Mathematics 2023-09-12 Morteza Boroun , Zeinab Alizadeh , Afrooz Jalilzadeh

We develop block structure adapted primal-dual algorithms for non-convex non-smooth optimisation problems whose objectives can be written as compositions $G(x)+F(K(x))$ of non-smooth block-separable convex functions $G$ and $F$ with a…

Optimization and Control · Mathematics 2020-09-25 Stanislav Mazurenko , Jyrki Jauhiainen , Tuomo Valkonen

Frank-Wolfe algorithms (FW) are popular first-order methods for solving constrained convex optimization problems that rely on a linear minimization oracle instead of potentially expensive projection-like oracles. Many works have identified…

Optimization and Control · Mathematics 2023-09-18 Elias Wirth , Thomas Kerdreux , Sebastian Pokutta

We present experimental work on a primal-dual framework simultaneously approximating maximum cut and weighted fractional cut-covering instances. In this primal-dual framework, we solve a semidefinite programming (SDP) relaxation to either…

Optimization and Control · Mathematics 2026-04-21 Nathan Benedetto Proença , Marcel K. de Carli Silva , Cristiane M. Sato , Levent Tunçel

In this paper we present a novel numerical method for computing local minimizers of twice smooth differentiable non-linear programming (NLP) problems. So far all algorithms for NLP are based on either of the following three principles:…

Numerical Analysis · Mathematics 2018-03-06 Martin Neuenhofen

In this paper, we adapt proximal incremental aggregated gradient methods to saddle point problems, which is motivated by decoupling linear transformations in regularized empirical risk minimization models. First, the Primal-Dual Proximal…

Optimization and Control · Mathematics 2019-11-14 Zhou Xianchen , Peng Wei , Wang Hongxia

In this paper, we propose and analyze a new matrix-free primal-dual algorithm, called restarted Halpern primal-dual hybrid gradient (rHPDHG), for solving linear programming (LP). We show that rHPDHG can achieve optimal accelerated linear…

Optimization and Control · Mathematics 2024-09-11 Haihao Lu , Jinwen Yang

In this paper, we propose a new primal-dual algorithm for minimizing $f(x) + g(x) + h(Ax)$, where $f$, $g$, and $h$ are proper lower semi-continuous convex functions, $f$ is differentiable with a Lipschitz continuous gradient, and $A$ is a…

Optimization and Control · Mathematics 2018-01-30 Ming Yan

One of the most attractive recent approaches to processing well-structured large-scale convex optimization problems is based on smooth convex-concave saddle point reformu-lation of the problem of interest and solving the resulting problem…

Data Structures and Algorithms · Computer Science 2014-05-22 Aharon Ben-Tal , Arkadi Nemirovski

The Frank-Wolfe algorithm is a popular method in structurally constrained machine learning applications, due to its fast per-iteration complexity. However, one major limitation of the method is a slow rate of convergence that is difficult…

Optimization and Control · Mathematics 2023-04-14 Zhaoyue Chen , Yifan Sun

A broad class of convex optimization problems can be formulated as a semidefinite program (SDP), minimization of a convex function over the positive-semidefinite cone subject to some affine constraints. The majority of classical SDP solvers…

Optimization and Control · Mathematics 2019-10-30 Francesco Locatello , Alp Yurtsever , Olivier Fercoq , Volkan Cevher

The convex hull membership problem (CHMP) consists in deciding whether a certain point belongs to the convex hull of a finite set of points, a decision problem with important applications in computational geometry and in foundations of…

Optimization and Control · Mathematics 2022-09-05 Rafaela Filippozzi , Douglas S. Gonçalves , Luiz-Rafael Santos

Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the…

Machine Learning · Computer Science 2018-06-27 Han Zhao , Geoff Gordon

Many algorithms in verification and automated reasoning leverage some form of duality between proofs and refutations or counterexamples. In most cases, duality is only used as an intuition that helps in understanding the algorithms and is…

Programming Languages · Computer Science 2025-01-06 Takeshi Tsukada , Hiroshi Unno , Oded Padon , Sharon Shoham

We study integer linear programs (ILP) of the form $\min\{c^\top x\ \vert\ Ax=b,l\le x\le u,x\in\mathbb Z^n\}$ and analyze their parameterized complexity with respect to their distance to the generalized matching problem, following the…

Computational Complexity · Computer Science 2025-10-20 Alexandra Lassota , Koen Ligthart

We develop a novel variant of the classical Frank-Wolfe algorithm, which we call spectral Frank-Wolfe, for convex optimization over a spectrahedron. The spectral Frank-Wolfe algorithm has a novel ingredient: it computes a few eigenvectors…

Optimization and Control · Mathematics 2020-08-18 Lijun Ding , Yingjie Fei , Qiantong Xu , Chengrun Yang

We develop a first-order accelerated algorithm for a class of constrained bilinear saddle-point problems with applications to network systems. The algorithm is a modified time-varying primal-dual version of an accelerated mirror-descent…

Optimization and Control · Mathematics 2024-10-04 Weijian Li , Xianlin Zeng , Lacra Pavel

The complexity in large-scale optimization can lie in both handling the objective function and handling the constraint set. In this respect, stochastic Frank-Wolfe algorithms occupy a unique position as they alleviate both computational…

Optimization and Control · Mathematics 2021-02-16 Cyrille W. Combettes , Christoph Spiegel , Sebastian Pokutta

We review the simplex method and two interior-point methods (the affine scaling and the primal-dual) for solving linear programming problems for checking avoiding sure loss, and propose novel improvements. We exploit the structure of these…

Optimization and Control · Mathematics 2019-07-01 Nawapon Nakharutai , Matthias C. M. Troffaes , Camila C. S. Caiado