English
Related papers

Related papers: Sparse Optimization for Unsupervised Extractive Su…

200 papers

This paper presents a subgradient-based algorithm for constrained nonsmooth convex optimization that does not require projections onto the feasible set. While the well-established Frank-Wolfe algorithm and its variants already avoid…

Optimization and Control · Mathematics 2024-09-04 Kamiar Asgari , Michael J. Neely

We propose an accelerated algorithm with a Frank-Wolfe method as an oracle for solving strongly monotone variational inequality problems. While standard solution approaches, such as projected gradient descent (aka value iteration), involve…

Optimization and Control · Mathematics 2025-10-07 Reza Rahimi Baghbadorani , Peyman Mohajerin Esfahani , Sergio Grammatico

Recently the away-step Frank-Wolfe algoritm for constrained multiobjective optimization has been shown linear convergence rate over a polytope which is generated by finite points set. In this paper we design a decomposition-invariant…

Optimization and Control · Mathematics 2024-09-10 Zhuoxin Fan , Liping Tang

The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe…

Optimization and Control · Mathematics 2019-06-11 Paul Grigas , Alfonso Lobos , Nathan Vermeersch

The Frank-Wolfe (FW) method is a popular algorithm for solving large-scale convex optimization problems appearing in structured statistical learning. However, the traditional Frank-Wolfe method can only be applied when the feasible region…

Optimization and Control · Mathematics 2021-10-11 Haoyue Wang , Haihao Lu , Rahul Mazumder

In this paper, we consider large-scale linearly constrained composite convex optimization problem, whose objective is a sum of a smooth function and a possibly nonsmooth function. We propose a scalable \textbf{F}rank-\textbf{W}olfe based…

Optimization and Control · Mathematics 2015-10-13 Ya-Feng Liu , Xiangfeng Wang , Xin Liu , Shiqian Ma

Recovering matrices from compressive and grossly corrupted observations is a fundamental problem in robust statistics, with rich applications in computer vision and machine learning. In theory, under certain conditions, this problem can be…

Optimization and Control · Mathematics 2017-05-31 Cun Mu , Yuqian Zhang , John Wright , Donald Goldfarb

The Frank-Wolfe algorithm is a popular method for minimizing a smooth convex function $f$ over a compact convex set $\mathcal{C}$. While many convergence results have been derived in terms of function values, hardly nothing is known about…

Optimization and Control · Mathematics 2022-02-18 Jérôme Bolte , Cyrille W. Combettes , Édouard Pauwels

In this paper, we focus on solving a distributed convex aggregative optimization problem in a network, where each agent has its own cost function which depends not only on its own decision variables but also on the aggregated function of…

Optimization and Control · Mathematics 2022-07-26 Tongyu Wang , Peng Yi

We propose a variant of the Frank-Wolfe algorithm for solving a class of sparse/low-rank optimization problems. Our formulation includes Elastic Net, regularized SVMs and phase retrieval as special cases. The proposed Primal-Dual Block…

Machine Learning · Computer Science 2019-06-07 Qi Lei , Jiacheng Zhuo , Constantine Caramanis , Inderjit S. Dhillon , Alexandros G. Dimakis

The stochastic Frank-Wolfe method has recently attracted much general interest in the context of optimization for statistical and machine learning due to its ability to work with a more general feasible region. However, there has been a…

Optimization and Control · Mathematics 2019-11-06 Haihao Lu , Robert M. Freund

Recently, compressive text summarisation offers a balance between the conciseness issue of extractive summarisation and the factual hallucination issue of abstractive summarisation. However, most existing compressive summarisation methods…

Computation and Language · Computer Science 2023-06-07 Peggy Tang , Junbin Gao , Lei Zhang , Zhiyong Wang

We introduce a new projection-free (Frank-Wolfe) method for optimizing structured nonconvex functions that are expressed as a difference of two convex functions. This problem class subsumes smooth nonconvex minimization, positioning our…

Optimization and Control · Mathematics 2025-12-01 Hoomaan Maskan , Yikun Hou , Suvrit Sra , Alp Yurtsever

Symmetric nonnegative matrix factorization has found abundant applications in various domains by providing a symmetric low-rank decomposition of nonnegative matrices. In this paper we propose a Frank-Wolfe (FW) solver to optimize the…

Machine Learning · Computer Science 2018-06-27 Han Zhao , Geoff Gordon

We consider the unsupervised alignment of the full text of a book with a human-written summary. This presents challenges not seen in other text alignment problems, including a disparity in length and, consequent to this, a violation of the…

Computation and Language · Computer Science 2013-05-08 David Bamman , Noah A. Smith

The complexity in large-scale optimization can lie in both handling the objective function and handling the constraint set. In this respect, stochastic Frank-Wolfe algorithms occupy a unique position as they alleviate both computational…

Optimization and Control · Mathematics 2021-02-16 Cyrille W. Combettes , Christoph Spiegel , Sebastian Pokutta

Decentralized optimization algorithms have received much attention due to the recent advances in network information processing. However, conventional decentralized algorithms based on projected gradient descent are incapable of handling…

Optimization and Control · Mathematics 2018-08-29 Hoi-To Wai , Jean Lafond , Anna Scaglione , Eric Moulines

This paper analyzes the convergence rates of the {\it Frank-Wolfe } method for solving convex constrained multiobjective optimization. We establish improved convergence rates under different assumptions on the objective function, the…

Optimization and Control · Mathematics 2024-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

Learning sparse combinations is a frequent theme in machine learning. In this paper, we study its associated optimization problem in the distributed setting where the elements to be combined are not centrally located but spread over a…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-25 Aurélien Bellet , Yingyu Liang , Alireza Bagheri Garakani , Maria-Florina Balcan , Fei Sha

We present an exact algorithm for mean-risk optimization subject to a budget constraint, where decision variables may be continuous or integer. The risk is measured by the covariance matrix and weighted by an arbitrary monotone function,…

Optimization and Control · Mathematics 2017-05-08 Christoph Buchheim , Marianna De Santis , Francesco Rinaldi , Long Trieu