English
Related papers

Related papers: Sparse Optimization for Unsupervised Extractive Su…

200 papers

We develop a novel variant of the classical Frank-Wolfe algorithm, which we call spectral Frank-Wolfe, for convex optimization over a spectrahedron. The spectral Frank-Wolfe algorithm has a novel ingredient: it computes a few eigenvectors…

Optimization and Control · Mathematics 2020-08-18 Lijun Ding , Yingjie Fei , Qiantong Xu , Chengrun Yang

In recent years, text summarization methods have attracted much attention again thanks to the researches on neural network models. Most of the current text summarization methods based on neural network models are supervised methods which…

Computation and Language · Computer Science 2024-01-25 Dehao Tao , Yingzhu Xiong , Zhongliang Yang , Yongfeng Huang

The Conditional Gradient (or Frank-Wolfe) method is one of the most well-known methods for solving constrained optimization problems appearing in various machine learning tasks. The simplicity of iteration and applicability to many…

Optimization and Control · Mathematics 2024-09-17 Ruslan Nazykov , Aleksandr Shestakov , Vladimir Solodkin , Aleksandr Beznosikov , Gauthier Gidel , Alexander Gasnikov

This paper showcases the theoretical and numerical performance of the Sliding Frank-Wolfe, which is a novel optimization algorithm to solve the BLASSO sparse spikes super-resolution problem. The BLASSO is a continuous (i.e. off-the-grid or…

Numerical Analysis · Mathematics 2018-11-16 Quentin Denoyelle , Vincent Duval , Gabriel Peyré , Emmanuel Soubies

Frank-Wolfe (FW) algorithms have been often proposed over the last few years as efficient solvers for a variety of optimization problems arising in the field of Machine Learning. The ability to work with cheap projection-free iterations and…

Machine Learning · Statistics 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Stefano Lodi , Claudio Sartori , Johan A. K. Suykens

We introduce regularized Frank-Wolfe, a general and effective algorithm for inference and learning of dense conditional random fields (CRFs). The algorithm optimizes a nonconvex continuous relaxation of the CRF inference problem using…

Machine Learning · Computer Science 2022-09-09 Đ. Khuê Lê-Huu , Karteek Alahari

The Frank-Wolfe algorithm is a classic method for constrained optimization problems. It has recently been popular in many machine learning applications because its projection-free property leads to more efficient iterations. In this paper,…

Optimization and Control · Mathematics 2020-10-23 Cheng Chen , Luo Luo , Weinan Zhang , Yong Yu

We present a new Frank-Wolfe (FW) type algorithm that is applicable to minimization problems with a nonsmooth convex objective. We provide convergence bounds and show that the scheme yields so-called coreset results for various Machine…

Optimization and Control · Mathematics 2017-08-23 Sathya N. Ravi , Maxwell D. Collins , Vikas Singh

This work presents a new approach to unsupervised abstractive summarization based on maximizing a combination of coverage and fluency for a given length constraint. It introduces a novel method that encourages the inclusion of key terms…

Computation and Language · Computer Science 2021-05-13 Philippe Laban , Andrew Hsi , John Canny , Marti A. Hearst

Unsupervised extractive document summarization aims to select important sentences from a document without using labeled summaries during training. Existing methods are mostly graph-based with sentences as nodes and edge weights measured by…

Computation and Language · Computer Science 2021-12-14 Shusheng Xu , Xingxing Zhang , Yi Wu , Furu Wei , Ming Zhou

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

We study the properties of the Frank-Wolfe algorithm to solve the m-EXACT-SPARSE reconstruction problem, where a signal y must be expressed as a sparse linear combination of a predefined set of atoms, called dictionary. We prove that when…

Optimization and Control · Mathematics 2019-05-28 Farah Cherfaoui , Valentin Emiya , Liva Ralaivola , Sandrine Anthoine

We study the effects of constrained optimization formulations and Frank-Wolfe algorithms for obtaining interpretable neural network predictions. Reformulating the Rate-Distortion Explanations (RDE) method for relevance attribution as a…

Machine Learning · Computer Science 2022-02-01 Jan Macdonald , Mathieu Besançon , Sebastian Pokutta

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

Optimization and Control · Mathematics 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

Unsupervised extractive summarization aims to extract salient sentences from a document as the summary without labeled data. Recent literatures mostly research how to leverage sentence similarity to rank sentences in the order of salience.…

Computation and Language · Computer Science 2023-02-27 Shichao Sun , Ruifeng Yuan , Wenjie Li , Sujian Li

The Frank-Wolfe method solves smooth constrained convex optimization problems at a generic sublinear rate of $\mathcal{O}(1/T)$, and it (or its variants) enjoys accelerated convergence rates for two fundamental classes of constraints:…

Optimization and Control · Mathematics 2020-06-17 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained smooth convex-concave saddle point (SP) problems. Remarkably, the method only requires access to linear minimization oracles. Leveraging recent advances in FW…

Optimization and Control · Mathematics 2017-03-07 Gauthier Gidel , Tony Jebara , Simon Lacoste-Julien

We analyze two novel randomized variants of the Frank-Wolfe (FW) or conditional gradient algorithm. While classical FW algorithms require solving a linear minimization problem over the domain at each iteration, the proposed method only…

Optimization and Control · Mathematics 2018-03-21 Thomas Kerdreux , Fabian Pedregosa , Alexandre d'Aspremont

Recently, there has been a renewed interest in the machine learning community for variants of a sparse greedy approximation procedure for concave optimization known as {the Frank-Wolfe (FW) method}. In particular, this procedure has been…

Computer Vision and Pattern Recognition · Computer Science 2015-10-27 Hector Allende , Emanuele Frandi , Ricardo Nanculef , Claudio Sartori

We propose a rank-$k$ variant of the classical Frank-Wolfe algorithm to solve convex optimization over a trace-norm ball. Our algorithm replaces the top singular-vector computation ($1$-SVD) in Frank-Wolfe with a top-$k$ singular-vector…

Machine Learning · Computer Science 2017-11-10 Zeyuan Allen-Zhu , Elad Hazan , Wei Hu , Yuanzhi Li