中文
相关论文

相关论文: Sparse Optimization for Unsupervised Extractive Su…

200 篇论文

We develop a novel variant of the classical Frank-Wolfe algorithm, which we call spectral Frank-Wolfe, for convex optimization over a spectrahedron. The spectral Frank-Wolfe algorithm has a novel ingredient: it computes a few eigenvectors…

最优化与控制 · 数学 2020-08-18 Lijun Ding , Yingjie Fei , Qiantong Xu , Chengrun Yang

In recent years, text summarization methods have attracted much attention again thanks to the researches on neural network models. Most of the current text summarization methods based on neural network models are supervised methods which…

计算与语言 · 计算机科学 2024-01-25 Dehao Tao , Yingzhu Xiong , Zhongliang Yang , Yongfeng Huang

The Conditional Gradient (or Frank-Wolfe) method is one of the most well-known methods for solving constrained optimization problems appearing in various machine learning tasks. The simplicity of iteration and applicability to many…

This paper showcases the theoretical and numerical performance of the Sliding Frank-Wolfe, which is a novel optimization algorithm to solve the BLASSO sparse spikes super-resolution problem. The BLASSO is a continuous (i.e. off-the-grid or…

数值分析 · 数学 2018-11-16 Quentin Denoyelle , Vincent Duval , Gabriel Peyré , Emmanuel Soubies

Frank-Wolfe (FW) algorithms have been often proposed over the last few years as efficient solvers for a variety of optimization problems arising in the field of Machine Learning. The ability to work with cheap projection-free iterations and…

We introduce regularized Frank-Wolfe, a general and effective algorithm for inference and learning of dense conditional random fields (CRFs). The algorithm optimizes a nonconvex continuous relaxation of the CRF inference problem using…

机器学习 · 计算机科学 2022-09-09 Đ. Khuê Lê-Huu , Karteek Alahari

The Frank-Wolfe algorithm is a classic method for constrained optimization problems. It has recently been popular in many machine learning applications because its projection-free property leads to more efficient iterations. In this paper,…

最优化与控制 · 数学 2020-10-23 Cheng Chen , Luo Luo , Weinan Zhang , Yong Yu

We present a new Frank-Wolfe (FW) type algorithm that is applicable to minimization problems with a nonsmooth convex objective. We provide convergence bounds and show that the scheme yields so-called coreset results for various Machine…

最优化与控制 · 数学 2017-08-23 Sathya N. Ravi , Maxwell D. Collins , Vikas Singh

This work presents a new approach to unsupervised abstractive summarization based on maximizing a combination of coverage and fluency for a given length constraint. It introduces a novel method that encourages the inclusion of key terms…

计算与语言 · 计算机科学 2021-05-13 Philippe Laban , Andrew Hsi , John Canny , Marti A. Hearst

Unsupervised extractive document summarization aims to select important sentences from a document without using labeled summaries during training. Existing methods are mostly graph-based with sentences as nodes and edge weights measured by…

计算与语言 · 计算机科学 2021-12-14 Shusheng Xu , Xingxing Zhang , Yi Wu , Furu Wei , Ming Zhou

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

最优化与控制 · 数学 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

We study the properties of the Frank-Wolfe algorithm to solve the m-EXACT-SPARSE reconstruction problem, where a signal y must be expressed as a sparse linear combination of a predefined set of atoms, called dictionary. We prove that when…

最优化与控制 · 数学 2019-05-28 Farah Cherfaoui , Valentin Emiya , Liva Ralaivola , Sandrine Anthoine

We study the effects of constrained optimization formulations and Frank-Wolfe algorithms for obtaining interpretable neural network predictions. Reformulating the Rate-Distortion Explanations (RDE) method for relevance attribution as a…

机器学习 · 计算机科学 2022-02-01 Jan Macdonald , Mathieu Besançon , Sebastian Pokutta

This paper considers stochastic convex optimization problems with two sets of constraints: (a) deterministic constraints on the domain of the optimization variable, which are difficult to project onto; and (b) deterministic or stochastic…

最优化与控制 · 数学 2022-05-25 Zeeshan Akhtar , Ketan Rajawat

Unsupervised extractive summarization aims to extract salient sentences from a document as the summary without labeled data. Recent literatures mostly research how to leverage sentence similarity to rank sentences in the order of salience.…

计算与语言 · 计算机科学 2023-02-27 Shichao Sun , Ruifeng Yuan , Wenjie Li , Sujian Li

The Frank-Wolfe method solves smooth constrained convex optimization problems at a generic sublinear rate of $\mathcal{O}(1/T)$, and it (or its variants) enjoys accelerated convergence rates for two fundamental classes of constraints:…

最优化与控制 · 数学 2020-06-17 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained smooth convex-concave saddle point (SP) problems. Remarkably, the method only requires access to linear minimization oracles. Leveraging recent advances in FW…

最优化与控制 · 数学 2017-03-07 Gauthier Gidel , Tony Jebara , Simon Lacoste-Julien

We analyze two novel randomized variants of the Frank-Wolfe (FW) or conditional gradient algorithm. While classical FW algorithms require solving a linear minimization problem over the domain at each iteration, the proposed method only…

最优化与控制 · 数学 2018-03-21 Thomas Kerdreux , Fabian Pedregosa , Alexandre d'Aspremont

Recently, there has been a renewed interest in the machine learning community for variants of a sparse greedy approximation procedure for concave optimization known as {the Frank-Wolfe (FW) method}. In particular, this procedure has been…

计算机视觉与模式识别 · 计算机科学 2015-10-27 Hector Allende , Emanuele Frandi , Ricardo Nanculef , Claudio Sartori

We propose a rank-$k$ variant of the classical Frank-Wolfe algorithm to solve convex optimization over a trace-norm ball. Our algorithm replaces the top singular-vector computation ($1$-SVD) in Frank-Wolfe with a top-$k$ singular-vector…

机器学习 · 计算机科学 2017-11-10 Zeyuan Allen-Zhu , Elad Hazan , Wei Hu , Yuanzhi Li