中文
相关论文

相关论文: Recovery and convergence rate of the Frank-Wolfe A…

200 篇论文

This work presents an approach for image reconstruction in clinical low-dose tomography that combines principles from sparse signal processing with ideas from deep learning. First, we describe sparse signal representation in terms of…

机器学习 · 统计学 2023-11-27 Jevgenija Rudzusika , Thomas Koehler , Ozan Öktem

We study Frank-Wolfe algorithms - standard, pairwise, and away-steps - for efficient optimization of Dominant Set Clustering. We present a unified and computationally efficient framework to employ the different variants of Frank-Wolfe…

机器学习 · 计算机科学 2022-12-06 Carl Johnell , Morteza Haghir Chehreghani

Reconstructing continuous signals from a small number of discrete samples is a fundamental problem across science and engineering. In practice, we are often interested in signals with 'simple' Fourier structure, such as bandlimited,…

数据结构与算法 · 计算机科学 2018-12-24 Haim Avron , Michael Kapralov , Cameron Musco , Christopher Musco , Ameya Velingker , Amir Zandieh

Owing to their low-complexity iterations, Frank-Wolfe (FW) solvers are well suited for various large-scale learning tasks. When block-separable constraints are present, randomized block FW (RB-FW) has been shown to further reduce complexity…

最优化与控制 · 数学 2017-11-22 Liang Zhang , Gang Wang , Daniel Romero , Georgios B. Giannakis

Phase retrieval(PR) problem is a kind of ill-condition inverse problem which can be found in various of applications. Utilizing the sparse priority, an algorithm called SWF(Sparse Wirtinger Flow) is proposed in this paper to deal with…

信息论 · 计算机科学 2017-04-12 Ziyang Yuan , Qi Wang , Hongxia Wang

Recovering matrices from compressive and grossly corrupted observations is a fundamental problem in robust statistics, with rich applications in computer vision and machine learning. In theory, under certain conditions, this problem can be…

最优化与控制 · 数学 2017-05-31 Cun Mu , Yuqian Zhang , John Wright , Donald Goldfarb

It is now well understood that (1) it is possible to reconstruct sparse signals exactly from what appear to be highly incomplete sets of linear measurements and (2) that this can be done by constrained L1 minimization. In this paper, we…

统计方法学 · 统计学 2007-11-13 Emmanuel J. Candes , Michael B. Wakin , Stephen P. Boyd

Greedy algorithms for minimizing L0-norm of sparse decomposition have profound application impact on many signal processing problems. In the sparse coding setup, given the observations $\mathrm{y}$ and the redundant dictionary…

数值分析 · 计算机科学 2015-02-13 Yuanyi Xue , Yao Wang

Frank-Wolfe algorithms have recently regained the attention of the Machine Learning community. Their solid theoretical properties and sparsity guarantees make them a suitable choice for a wide range of problems in this field. In addition,…

机器学习 · 统计学 2015-10-27 Emanuele Frandi , Ricardo Nanculef , Johan A. K. Suykens

Projection-free optimization via different variants of the Frank-Wolfe (FW) method has become one of the cornerstones in large scale optimization for machine learning and computational statistics. Numerous applications within these fields…

最优化与控制 · 数学 2021-08-03 Pavel Dvurechensky , Kamil Safin , Shimrit Shtern , Mathias Staudigl

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

最优化与控制 · 数学 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

Sparse recovery is widely applied in many fields, since many signals or vectors can be sparsely represented under some frames or dictionaries. Most of fast algorithms at present are based on solving $l^0$ or $l^1$ minimization problems and…

数值分析 · 数学 2019-03-06 Chong-Jun Li , Yi-Jun Zhong

Given a way to evaluate an unknown polynomial with integer coefficients, we present new algorithms to recover its nonzero coefficients and corresponding exponents. As an application, we adapt this interpolation algorithm to the problem of…

符号计算 · 计算机科学 2022-05-19 Pascal Giorgi , Bruno Grenet , Armelle Perret du Cray , Daniel S. Roche

We propose a new version of the Frank-Wolfe method, called the (L0, L1)-Frank-Wolfe algorithm, developed for optimization problems with (L0, L1)-smooth objectives. We establish that this algorithm achieves superior theoretical convergence…

最优化与控制 · 数学 2026-05-21 A. A. Vyguzov , F. S. Stonyakin

Minimizing a function over an intersection of convex sets is an important task in optimization that is often much more challenging than minimizing it over each individual constraint set. While traditional methods such as Frank-Wolfe (FW) or…

最优化与控制 · 数学 2018-04-11 Gauthier Gidel , Fabian Pedregosa , Simon Lacoste-Julien

Frank-Wolfe algorithm (FW) and its variants have gained a surge of interests in machine learning community due to its projection-free property. Recently people have reduced the gradient evaluation complexity of FW algorithm to…

机器学习 · 统计学 2018-05-22 Yan Li , Chao Qu , Huan Xu

In this paper, we derive a new reconstruction method for real non-harmonic Fourier sums, i.e., real signals which can be represented as sparse exponential sums of the form $f(t) = \sum_{j=1}^{K} \gamma_{j} \, \cos(2\pi a_{j} t + b_{j})$,…

数值分析 · 数学 2020-11-30 Markus Petz , Gerlind Plonka , Nadiia Derevianko

The Frank-Wolfe method solves smooth constrained convex optimization problems at a generic sublinear rate of $\mathcal{O}(1/T)$, and it (or its variants) enjoys accelerated convergence rates for two fundamental classes of constraints:…

最优化与控制 · 数学 2020-06-17 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

The convergence rate is analyzed for the SpaSRA algorithm (Sparse Reconstruction by Separable Approximation) for minimizing a sum $f (\m{x}) + \psi (\m{x})$ where $f$ is smooth and $\psi$ is convex, but possibly nonsmooth. It is shown that…

最优化与控制 · 数学 2009-12-10 William Hager , Dzung Phan , Hongchao Zhang

In Bayesian inference, the posterior distributions are difficult to obtain analytically for complex models such as neural networks. Variational inference usually uses a parametric distribution for approximation, from which we can easily…

机器学习 · 统计学 2019-02-01 Futoshi Futami , Zhenghang Cui , Issei Sato , Masashi Sugiyama