English
Related papers

Related papers: Boosting the Sliding Frank-Wolfe solver for 3D dec…

200 papers

Error bound condition has recently gained revived interest in optimization. It has been leveraged to derive faster convergence for many popular algorithms, including subgradient methods, proximal gradient method and accelerated proximal…

Optimization and Control · Mathematics 2018-10-12 Yi Xu , Tianbao Yang

We propose several variants of the Frank-Wolfe algorithm to minimize a sum of functions. The main proposed algorithm is inspired from the dual averaging scheme of Nesterov adapted for Frank Wolfe in a stochastic setting. A distributed…

Optimization and Control · Mathematics 2023-01-12 Suhail M Shah

The Frank-Wolfe algorithm is a method for constrained optimization that relies on linear minimizations, as opposed to projections. Therefore, a motivation put forward in a large body of work on the Frank-Wolfe algorithm is the computational…

Optimization and Control · Mathematics 2021-06-15 Cyrille W. Combettes , Sebastian Pokutta

Optimization-based problems have become of great interest for signal approximation purposes, as they achieved good accuracy results while being extremely flexible and versatile. In this work, we put our focus on the context of periodic…

Optimization and Control · Mathematics 2021-11-30 Adrian Jarret

Distributed optimization has gained a surge of interest in recent years. In this paper we propose a distributed projection free algorithm named Distributed Conditional Gradient Sliding(DCGS). Compared to the state-of-the-art distributed…

Optimization and Control · Mathematics 2018-05-22 Yan Li , Chao Qu , Huan Xu

In this paper, we consider Frank-Wolfe-based algorithms for composite convex optimization problems with objective involving a logarithmically-homogeneous, self-concordant functions. Recent Frank-Wolfe-based methods for this class of…

Optimization and Control · Mathematics 2023-10-24 Nimita Shinde , Vishnu Narayanan , James Saunderson

3D Language Gaussian Splatting (3DLGS) augments 3D Gaussian Splatting with language-aligned visual features for open-vocabulary 3D scene understanding. A core challenge is efficiently associating high-dimensional vision-language embeddings…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Lovre Antonio Budimir , Yushi Guan , Steve Ryhner , Sven Lončarić , Nandita Vijaykumar

Multi-channel sparse blind deconvolution, or convolutional sparse coding, refers to the problem of learning an unknown filter by observing its circulant convolutions with multiple input signals that are sparse. This problem finds numerous…

Machine Learning · Statistics 2021-04-07 Laixi Shi , Yuejie Chi

We describe a new multi-scale deconvolution algorithm that can also be used in multi-frequency mode. The algorithm only affects the minor clean loop. In single-frequency mode, the minor loop of our improved multi-scale algorithm is over an…

Instrumentation and Methods for Astrophysics · Physics 2017-08-02 A. R. Offringa , O. Smirnov

We present a variational Bayesian method of joint image reconstruction and point spread function (PSF) estimation when the PSF of the imaging device is only partially known. To solve this semi-blind deconvolution problem, prior…

Data Analysis, Statistics and Probability · Physics 2013-03-18 Se Un Park , Nicolas Dobigeon , Alfred O. Hero

In this paper, we study the properties of the Frank-Wolfe algorithm to solve the \ExactSparse reconstruction problem. We prove that when the dictionary is quasi-incoherent, at each iteration, the Frank-Wolfe algorithm picks up an atom…

Machine Learning · Computer Science 2018-12-19 Farah Cherfaoui , Valentin Emiya , Liva Ralaivola , Sandrine Anthoine

We propose an algorithm for rotational sparse coding along with an efficient implementation using steerability. Sparse coding (also called dictionary learning) is an important technique in image processing, useful in inverse problems,…

Image and Video Processing · Electrical Eng. & Systems 2020-01-31 Michael T. McCann , Vincent Andrearczyk , Michael Unser , Adrien Depeursinge

The problem of sparse multichannel blind deconvolution (S-MBD) arises frequently in many engineering applications such as radar/sonar/ultrasound imaging. To reduce its computational and implementation cost, we propose a compression method…

Signal Processing · Electrical Eng. & Systems 2023-07-05 Bahareh Tolooshams , Satish Mulleti , Demba Ba , Yonina C. Eldar

We introduce novel techniques to enhance Frank-Wolfe algorithms by leveraging function smoothness beyond traditional short steps. Our study focuses on Frank-Wolfe algorithms with step sizes that incorporate primal-dual guarantees, offering…

Optimization and Control · Mathematics 2025-02-03 David Martínez-Rubio , Sebastian Pokutta

Deep learning applied to the reconstruction of 3D shapes has seen growing interest. A popular approach to 3D reconstruction and generation in recent years has been the CNN encoder-decoder model usually applied in voxel space. However, this…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Mateusz Michalkiewicz , Eugene Belilovsky , Mahsa Baktashmotlagh , Anders Eriksson

We study the properties of the Frank-Wolfe algorithm to solve the m-EXACT-SPARSE reconstruction problem, where a signal y must be expressed as a sparse linear combination of a predefined set of atoms, called dictionary. We prove that when…

Optimization and Control · Mathematics 2019-05-28 Farah Cherfaoui , Valentin Emiya , Liva Ralaivola , Sandrine Anthoine

This paper focuses on the problem of \emph{constrained} \emph{stochastic} optimization. A zeroth order Frank-Wolfe algorithm is proposed, which in addition to the projection-free nature of the vanilla Frank-Wolfe algorithm makes it gradient…

Optimization and Control · Mathematics 2019-02-20 Anit Kumar Sahu , Manzil Zaheer , Soummya Kar

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

The analysis of Frank Wolfe (FW) variants is often complicated by the presence of different kinds of "good" and "bad" steps. In this article we aim to simplify the convergence analysis of some of these variants by getting rid of such a…

Optimization and Control · Mathematics 2022-11-22 Francesco Rinaldi , Damiano Zeffiro

We revisit the Frank-Wolfe (FW) optimization under strongly convex constraint sets. We provide a faster convergence rate for FW without line search, showing that a previously overlooked variant of FW is indeed faster than the standard…

Machine Learning · Computer Science 2019-02-01 Jarrid Rector-Brooks , Jun-Kun Wang , Barzan Mozafari