English
Related papers

Related papers: Gridless 2D Recovery of Lines using the Sliding Fr…

200 papers

The removal of blur from a signal, in the presence of noise, is readily accomplished if the blur can be described in precise mathematical terms. However, there is growing interest in problems where the extent of blur is known only…

Statistics Theory · Mathematics 2007-11-06 Peter Hall , Peihua Qiu

We study a blind deconvolution problem on graphs, which arises in the context of localizing a few sources that diffuse over networks. While the observations are bilinear functions of the unknown graph filter coefficients and sparse input…

Signal Processing · Electrical Eng. & Systems 2024-09-19 Chang Ye , Gonzalo Mateos

The Conditional Gradient (or Frank-Wolfe) method is one of the most well-known methods for solving constrained optimization problems appearing in various machine learning tasks. The simplicity of iteration and applicability to many…

Optimization and Control · Mathematics 2024-09-17 Ruslan Nazykov , Aleksandr Shestakov , Vladimir Solodkin , Aleksandr Beznosikov , Gauthier Gidel , Alexander Gasnikov

We present a blended conditional gradient approach for minimizing a smooth convex function over a polytope P, combining the Frank--Wolfe algorithm (also called conditional gradient) with gradient-based steps, different from away steps and…

Optimization and Control · Mathematics 2025-03-24 Gábor Braun , Sebastian Pokutta , Dan Tu , Stephen Wright

Suppose that we observe noisy linear measurements of an unknown signal that can be modeled as the sum of two component signals, each of which arises from a nonlinear sub-manifold of a high dimensional ambient space. We introduce SPIN, a…

Information Theory · Computer Science 2012-06-11 Chinmay Hegde , Richard G. Baraniuk

Frank-Wolfe methods (FW) have gained significant interest in the machine learning community due to its ability to efficiently solve large problems that admit a sparse structure (e.g. sparse vectors and low-rank matrices). However the…

Machine Learning · Statistics 2018-03-22 Edward Cheung , Yuying Li

Heavy sweep distortion induced by alignments and inter-reflections of layers of a sample is a major burden in recovering 2D and 3D information in time resolved spectral imaging. This problem cannot be addressed by conventional denoising and…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Alireza Aghasi , Barmak Heshmat , Albert Redo-Sanchez , Justin Romberg , Ramesh Raskar

Recently the away-step Frank-Wolfe algoritm for constrained multiobjective optimization has been shown linear convergence rate over a polytope which is generated by finite points set. In this paper we design a decomposition-invariant…

Optimization and Control · Mathematics 2024-09-10 Zhuoxin Fan , Liping Tang

The stochastic Frank-Wolfe method has recently attracted much general interest in the context of optimization for statistical and machine learning due to its ability to work with a more general feasible region. However, there has been a…

Optimization and Control · Mathematics 2019-11-06 Haihao Lu , Robert M. Freund

This paper attempts to undertake the study of Restored Gaussian Blurred Images. by using four types of techniques of deblurring image as Wiener filter, Regularized filter, Lucy Richardson deconvlutin algorithm and Blind deconvlution…

Computer Vision and Pattern Recognition · Computer Science 2010-04-27 Salem Saleh Al-amri , N. V. Kalyankar , Khamitkar S. D

The paper introduces a new adaptive version of the Frank-Wolfe algorithm for relatively smooth convex functions. It is proposed to use the Bregman divergence other than half the square of the Euclidean norm in the formula for step-size.…

Optimization and Control · Mathematics 2024-07-23 Alexander Vyguzov , Fedor Stonyakin

This paper presents a subgradient-based algorithm for constrained nonsmooth convex optimization that does not require projections onto the feasible set. While the well-established Frank-Wolfe algorithm and its variants already avoid…

Optimization and Control · Mathematics 2024-09-04 Kamiar Asgari , Michael J. Neely

In this paper, we propose a Riemannian steepest descent method for solving a blind deconvolution problem. We prove that the proposed algorithm with an appropriate initialization will recover the exact solution with high probability when the…

Information Theory · Computer Science 2018-04-17 Wen Huang , Paul Hand

Rain streaks bring complicated pixel intensity changes and additional gradients, greatly obstructing the extraction of image features from background. This causes serious performance degradation in feature-based applications. Thus, it is…

Image and Video Processing · Electrical Eng. & Systems 2023-11-02 Wei Wu , Hao Chang , Zhu Li

Deep neural networks is today one of the most popular choices in classification, regression and function approximation. However, the training of such deep networks is far from trivial as there are often millions of parameters to tune.…

Machine Learning · Computer Science 2020-06-09 Jakob Stigenberg

The non-uniform photoelectric response of infrared imaging systems results in fixed-pattern stripe noise being superimposed on infrared images, which severely reduces image quality. As the applications of degraded infrared images are…

Image and Video Processing · Electrical Eng. & Systems 2022-09-30 Zeshan Fayyaz , Daniel Platnick , Hannan Fayyaz , Nariman Farsad

We study the linear convergence of variants of the Frank-Wolfe algorithms for some classes of strongly convex problems, using only affine-invariant quantities. As in Guelat & Marcotte (1986), we show the linear convergence of the standard…

Optimization and Control · Mathematics 2014-01-06 Simon Lacoste-Julien , Martin Jaggi

The conditional gradient algorithm (also known as the Frank-Wolfe algorithm) has recently regained popularity in the machine learning community due to its projection-free property to solve constrained problems. Although many variants of the…

Machine Learning · Computer Science 2021-09-21 Xiyuan Wei , Bin Gu , Heng Huang

This paper aims to enhance the use of the Frank-Wolfe (FW) algorithm for training deep neural networks. Similar to any gradient-based optimization algorithm, FW suffers from high computational and memory costs when computing gradients for…

Machine Learning · Computer Science 2024-12-30 M. Rostami , S. S. Kia

Differentiable optimization has received a significant amount of attention due to its foundational role in the domain of machine learning based on neural networks. This paper proposes a differentiable layer, named Differentiable Frank-Wolfe…

Machine Learning · Computer Science 2024-04-01 Zixuan Liu , Liu Liu , Xueqian Wang , Peilin Zhao