English
Related papers

Related papers: CPGD: Cadzow Plug-and-Play Gradient Descent for Ge…

200 papers

Empirical evaluation of deep learning models against adversarial attacks entails solving nontrivial constrained optimization problems. Popular algorithms for solving these constrained problems rely on projected gradient descent (PGD) and…

Machine Learning · Computer Science 2022-11-15 Hengyue Liang , Buyun Liang , Ying Cui , Tim Mitchell , Ju Sun

We address the problem of simultaneously recovering a sequence of point source signals from observations limited to the low-frequency end of the spectrum of their summed convolution, where the point spread functions (PSFs) are unknown. By…

Information Theory · Computer Science 2024-07-16 Jinchi Chen

Diffusion models have recently shown promise as powerful generative priors for inverse problems. However, conventional applications require solving the full reverse diffusion process and operating on noisy intermediate states, which poses…

Geophysics · Physics 2025-06-13 Yuke Xie , Hervé Chauris , Nicolas Desassis

We consider the problem of denoising with the help of prior information taken from a database of clean signals or images. Denoising with variational methods is very efficient if a regularizer well adapted to the nature of the data is…

Machine Learning · Computer Science 2023-10-06 Hui Shi , Yann Traonmilin , J-F Aujol

For image recovery problems, plug-and-play (PnP) methods have been developed that replace the proximal step in an optimization algorithm with a call to an application-specific denoiser, often implemented using a deep neural network.…

Information Theory · Computer Science 2022-02-14 Saurav K Shastri , Rizwan Ahmad , Christopher A Metzler , Philip Schniter

Dimension reduction techniques are often used when the high-dimensional tensor has relatively low intrinsic rank compared to the ambient dimension of the tensor. The CANDECOMP/PARAFAC (CP) tensor completion is a widely used approach to find…

Numerical Analysis · Mathematics 2021-04-01 Jiahua Jiang , Fatoumata Sanogo , Carmeliza Navasca

The data consistency for the physical forward model is crucial in inverse problems, especially in MR imaging reconstruction. The standard way is to unroll an iterative algorithm into a neural network with a forward model embedded. The…

Image and Video Processing · Electrical Eng. & Systems 2023-06-28 Guanxiong Luo , Mengmeng Kuang , Peng Cao

The computational cost of parametric studies currently represents the major limitation to the application of simulation-based engineering techniques in a daily industrial environment. This work presents the first nonintrusive implementation…

Numerical Analysis · Mathematics 2020-02-05 Vasileios Tsiolakis , Matteo Giacomini , Ruben Sevilla , Carsten Othmer , Antonio Huerta

We consider the problem of principal component analysis (PCA) in a streaming stochastic setting, where our goal is to find a direction of approximate maximal variance, based on a stream of i.i.d. data points in $\reals^d$. A simple and…

Machine Learning · Computer Science 2016-01-05 Ohad Shamir

Plug-and-play (PnP) is a non-convex framework that integrates modern denoising priors, such as BM3D or deep learning-based denoisers, into ADMM or other proximal algorithms. An advantage of PnP is that one can use pre-trained denoisers when…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Ernest K. Ryu , Jialin Liu , Sicheng Wang , Xiaohan Chen , Zhangyang Wang , Wotao Yin

Regularization approaches have demonstrated their effectiveness for solving ill-posed problems. However, in the context of variational restoration methods, a challenging question remains, which is how to find a good regularizer. While total…

Optimization and Control · Mathematics 2011-10-25 Nelly Pustelnik , Caroline Chaux , Jean-Christophe Pesquet

Parametric manifold optimization problems frequently arise in various machine learning tasks, where state functions are defined on infinite-dimensional manifolds. We propose a unified accelerated natural gradient descent (ANGD) framework to…

Optimization and Control · Mathematics 2025-04-09 Chenyi Li , Shuchen Zhu , Zhonglin Xie , Zaiwen Wen

Solving inverse problems requires appropriate regularization techniques to ensure well-posedness and stability. In recent years, denoiser-driven methods have emerged as effective regularization strategies, achieving state-of-the-art…

Numerical Analysis · Mathematics 2026-04-23 Harshit Bajpai , Ankik Kumar Giri , Tim Jahn , Abhinav Jha

This study focuses on solving group zero-norm regularized robust loss minimization problems. We propose a proximal Majorization-Minimization (PMM) algorithm to address a class of equivalent Difference-of-Convex (DC) surrogate optimization…

Optimization and Control · Mathematics 2025-05-30 Ling Liang , Shujun Bi

We propose a new solver for the sparse spikes deconvolution problem over the space of Radon measures. A common approach to off-the-grid deconvolution considers semidefinite (SDP) relaxations of the total variation (the total mass of the…

Optimization and Control · Mathematics 2019-03-12 Paul Catala , Vincent Duval , Gabriel Peyré

The inherent ill-posed nature of image reconstruction problems, due to limitations in the physical acquisition process, is typically addressed by introducing a regularisation term that incorporates prior knowledge about the underlying…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Naïl Khelifa , Ferdia Sherry , Carola-Bibiane Schönlieb

We study accelerated optimization methods in the Gaussian phase retrieval problem. In this setting, we prove that gradient methods with Polyak or Nesterov momentum have similar implicit regularization to gradient descent. This implicit…

Optimization and Control · Mathematics 2023-11-23 Tyler Maunu , Martin Molina-Fructuoso

In this paper, we utilize stochastic optimization to reduce the space complexity of convex composite optimization with a nuclear norm regularizer, where the variable is a matrix of size $m \times n$. By constructing a low-rank estimate of…

Machine Learning · Computer Science 2015-12-08 Lijun Zhang , Tianbao Yang , Rong Jin , Zhi-Hua Zhou

In this paper we propose a splitting scheme which hybridizes generalized conditional gradient with a proximal step which we call CGALP algorithm, for minimizing the sum of three proper convex and lower-semicontinuous functions in real…

Optimization and Control · Mathematics 2022-10-20 Antonio Silveti-Falls , Cesare Molinari , Jalal Fadili

We consider the problem of minimizing a convex objective which is the sum of a smooth part, with Lipschitz continuous gradient, and a nonsmooth part. Inspired by various applications, we focus on the case when the nonsmooth part is a…

Optimization and Control · Mathematics 2013-08-28 Ting Kei Pong
‹ Prev 1 4 5 6 7 8 10 Next ›