English
Related papers

Related papers: Hessian Schatten-Norm Regularization for Linear In…

200 papers

In this paper we consider the computation of approximate solutions for inverse problems in Hilbert spaces. In order to capture the special feature of solutions, non-smooth convex functions are introduced as penalty terms. By exploiting the…

Numerical Analysis · Mathematics 2015-06-18 Qinian Jin , Xiliang Lu

Inverse problems arise in a number of domains such as medical imaging, remote sensing, and many more, relying on the use of advanced signal and image processing approaches -- such as sparsity-driven techniques -- to determine their…

Machine Learning · Computer Science 2019-02-01 Jaweria Amjad , Zhaoyan Lyu , Miguel R. D. Rodrigues

Given an optimization problem, the Hessian matrix and its eigenspectrum can be used in many ways, ranging from designing more efficient second-order algorithms to performing model analysis and regression diagnostics. When nonlinear models…

Machine Learning · Statistics 2021-03-18 Zhenyu Liao , Michael W. Mahoney

In this paper we study general Schatten-$p$ quasi-norm (SPQN) regularized matrix minimization problems. In particular, we first introduce a class of first-order stationary points for them, and show that the first-order stationary points…

Optimization and Control · Mathematics 2016-11-01 Zhaosong Lu , Yong Zhang

Regularization methods are a key tool in the solution of inverse problems. They are used to introduce prior knowledge and make the approximation of ill-posed (pseudo-)inverses feasible. In the last two decades interest has shifted from…

Numerical Analysis · Mathematics 2018-01-31 Martin Benning , Martin Burger

We develop a computationally efficient algorithm for the automatic regularization of nonlinear inverse problems based on the discrepancy principle. We formulate the problem as an equality constrained optimization problem, where the…

Numerical Analysis · Mathematics 2021-09-03 Jeffrey Cornelis , Wim Vanroose

Inverse problems arise in a variety of imaging applications including computed tomography, non-destructive testing, and remote sensing. The characteristic features of inverse problems are the non-uniqueness and instability of their…

Numerical Analysis · Mathematics 2020-06-09 Markus Haltmeier , Linh V. Nguyen

We study randomized sketching methods for approximately solving least-squares problem with a general convex constraint. The quality of a least-squares approximation can be assessed in different ways: either in terms of the value of the…

Optimization and Control · Mathematics 2014-11-04 Mert Pilanci , Martin J. Wainwright

We propose a new general framework for recovering low-rank structure in optimal transport using Schatten-$p$ norm regularization. Our approach extends existing methods that promote sparse and interpretable transport maps or plans, while…

Machine Learning · Statistics 2025-10-15 Tyler Maunu

In this paper, we propose a novel deep convolutional neural network (CNN)-based algorithm for solving ill-posed inverse problems. Regularized iterative algorithms have emerged as the standard approach to ill-posed inverse problems in the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Kyong Hwan Jin , Michael T. McCann , Emmanuel Froustey , Michael Unser

In this paper, we propose a new variational model for image reconstruction by minimizing the $L^1$ norm of the \emph{Weingarten map} of image surface $(x,y,f(x,y))$ for a given image $f:{\mathrm{\Omega}}\rightarrow \mathbb R$. We…

Numerical Analysis · Mathematics 2022-04-07 Qiuxiang Zhong , Ryan Wen Liu , Yuping Duan

In this work, we propose Regularization-by-Equivariance (REV), a novel structure-adaptive regularization scheme for solving imaging inverse problems under incomplete measurements. This regularization scheme utilizes the equivariant…

Optimization and Control · Mathematics 2022-02-15 Junqi Tang

We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly non-smooth) regularizer is minimized under the constraint that the solution explains the observations…

Optimization and Control · Mathematics 2012-10-10 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo

The Schatten quasi-norm was introduced to bridge the gap between the trace norm and rank function. However, existing algorithms are too slow or even impractical for large-scale problems. Motivated by the equivalence relation between the…

Machine Learning · Computer Science 2018-03-02 Fanhua Shang , Yuanyuan Liu , James Cheng

We develop regularization methods to find flat minima while training deep neural networks. These minima generalize better than sharp minima, yielding models outperforming baselines on real-world test data (which may be distributed…

Machine Learning · Computer Science 2025-07-04 Adam Sandler , Diego Klabjan , Yuan Luo

The Bayesian statistical framework provides a systematic approach to enhance the regularization model by incorporating prior information about the desired solution. For the Bayesian linear inverse problems with Gaussian noise and Gaussian…

Numerical Analysis · Mathematics 2024-05-21 Haibo Li

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

This paper presents a patch-wise low-rank based image denoising method with constrained variational model involving local and nonlocal regularization. On one hand, recent patch-wise methods can be represented as a low-rank matrix…

Computer Vision and Pattern Recognition · Computer Science 2015-12-04 Yuan Xie

Imaging inverse problems aim to recover high-dimensional signals from undersampled, noisy measurements, a fundamentally ill-posed task with infinite solutions in the null-space of the sensing operator. To resolve this ambiguity, prior…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Roman Jacome , Romario Gualdrón-Hurtado , Leon Suarez , Henry Arguello

Spectral Computed Tomography (CT) is an emerging technology that enables to estimate the concentration of basis materials within a scanned object by exploiting different photon energy spectra. In this work, we aim at efficiently solving a…

Optimization and Control · Mathematics 2021-03-26 Alessandro Perelli , Martin S. Andersen