English
Related papers

Related papers: Convergence of Regularization Parameters for Solut…

200 papers

We present a novel approach to nonlinear constrained Tikhonov regularization from the viewpoint of optimization theory. A second-order sufficient optimality condition is suggested as a nonlinearity condition to handle the nonlinearity of…

Numerical Analysis · Mathematics 2015-05-30 Kazufumi Ito , Bangti Jin

The standard approach for dealing with the ill-posedness of the training problem in machine learning and/or the reconstruction of a signal from a limited number of measurements is regularization. The method is applicable whenever the…

Optimization and Control · Mathematics 2020-07-13 Michael Unser

We present a method for supervised learning of sparsity-promoting regularizers for image denoising. Sparsity-promoting regularization is a key ingredient in solving modern image reconstruction problems; however, the operators underlying…

Image and Video Processing · Electrical Eng. & Systems 2020-06-11 Michael T. McCann , Saiprasad Ravishankar

We derive a formula for optimal hard thresholding of the singular value decomposition in the presence of correlated additive noise; although it nominally involves unobservables, we show how to apply it even where the noise covariance…

Statistics Theory · Mathematics 2023-03-28 David L. Donoho , Matan Gavish , Elad Romanov

A regularization algorithm allowing random noise in derivatives and inexact function values is proposed for computing approximate local critical points of any order for smooth unconstrained optimization problems. For an objective function…

Optimization and Control · Mathematics 2021-04-07 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

In this paper we propose an approach to approximate a truncated singular value decomposition of a large structured matrix. By first decomposing the matrix into a sum of Kronecker products, our approach can be used to approximate a large…

Numerical Analysis · Mathematics 2018-04-03 Clarissa Garvey , Chang Meng , James G. Nagy

If we have an unbiased estimate of some parameter of interest, then its absolute value is positively biased for the absolute value of the parameter. This bias is large when the signal-to-noise ratio (SNR) is small, and it becomes even…

Methodology · Statistics 2020-12-01 Erik van Zwet , Andrew Gelman

Recovering a large matrix from limited measurements is a challenging task arising in many real applications, such as image inpainting, compressive sensing and medical imaging, and this kind of problems are mostly formulated as low-rank…

Computer Vision and Pattern Recognition · Computer Science 2014-06-12 Yilun Wang , Xinhua Su

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

Numerical Analysis · Mathematics 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

Matrix learning is at the core of many machine learning problems. A number of real-world applications such as collaborative filtering and text mining can be formulated as a low-rank matrix completion problem, which recovers incomplete…

Machine Learning · Computer Science 2021-02-23 Yaqing Wang , Quanming Yao , James T. Kwok

Regression by composition provides a flexible framework for constructing conditional distributions through sequential group actions. However, when multiple flows act on the same distribution, the model becomes non-identifiable, leading to…

Methodology · Statistics 2026-03-30 Safaa K. Kadhem

We deal with the shape reconstruction of inclusions in elastic bodies. For solving this inverse problem in practice, data fitting functionals are used. Those work better than the rigorous monotonicity methods from [5], but have no…

Numerical Analysis · Mathematics 2022-12-13 Sarah Eberle , Bastian Harrach

This paper investigates the theoretical guarantees of L1-analysis regularization when solving linear inverse problems. Most of previous works in the literature have mainly focused on the sparse synthesis prior where the sparsity is measured…

Information Theory · Computer Science 2012-10-03 Samuel Vaiter , Gabriel Peyré , Charles Dossal , Jalal Fadili

This paper considers large-scale linear ill-posed inverse problems whose solutions can be represented as sums of smooth and piecewise constant components. To solve such problems we consider regularizers consisting of two terms that must be…

Numerical Analysis · Mathematics 2022-06-30 Ali Gholami , Silvia Gazzola

Linear discrimination, from the point of view of numerical linear algebra, can be treated as solving an ill-posed system of linear equations. In order to generate a solution that is robust in the presence of noise, these problems require…

Genomics · Quantitative Biology 2007-05-23 Erik Andries , Thomas Hagstrom , Susan R. Atlas , Cheryl Willman

Randomized numerical linear algebra is proved to bridge theoretical advancements to offer scalable solutions for approximating tensor decomposition. This paper introduces fast randomized algorithms for solving the fixed Tucker-rank problem…

Numerical Analysis · Mathematics 2025-06-06 Maolin Che , Yimin Wei , Chong Wu , Hong Yan

Many large-scale stochastic optimization algorithms involve repeated solutions of linear systems or evaluations of log-determinants. In these regimes, computing exact solutions is often unnecessary; it is more computationally efficient to…

Numerical Analysis · Mathematics 2026-02-24 Tianshi Xu , Difeng Cai , Hua Huang , Edmond Chow , Yuanzhe Xi

The robust low-rank tensor completion problem addresses the challenge of recovering corrupted high-dimensional tensor data with missing entries, outliers, and sparse noise commonly found in real-world applications. Existing methodologies…

Machine Learning · Statistics 2026-04-16 Biswarup Karmakar , Ratikanta Behera

The analysis of Tikhonov regularization for nonlinear ill-posed equations with smoothness promoting penalties is an important topic in inverse problem theory. With focus on Hilbert scale models, the case of oversmoothing penalties, i.e.,…

Numerical Analysis · Mathematics 2024-04-18 Bernd Hofmann , Christopher Hofmann , Peter Mathé , Robert Plato

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson