English
Related papers

Related papers: Stopping criterion for iterative regularization of…

200 papers

We consider linear inverse problems where the solution is assumed to have a sparse expansion on an arbitrary pre-assigned orthonormal basis. We prove that replacing the usual quadratic regularizing penalties by weighted l^p-penalties on the…

Functional Analysis · Mathematics 2025-10-20 Ingrid Daubechies , Michel Defrise , Christine De Mol

Iterative decoding was not originally introduced as the solution to an optimization problem rendering the analysis of its convergence very difficult. In this paper, we investigate the link between iterative decoding and classical…

Information Theory · Computer Science 2010-01-13 Florence Alberge , Ziad Naja , P. Duhamel

In this text I present a couple of new principles and thereon based iterative methods for numerical solution of sequences of systems of linear equations with fixed system matrix and changing right-hand-sides. The use of the new methods is…

Numerical Analysis · Mathematics 2015-12-17 Martin Neuenhofen

We consider the well-studied Sparse Fourier transform problem, where one aims to quickly recover an approximately Fourier $k$-sparse vector $\widehat{x} \in \mathbb{C}^{n^d}$ from observing its time domain representation $x$. In the exact…

Data Structures and Algorithms · Computer Science 2023-01-24 Karl Bringmann , Michael Kapralov , Mikhail Makarov , Vasileios Nakos , Amir Yagudin , Amir Zandieh

The solution of the continuous time filtering problem can be represented as a ratio of two expectations of certain functionals of the signal process that are parametrized by the observation path. We introduce a class of discretization…

Probability · Mathematics 2017-11-23 Dan Crisan , Salvador Ortiz-Latorre

We propose a new iterative unfolding method for experimental data, making use of a regularization function. The use of this function allows one to build an improved normalization procedure for Monte Carlo spectra, unbiased by the presence…

Data Analysis, Statistics and Probability · Physics 2009-07-23 Bogdan Malaescu

This paper considers large-scale linear ill-posed inverse problems whose solutions can be represented as sums of smooth and piecewise constant components. To solve such problems we consider regularizers consisting of two terms that must be…

Numerical Analysis · Mathematics 2022-06-30 Ali Gholami , Silvia Gazzola

Sequences of parametrized Lyapunov equations can be encountered in many application settings. Moreover, solutions of such equations are often intermediate steps of an overall procedure whose main goal is the computation of…

Numerical Analysis · Mathematics 2024-05-30 Davide Palitta , Zoran Tomljanović , Ivica Nakić , Jens Saak

In this work, we propose a new criterion for choosing the regularization parameter in Tikhonov regularization when the noise is white Gaussian. The criterion minimizes a lower bound of the predictive risk, when both data norm and noise…

Numerical Analysis · Mathematics 2020-06-24 Federico Benvenuto , Bangti Jin

Parameter learning for high-dimensional, partially observed, and nonlinear stochastic processes is a methodological challenge. Spatiotemporal disease transmission systems provide examples of such processes giving rise to open inference…

Machine Learning · Statistics 2023-04-05 Ning Ning , Edward L. Ionides

Recently, the regularized functional matching pursuit (RFMP) was introduced as a greedy algorithm for linear ill-posed inverse problems. This algorithm incorporates the Tikhonov-Phillips regularization which implies the necessity of a…

Numerical Analysis · Mathematics 2016-11-04 Martin Gutting , Bianca Kretz , Volker Michel , Roger Telschow

We consider linear inverse problems under white noise. These types of problems can be tackled with, e.g., iterative regularisation methods and the main challenge is to determine a suitable stopping index for the iteration. Convergence…

Numerical Analysis · Mathematics 2022-05-02 Tim Jahn

We consider the numerical approximation of the filtering problem in high dimensions, that is, when the hidden state lies in $\mathbb{R}^d$ with $d$ large. For low dimensional problems, one of the most popular numerical procedures for…

Computation · Statistics 2014-12-12 Alex Beskos , Dan Crisan , Ajay Jasra , Kengo Kamatani , Yan Zhou

We present a continuous-time equivalent to the well-known iterative linear-quadratic algorithm including an implementation of a backtracking line-search policy and a novel regularization approach based on the necessary conditions in the…

Systems and Control · Electrical Eng. & Systems 2025-05-22 Juraj Lieskovský , Jaroslav Bušek , Tomáš Vyhlídal

In this work, we are devoted to the reconstruction of an unknown initial value from the terminal data. The asymptotic and root-distribution properties of Mittag-Leffler functions are used to establish stability of the backward problem.…

Numerical Analysis · Mathematics 2025-06-24 Dakang Cen , Zhiyuan Li , Wenlong Zhang

The reconstruction of images from their corresponding noisy Radon transform is a typical example of an ill-posed linear inverse problem as arising in the application of computerized tomography (CT). As the (naive) solution does not depend…

Early stopping of iterative algorithms is an algorithmic regularization method to avoid over-fitting in estimation and classification. In this paper, we show that early stopping can also be applied to obtain the minimax optimal testing in a…

Statistics Theory · Mathematics 2018-09-18 Meimei Liu , Guang Cheng

We introduce a generalized Fourier ratio, the \(\ell^1/\ell^2\) norm ratio of coefficients in an \emph{arbitrary} orthonormal system, as a single, basis-invariant measure of \emph{effective dimension} that governs fundamental limits across…

Classical Analysis and ODEs · Mathematics 2026-01-26 Will Burstein , Alex Iosevich , Hari Sarang Nathan

This paper proposes a data-driven model reduction approach on the basis of noisy data. Firstly, the concept of data reduction is introduced. In particular, we show that the set of reduced-order models obtained by applying a Petrov-Galerkin…

Optimization and Control · Mathematics 2022-02-01 Azka Muji Burohman , Bart Besselink , Jacquelien M. A. Scherpen , M. Kanat Camlibel

Deep neural networks are typically represented by a much larger number of parameters than shallow models, making them prohibitive for small footprint devices. Recent research shows that there is considerable redundancy in the parameter…

Machine Learning · Computer Science 2016-05-17 Ming Tu , Visar Berisha , Yu Cao , Jae-sun Seo