English
Related papers

Related papers: Convergence of Regularization Parameters for Solut…

200 papers

We investigate the modeling and the numerical solution of machine learning problems with prediction functions which are linear combinations of elements of a possibly infinite-dimensional dictionary. We propose a novel flexible composite…

Statistics Theory · Mathematics 2015-12-03 Patrick L. Combettes , Saverio Salzo , Silvia Villa

Deep neural networks exploiting millions of parameters are nowadays the norm in deep learning applications. This is a potential issue because of the great amount of computational resources needed for training, and of the possible loss of…

Computation and Language · Computer Science 2022-10-31 Giovanni Bonetta , Matteo Ribero , Rossella Cancelliere

Generalization is one of the fundamental issues in machine learning. However, traditional techniques like uniform convergence may be unable to explain generalization under overparameterization. As alternative approaches, techniques based on…

Machine Learning · Computer Science 2022-03-22 Jiaye Teng , Jianhao Ma , Yang Yuan

Choosing an appropriate regularization term is necessary to obtain a meaningful solution to an ill-posed linear inverse problem contaminated with measurement errors or noise. The $\ell_p$ norm covers a wide range of choices for the…

Numerical Analysis · Mathematics 2020-12-30 Jeffrey Cornelis , Wim Vanroose

In this work, our aim is to reconstruct the unknown initial value from terminal data. We develop a numerical framework on nonuniform time grids for fractional wave equations under the lower regularity assumptions. Then, we introduce a…

Numerical Analysis · Mathematics 2025-06-25 Dakang Cen , Zhiyuan Li , Wenlong Zhang

Regularization is a well studied problem in the context of neural networks. It is usually used to improve the generalization performance when the number of input samples is relatively small or heavily contaminated with noise. The…

Artificial Intelligence · Computer Science 2011-04-19 Salah Rifai , Xavier Glorot , Yoshua Bengio , Pascal Vincent

A number of regularization methods for discrete inverse problems consist in considering weighted versions of the usual least square solution. However, these so-called filter methods are generally restricted to monotonic transformations,…

Statistics Theory · Mathematics 2011-05-05 Paul Rochet

In most practical applications such as recommendation systems, display advertising, and so forth, the collected data often contains missing values and those missing values are generally missing-not-at-random, which deteriorates the…

Machine Learning · Computer Science 2024-05-27 Mingming Ha , Xuewen Tao , Wenfang Lin , Qionxu Ma , Wujiang Xu , Linxun Chen

Variational regularization of ill-posed inverse problems is based on minimizing the sum of a data fidelity term and a regularization term. The balance between them is tuned using a positive regularization parameter, whose automatic choice…

Numerical Analysis · Mathematics 2025-11-12 Markus Juvonen , Bjørn Jensen , Ilmari Pohjola , Yiqiu Dong , Samuli Siltanen

This paper is concerned with the solution of large-scale linear discrete ill-posed problems with error-contaminated data. Tikhonov regularization is a popular approach to determine meaningful approximate solutions of such problems. The…

Numerical Analysis · Mathematics 2016-02-11 Guangxin Huang , Silvia Noschese , Lothar Reichel

The recently developed data-driven eigenmatrix method shows very promising reconstruction accuracy in sparse recovery for a wide range of kernel functions and random sample locations. However, its current implementation can lead to…

Numerical Analysis · Mathematics 2024-05-15 Koung Hee Leem , Jun Liu , George Pelekanos

In this paper, we aim at recovering an unknown signal x0 from noisy L1measurements y=Phi*x0+w, where Phi is an ill-conditioned or singular linear operator and w accounts for some noise. To regularize such an ill-posed inverse problem, we…

Statistics Theory · Mathematics 2013-11-05 Samuel Vaiter , Charles Deledalle , Gabriel Peyré , Charles Dossal , Jalal Fadili

We propose a new stopping criterion for Krylov subspace iterative regularization of large-scale ill-posed inverse problems. Our stopping criterion accurately filters the data using a generalization of the Picard parameter that was…

Numerical Analysis · Mathematics 2017-07-14 Eitan Levin , Alexander Y. Meltzer

Tensor decomposition methods allow us to learn the parameters of latent variable models through decomposition of low-order moments of data. A significant limitation of these algorithms is that there exists no general method to regularize…

Machine Learning · Statistics 2019-05-28 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

Convergence rates in spectral regularization methods quantify the approximation error in inverse problems as a function of the noise level or the number of sampling points. Classical strong convergence rate results typically rely on source…

Numerical Analysis · Mathematics 2025-12-05 Sabrina Guastavino , Gabriele Santin , Francesco Marchetti , Federico Benvenuto

Recently, sparsity-based algorithms are proposed for super-resolution spectrum estimation. However, to achieve adequately high resolution in real-world signal analysis, the dictionary atoms have to be close to each other in frequency,…

Machine Learning · Statistics 2015-06-05 Yiyuan She , Huanghuang Li , Jiangping Wang , Dapeng Wu

The Singular Value Decomposition is a matrix decomposition technique widely used in the analysis of multivariate data, such as complex space-time images obtained in both physical and biological systems. In this paper, we examine the…

Statistical Mechanics · Physics 2009-09-25 A. M. Sengupta , P. P. Mitra

Tikhonov regularization involves minimizing the combination of a data discrepancy term and a regularizing term, and is the standard approach for solving inverse problems. The use of non-convex regularizers, such as those defined by trained…

Optimization and Control · Mathematics 2023-02-20 Daniel Obmann , Markus Haltmeier

This paper derives a new class of adaptive regularization parameter choice strategies that can be effectively and efficiently applied when regularizing large-scale linear inverse problems by combining standard Tikhonov regularization and…

Numerical Analysis · Mathematics 2019-07-15 Silvia Gazzola , Malena Sabate Landman

Conditional stability estimates require additional regularization for obtaining stable approximate solutions if the validity area of such estimates is not completely known. In this context, we consider ill-posed nonlinear inverse problems…

Numerical Analysis · Mathematics 2020-01-29 Frank Werner , Bernd Hofmann