English
Related papers

Related papers: Scalable iterative data-adaptive RKHS regularizati…

200 papers

For the large-scale linear discrete ill-posed problem $\min\|Ax-b\|$ or $Ax=b$ with $b$ contaminated by Gaussian white noise, the Lanczos bidiagonalization based Krylov solver LSQR and its mathematically equivalent CGLS, the Conjugate…

Numerical Analysis · Mathematics 2020-03-20 Zhongxiao Jia

We investigate iterated Tikhonov methods coupled with a Kaczmarz strategy for obtaining stable solutions of nonlinear systems of ill-posed operator equations. We show that the proposed method is a convergent regularization method. In the…

Numerical Analysis · Mathematics 2020-12-23 J. Baumeister , A. De Cezaro , A. Leitao

We present an adaptive regularization scheme for optimizing composite energy functionals arising in image analysis problems. The scheme automatically trades off data fidelity and regularization depending on the current data fit during the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Byung-Woo Hong , Ja-Keoung Koo , Martin Burger , Stefano Soatto

Many practical imaging systems suffer from uncertainty in acquisition geometry -- such as projection angles in computed tomography or sensor positions in photoacoustic tomography -- leading to nonlinear inverse problems that require joint…

Numerical Analysis · Mathematics 2026-05-08 Toluwani Okunola , Mirjeta Pasha , Misha E. Kilmer , James G. Nagy , Eric de Sturler

In this paper, we propose a stochastic Primal-Dual Hybrid Gradient (PDHG) approach for solving a wide spectrum of regularized stochastic minimization problems, where the regularization term is composite with a linear function. It has been…

Machine Learning · Computer Science 2018-02-02 Linbo Qiao , Tianyi Lin , Qi Qin , Xicheng Lu

We develop innovative algorithms for solving the strong-constraint formulation of four-dimensional variational data assimilation in large-scale applications. We present a space-time decomposition approach that employs domain decomposition…

Numerical Analysis · Mathematics 2022-05-16 Luisa D'Amore. Emil Constantinescu , Luisa Carracciuolo

This work presents a general framework for solving the low rank and/or sparse matrix minimization problems, which may involve multiple non-smooth terms. The Iteratively Reweighted Least Squares (IRLS) method is a fast solver, which smooths…

Machine Learning · Computer Science 2015-06-18 Canyi Lu , Zhouchen Lin , Shuicheng Yan

In this paper, we consider the nonlinear ill-posed inverse problem with noisy data in the statistical learning setting. The Tikhonov regularization scheme in Hilbert scales is considered to reconstruct the estimator from the random noisy…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi

We consider the inverse problem of retrieving aerosol extinction coefficients from Raman lidar measurements. In this problem the unknown and the data are related through the exponential of a linear operator, the unknown is non-negative and…

Numerical Analysis · Mathematics 2018-08-21 Giulia Denevi , Sara Garbarino , Alberto Sorrentino

Rational Krylov subspaces have become a reference tool in dimension reduction procedures for several application problems. When data matrices are symmetric, a short-term recurrence can be used to generate an associated orthonormal basis. In…

Numerical Analysis · Mathematics 2021-12-21 Davide Palitta , Stefano Pozza , Valeria Simoncini

A domain decomposition method for the solution of general variable-coefficient elliptic partial differential equations on regular domains is introduced. The method is based on tessellating the domain into overlapping thin slabs or shells,…

Numerical Analysis · Mathematics 2025-10-31 Simon Dirckx , Anna Yesypenko , Per-Gunnar Martinsson

In complex-valued coherent inverse problems such as synthetic aperture radar (SAR), one may often have prior information only on the magnitude image which shows the features of interest such as strength of reflectivity. In contrast, there…

Numerical Analysis · Mathematics 2024-10-30 F. M. Watson , W. R. B. Lionheart , J. Hellier

This paper discusses model order reduction of large sparse second-order index-3 differential algebraic equations (DAEs) by applying Iterative Rational Krylov Algorithm (IRKA). In general, such DAEs arise in constraint mechanics, multibody…

Optimization and Control · Mathematics 2021-01-11 Xin Du , M. Monir Uddiny , A. Mostakim Fonyz , Md. Tanzim Hossainx , Md. Nazmul Islam Shuzan

Several problems in machine learning, statistics, and other fields rely on computing eigenvectors. For large scale problems, the computation of these eigenvectors is typically performed via iterative schemes such as subspace iteration or…

Numerical Analysis · Mathematics 2020-11-03 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

Near kinematic singularities of a serial manipulator, the inverse kinematics (IK) problem becomes ill-conditioned, which poses computational problems for the numerical solution. Computational methods to tackle this issue are based on…

Robotics · Computer Science 2024-12-31 Andreas Mueller

We propose a fast algorithm for computing the entire ridge regression regularization path in nearly linear time. Our method constructs a basis on which the solution of ridge regression can be computed instantly for any value of the…

Optimization and Control · Mathematics 2022-10-25 Yifei Wang , Mert Pilanci

This paper presents a new algorithm KIOPS for computing linear combinations of $\varphi$-functions that appear in exponential integrators. This algorithm is suitable for large-scale problems in computational physics where little or no…

Numerical Analysis · Mathematics 2021-11-12 Stéphane Gaudreault , Greg Rainwater , Mayya Tokman

We propose a new iteratively reweighted least squares (IRLS) algorithm for the recovery of a matrix $X \in \mathbb{C}^{d_1\times d_2}$ of rank $r \ll\min(d_1,d_2)$ from incomplete linear observations, solving a sequence of low complexity…

Numerical Analysis · Mathematics 2018-02-28 Christian Kümmerle , Juliane Sigl

We consider least-squares problems with quadratic regularization and propose novel sketching-based iterative methods with an adaptive sketch size. The sketch size can be as small as the effective dimension of the data matrix to guarantee…

Machine Learning · Computer Science 2021-04-30 Jonathan Lacotte , Mert Pilanci

In this paper we propose a new class of iterative regularization methods for solving ill-posed linear operator equations. The prototype of these iterative regularization methods is in the form of second order evolution equation with a…

Numerical Analysis · Mathematics 2020-06-24 Rongfang Gong , B. Hofmann , Ye Zhang