English
Related papers

Related papers: Multigrid preconditioning for regularized least-sq…

200 papers

Given a set of response observations for a parametrized dynamical system, we seek a parametrized dynamical model that will yield uniformly small response error over a range of parameter values yet has low order. Frequently, access to…

Numerical Analysis · Mathematics 2018-08-20 Alexander Grimm , Christopher Beattie , Zlatko Drmač , Serkan Gugercin

In this paper, we revisit the large-scale constrained linear regression problem and propose faster methods based on some recent developments in sketching and optimization. Our algorithms combine (accelerated) mini-batch SGD with a new…

Machine Learning · Computer Science 2018-02-12 Di Wang , Jinhui Xu

Preconditioning for overdetermined least-squares problems has received comparatively little attention, and designing methods that are both effective and memory-efficient remains challenging. We propose a class of ILU-based preconditioners…

Numerical Analysis · Mathematics 2026-03-31 Jennifer Scott , Miroslav Tůma

The geometric high-order regularization methods such as mean curvature and Gaussian curvature, have been intensively studied during the last decades due to their abilities in preserving geometric properties including image edges, corners,…

Image and Video Processing · Electrical Eng. & Systems 2023-03-22 Zhenwei Zhang , Ke Chen , Ke Tang , Yuping Duan

We develop a convolutional regularized least squares ($\texttt{CRLS}$) framework for reduced-order modeling of transonic flows with shocks. Conventional proper orthogonal decomposition (POD) based reduced models are attractive because of…

Fluid Dynamics · Physics 2025-11-27 Muhammad Bilal , Ashwin Renganathan

We describe a parallel iterative least squares solver named \texttt{LSRN} that is based on random normal projection. \texttt{LSRN} computes the min-length solution to $\min_{x \in \mathbb{R}^n} \|A x - b\|_2$, where $A \in \mathbb{R}^{m…

Data Structures and Algorithms · Computer Science 2012-02-21 Xiangrui Meng , Michael A. Saunders , Michael W. Mahoney

The focus of this work is on the construction and analysis of optimal-order multigrid preconditioners to be used in the Newton-Krylov method for a distributed optimal control problem constrained by the stationary Navier-Stokes equations. As…

Numerical Analysis · Mathematics 2018-11-22 Ana Maria Soane , Andrei Draganescu

Inverse problems arise in a wide spectrum of applications in fields ranging from engineering to scientific computation. Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, such…

Numerical Analysis · Mathematics 2025-05-12 Abinash Nayak

For low-dimensional data sets with a large amount of data points, standard kernel methods are usually not feasible for regression anymore. Besides simple linear models or involved heuristic deep learning models, grid-based discretizations…

Machine Learning · Computer Science 2019-03-01 Bastian Bohn , Michael Griebel , Jens Oettershagen

In this research, to solve the large indefinite least squares problem, we firstly transform its normal equation into a sparse block three-by-three linear systems, then use GMRES method with an accelerated preconditioner to solve it. The…

Numerical Analysis · Mathematics 2025-05-26 Jun Li , Lingsheng Meng

Variational regularization of ill-posed inverse problems is based on minimizing the sum of a data fidelity term and a regularization term. The balance between them is tuned using a positive regularization parameter, whose automatic choice…

Numerical Analysis · Mathematics 2025-11-12 Markus Juvonen , Bjørn Jensen , Ilmari Pohjola , Yiqiu Dong , Samuli Siltanen

Due to the COVID-19 pandemic, there is an increasing demand for portable CT machines worldwide in order to diagnose patients in a variety of settings. This has led to a need for CT image reconstruction algorithms that can produce high…

Numerical Analysis · Mathematics 2025-12-10 Mai Phuong Pham Huynh , Manuel Santana , Ana Castillo

Tikhonov regularization for projected solutions of large-scale ill-posed problems is considered. The Golub-Kahan iterative bidiagonalization is used to project the problem onto a subspace and regularization then applied to find a subspace…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Saeed Vatankhah , Vahid E. Ardestani

We investigate iterative methods with randomized preconditioners for solving overdetermined least-squares problems, where the preconditioners are based on a random embedding of the data matrix. We consider two distinct approaches: the…

Numerical Analysis · Mathematics 2021-04-15 Jonathan Lacotte , Mert Pilanci

The advantages and difficulties of application of Pad\'e approximants to two-dimensional regression analysis are discussed. New formulation of residuals is suggested in the method of least squares. It leads to a system of linear equations…

Methodology · Statistics 2022-08-23 Glib Yevkin , Olexandr Yevkin

For the large-scale linear discrete ill-posed problem $\min\|Ax-b\|$ or $Ax=b$ with $b$ contaminated by a white noise, the Lanczos bidiagonalization based LSQR method and its mathematically equivalent Conjugate Gradient (CG) method for…

Numerical Analysis · Mathematics 2017-01-23 Zhongxiao Jia

We propose regularization schemes for deformable registration and efficient algorithms for their numerical approximation. We treat image registration as a variational optimal control problem. The deformation map is parametrized by its…

Optimization and Control · Mathematics 2016-09-09 Andreas Mang , George Biros

We present a stationary iteration based upon a block splitting for a class of indefinite least squares problem. Convergence of the proposed method is investigated and optimal value of the involving parameter is used. The induced…

Numerical Analysis · Mathematics 2025-12-15 Davod Khojasteh Salkuyeh

In this work we exploit agglomeration based $h$-multigrid preconditioners to speed-up the iterative solution of discontinuous Galerkin discretizations of the Stokes and Navier-Stokes equations. As a distinctive feature $h$-coarsened mesh…

Computational Physics · Physics 2017-09-13 Lorenzo Botti , Alessandro Colombo , Francesco Bassi

Non-blind image deblurring is typically formulated as a linear least-squares problem regularized by natural priors on the corresponding sharp picture's gradients, which can be solved, for example, using a half-quadratic splitting method…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Thomas Eboli , Jian Sun , Jean Ponce