English
Related papers

Related papers: Are sketch-and-precondition least squares solvers …

200 papers

While preconditioning is a long-standing concept to accelerate iterative methods for linear systems, generalizations to matrix functions are still in their infancy. We go a further step in this direction, introducing polynomial…

Numerical Analysis · Mathematics 2024-01-15 Andreas Frommer , Gustavo Ramirez-Hidalgo , Marcel Schweitzer , Manuel Tsolakis

In this paper, we consider the mixed and componentwise condition numbers for a linear function of the solution to the linear least squares problem with equality constrains (LSE). We derive the explicit expressions of the mixed and…

Numerical Analysis · Mathematics 2016-12-13 Huai-An Diao

In this paper we formulate and solve a robust least squares problem for a system of linear equations subject to quantization error in the data matrix. Ordinary least squares fails to consider uncertainty in the operator, modeling all noise…

Optimization and Control · Mathematics 2021-04-09 Richard Clancy , Stephen Becker

We study the backward stability of running a backward stable eigenstructure solver on a pencil $S(\lambda)$ that is a strong linearization of a rational matrix $R(\lambda)$ expressed in the form $R(\lambda)=D(\lambda)+ C(\lambda…

Numerical Analysis · Mathematics 2021-03-31 Froilán M. Dopico , María C. Quintana , Paul Van Dooren

Sketch-and-project is a framework which unifies many known iterative methods for solving linear systems and their variants, as well as further extensions to non-linear optimization problems. It includes popular methods such as randomized…

Optimization and Control · Mathematics 2023-09-20 Michał Dereziński , Elizaveta Rebrova

Stationary iterative methods with a symmetric splitting matrix are performed as inner-iteration preconditioning for Krylov subspace methods. We give conditions such that the inner-iteration preconditioning matrix is definite, and show that…

Numerical Analysis · Mathematics 2019-05-20 Keiichi Morikuni

We consider the linear least squares problem with linear equality constraints (LSE problem) formulated as $\min_{x\in\mathbb{R}^{n}}\|Ax-b\|_2 \ \mathrm{s.t.} \ Cx = d$. Although there are some classical methods available to solve this…

Numerical Analysis · Mathematics 2025-01-06 Haibo Li

Separable nonlinear least squares (SNLS)problem is a special class of nonlinear least squares (NLS)problems, whose objective function is a mixture of linear and nonlinear functions. It has many applications in many different areas,…

Computational Geometry · Computer Science 2016-11-17 Wajeb Gharibi , Omar Saeed Al-Mushayt

Model-based iterative reconstruction plays a key role in solving inverse problems. However, the associated minimization problems are generally large-scale, nonsmooth, and sometimes even nonconvex, which present challenges in designing…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Tao Hong , Zhaoyi Xu , Jason Hu , Jeffrey A. Fessler

In this paper, we study the performance of the non-conforming least-squares spectral element method for Stokes problem. Generalized Stokes problem has been considered and the method is shown to be exponential accurate. The numerical method…

Numerical Analysis · Mathematics 2021-02-12 N. Kishore Kumar , Shubhashree Mohapatra

Semidefinite programming (SDP) is a powerful tool for tackling a wide range of computationally hard problems such as clustering. Despite the high accuracy, semidefinite programs are often too slow in practice with poor scalability on large…

Machine Learning · Statistics 2022-02-10 Yubo Zhuang , Xiaohui Chen , Yun Yang

In recent work (Maierhofer & Huybrechs, 2022, Adv. Comput. Math.), the authors showed that least-squares oversampling can improve the convergence properties of collocation methods for boundary integral equations involving operators of…

Numerical Analysis · Mathematics 2022-01-28 Georg Maierhofer , Daan Huybrechs

In this paper, we present a nonlinear least-squares fitting algorithm using B-splines with free knots. Since its performance strongly depends on the initial estimation of the free parameters (i.e. the knots), we also propose a fast and…

Signal Processing · Electrical Eng. & Systems 2020-03-13 Péter Kovács , Andrea M. Fekete

We introduce a novel technique for ``lifting'' dimension lower bounds for linear sketches in the real-valued setting to dimension lower bounds for linear sketches with polynomially-bounded integer entries when the input is a…

Data Structures and Algorithms · Computer Science 2025-03-26 Elena Gribelyuk , Honghao Lin , David P. Woodruff , Huacheng Yu , Samson Zhou

Brown and Walker (1997) showed that GMRES determines a least squares solution of $ A x = b $ where $ A \in {\bf R}^{n \times n} $ without breakdown for arbitrary $ b, x_0 \in {\bf R}^n $ if and only if $A$ is range-symmetric, i.e. $ {\cal…

Numerical Analysis · Mathematics 2024-07-08 Kota Sugihara , Ken Hayami

This paper concerns the stability of analytical and numerical solutions of nonlinear stochastic delay differential equations (SDDEs). We derive sufficient conditions for the stability, contractivity and asymptotic contractivity in mean…

Numerical Analysis · Mathematics 2014-01-21 Siqing Gan , Aiguo Xiao , Desheng Wang

We consider the cubic Schr\"odinger equation on the euclidean space perturbed by a short-range potential $V$. The presence of a negative simple eigenvalue for $-\Delta+V$ gives rise to a curve of small and localized nonlinear ground states…

Analysis of PDEs · Mathematics 2021-09-14 Nicolas Camps

This paper introduces the recursive sweeping preconditioner for the numerical solution of the Helmholtz equation in 3D. This is based on the earlier work of the sweeping preconditioner with the moving perfectly matched layers (PMLs). The…

Numerical Analysis · Mathematics 2015-02-26 Fei Liu , Lexing Ying

Low-rank Tucker and CP tensor decompositions are powerful tools in data analytics. The widely used alternating least squares (ALS) method, which solves a sequence of over-determined least squares subproblems, is costly for large and sparse…

Numerical Analysis · Mathematics 2021-08-26 Linjian Ma , Edgar Solomonik

The scattering of waves by obstacles in a 2D setting is considered, in particular the computation of the scattered field via the collocation or the least-squares methods. In the case of multiple scattering by smooth obstacles, we prove that…

Numerical Analysis · Mathematics 2014-01-15 Gilles Chardon