English
Related papers

Related papers: GMRES using pseudoinverse for range symmetric sing…

200 papers

This paper investigates two inexact Levenberg-Marquardt (LM) methods for solving systems of nonlinear equations. Both approaches compute approximate search directions by solving the LM linear system inexactly, subject to specific…

Optimization and Control · Mathematics 2025-07-23 Bas Symoens , Morteza Rahimi , Masoud Ahookhosh

Physics-informed machine learning and inverse modeling require the solution of ill-conditioned non-convex optimization problems. First-order methods, such as SGD and ADAM, and quasi-Newton methods, such as BFGS and L-BFGS, have been applied…

Numerical Analysis · Mathematics 2021-05-18 Kailai Xu , Eric Darve

This work presents an Iterative Constraint Energy Minimizing Generalized Multiscale Finite Element Method (ICEM-GMsFEM) for solving the contact problem with high contrast coefficients. The model problem can be characterized by a variational…

Numerical Analysis · Mathematics 2024-06-06 Zishang Li , Changqing Ye , Eric T. Chung

Methods for solving hyperbolic systems typically depend on unknown ordering (e.g., Gauss-Seidel, or sweep/wavefront/marching methods) to achieve good convergence. For many discretisations, mesh types or decompositions these methods do not…

Numerical Analysis · Mathematics 2025-11-19 S. Dargaville , R. P. Smedley-Stevenson , P. N. Smith , C. C. Pain

We consider an inverse source problem for partially coherent light propagating in the Fresnel regime. The data is the coherence of the field measured away from the source. The reconstruction is based on a minimum residue formulation, which…

We introduce a new class of preconditioners to enable flexible GMRES to find a least-squares solution, and potentially the pseudoinverse solution, of large-scale sparse, asymmetric, singular, and potentially inconsistent systems. We develop…

Numerical Analysis · Mathematics 2022-01-13 Xiangmin Jiao , Qiao Chen

This article develops a weak Galerkin least-squares (WG--LS) finite element method for first-order linear convection equations in non-divergence form. The method is formulated using discontinuous finite element functions and does not…

Numerical Analysis · Mathematics 2026-01-05 Chunmei Wang , Shangyou Zhang

We extend the geometrical inverse approximation approach for solving linear least-squares problems. For that we focus on the minimization of $1-\cos(X(A^TA),I)$, where $A$ is a given rectangular coefficient matrix and $X$ is the approximate…

Numerical Analysis · Mathematics 2019-02-25 Jean-Paul Chehab , Marcos Raydan

Selecting interpretable feature sets in underdetermined ($n \ll p$) and highly correlated regimes constitutes a fundamental challenge in data science, particularly when analyzing physical measurements. In such settings, multiple distinct…

Machine Learning · Computer Science 2026-02-10 Kateřina Henclová , Václav Šmídl

We present a two-stage least-squares method to inverse medium problems of reconstructing multiple unknown coefficients simultaneously from noisy data. A direct sampling method is applied to detect the location of the inhomogeneity in the…

Numerical Analysis · Mathematics 2022-01-04 Kazufumi Ito , Ying Liang , Jun Zou

This article proposes an efficient numerical method for solving nonlinear partial differential equations (PDEs) based on sparse Gaussian processes (SGPs). Gaussian processes (GPs) have been extensively studied for solving PDEs by…

Numerical Analysis · Mathematics 2023-08-09 Rui Meng , Xianjin Yang

The Extended Randomized Kaczmarz method is a well known iterative scheme which can find the Moore-Penrose inverse solution of a possibly inconsistent linear system and requires only one additional column of the system matrix in each…

Numerical Analysis · Mathematics 2022-07-21 Frank Schöpfer , Dirk A Lorenz , Lionel Tondji , Maximilian Winkler

We review our calculation method, Gaussian expansion method (GEM), and its applications to various few-body (3- to 5-body) systems such as 1) few-nucleon systems, 2) few-body structure of hypernuclei, 3) clustering structure of light nuclei…

Nuclear Theory · Physics 2018-09-14 Emiko Hiyama , Masayasu Kamimura

We prove the statistical consistency of kernel Partial Least Squares Regression applied to a bounded regression learning problem on a reproducing kernel Hilbert space. Partial Least Squares stands out of well-known classical approaches as…

Methodology · Statistics 2010-08-13 Gilles Blanchard , Nicole Kraemer

The randomized row method is a popular representative of the iterative algorithm because of its efficiency in solving the overdetermined and consistent systems of linear equations. In this paper, we present an extended randomized multiple…

Numerical Analysis · Mathematics 2024-11-06 Nian-Ci Wu , Chengzhi Liu , Yatian Wang , Qian Zuo

We present a new method for the numerical solution of singular integral equations on the real axis. The method's value stems from an explicit formula for the Cauchy integral of a complex exponential multiplied by a rational function.…

Numerical Analysis · Mathematics 2014-04-29 Thomas Trogdon

Designing modern photonic devices often involves traversing a large parameter space via an optimization procedure, gradient based or otherwise, and typically results in the designer performing electromagnetic simulations of correlated…

Computational Physics · Physics 2020-03-27 Rahul Trivedi , Logan Su , Jesse Lu , Martin F Schubert , Jelena Vuckovic

We study the convergence of the shuffling gradient method, a popular algorithm employed to minimize the finite-sum function with regularization, in which functions are passed to apply (Proximal) Gradient Descent (GD) one by one whose order…

Optimization and Control · Mathematics 2025-05-30 Zijian Liu , Zhengyuan Zhou

In this work, a balancing domain decomposition by constraints (BDDC) algorithm is applied to the nonsymmetric positive definite linear system arising from the hybridizable discontinuous Galerkin (HDG) discretization of an elliptic…

Numerical Analysis · Mathematics 2025-08-20 Sijing Liu , Jinjin Zhang

We consider the least-squares finite element method (lsfem) for systems of nonlinear ordinary differential equations and establish an optimal error estimate for this method when piecewise linear elements are used. The main assumptions are…

Numerical Analysis · Mathematics 2021-10-01 Matthias Chung , Justin Krueger , Honghu Liu