English
Related papers

Related papers: Extended-Krylov-subspace methods for trust-region …

200 papers

This work presents a new Krylov-subspace-recycling method for efficiently solving sequences of linear systems of equations characterized by varying right-hand sides and symmetric-positive-definite matrices. As opposed to typical truncation…

Numerical Analysis · Mathematics 2016-01-22 Kevin Carlberg , Virginia Forstall , Ray Tuminaro

The rational Krylov subspace method (RKSM) and the low-rank alternating directions implicit (LR-ADI) iteration are established numerical tools for computing low-rank solution factors of large-scale Lyapunov equations. In order to generate…

Numerical Analysis · Mathematics 2019-05-07 Patrick Kürschner , Melina A. Freitag

We propose a novel algorithm based on inexact GMRES methods for linear response calculations in density functional theory. Such calculations require iteratively solving a nested linear problem $\mathcal{E} \delta\rho = b$ to obtain the…

Numerical Analysis · Mathematics 2025-10-30 Michael F. Herbst , Bonan Sun

The recently developed data-driven eigenmatrix method shows very promising reconstruction accuracy in sparse recovery for a wide range of kernel functions and random sample locations. However, its current implementation can lead to…

Numerical Analysis · Mathematics 2024-05-15 Koung Hee Leem , Jun Liu , George Pelekanos

We propose a first-order method to solve the cubic regularization subproblem (CRS) based on a novel reformulation. The reformulation is a constrained convex optimization problem whose feasible region admits an easily computable projection.…

Optimization and Control · Mathematics 2021-06-03 Rujun Jiang , Man-Chung Yue , Zhishuo Zhou

We focus on robust and efficient iterative solvers for the pressure Poisson equation in incompressible Navier-Stokes problems. Preconditioned Krylov subspace methods are popular for these problems, with BiCGStab and GMRES(m) most frequently…

Numerical Analysis · Computer Science 2015-09-29 Amit Amritkar , Eric de Sturler , Katarzyna Świrydowicz , Danesh Tafti , Kapil Ahuja

Linear matrix equations, such as the Sylvester and Lyapunov equations, play an important role in various applications, including the stability analysis and dimensionality reduction of linear dynamical control systems and the solution of…

Numerical Analysis · Mathematics 2019-05-30 Daniel Kressner , Stefano Massei , Leonardo Robol

For the large-scale linear discrete ill-posed problem $\min\|Ax-b\|$ or $Ax=b$ with $b$ contaminated by Gaussian white noise, the Lanczos bidiagonalization based Krylov solver LSQR and its mathematically equivalent CGLS, the Conjugate…

Numerical Analysis · Mathematics 2020-03-20 Zhongxiao Jia

Most current prevalent iterative methods can be classified into the so-called extended Krylov subspace methods, a class of iterative methods which do not fall into this category are also proposed in this paper. Comparing with traditional…

Numerical Analysis · Mathematics 2015-11-26 Wujian Peng , Qun Lin

In this work we address the subspace recovery problem. Given a set of data samples (vectors) approximately drawn from a union of multiple subspaces, our goal is to segment the samples into their respective subspaces and correct the possible…

Information Theory · Computer Science 2013-01-29 Guangcan Liu , Zhouchen Lin , Shuicheng Yan , Ju Sun , Yong Yu , Yi Ma

In this article we study the numerical approximation of incompressible miscible displacement problems with a linearised Crank-Nicolson time discretisation, combined with a mixed finite element and discontinuous Galerkin method. At the heart…

Numerical Analysis · Mathematics 2011-11-28 Max Jensen , Ruediger Mueller

As the scale of problems and data used for experimental design, signal processing and data assimilation grow, the oft-occuring least squares subproblems are correspondingly growing in size. As the scale of these least squares problems…

Computation · Statistics 2023-02-09 Nathaniel Pritchard , Vivak Patel

An efficient Krylov subspace algorithm for computing actions of the $\varphi$ matrix function for large matrices is proposed. This matrix function is widely used in exponential time integration, Markov chains and network analysis and many…

Numerical Analysis · Mathematics 2020-10-20 Mike A. Botchev , Leonid A. Knizhnerman , Eugene E. Tyrtyshnikov

We study iterative methods based on Krylov subspaces for low-rank approximation under any Schatten-$p$ norm. Here, given access to a matrix $A$ through matrix-vector products, an accuracy parameter $\epsilon$, and a target rank $k$, the…

Data Structures and Algorithms · Computer Science 2022-06-20 Ainesh Bakshi , Kenneth L. Clarkson , David P. Woodruff

We present an algorithm to perform trust-region-based optimization for nonlinear unconstrained problems. The method selectively uses function and gradient evaluations at different floating-point precisions to reduce the overall energy…

Optimization and Control · Mathematics 2022-02-18 Richard J Clancy , Matt Menickelly , Jan Hückelheim , Paul Hovland , Prani Nalluri , Rebecca Gjini

We consider variants of trust-region and cubic regularization methods for non-convex optimization, in which the Hessian matrix is approximated. Under mild conditions on the inexact Hessian, and using approximate solution of the…

Optimization and Control · Mathematics 2019-05-15 Peng Xu , Fred Roosta , Michael W. Mahoney

We consider nonlinear inverse problems arising in the context of parameter identification for parabolic partial differential equations (PDEs). For stable reconstructions, regularization methods such as the iteratively regularized…

Numerical Analysis · Mathematics 2025-07-16 Michael Kartmann , Benedikt Klein , Mario Ohlberger , Thomas Schuster , Stefan Volkwein

The hybrid LSMR algorithm is proposed for large-scale general-form regularization. It is based on a Krylov subspace projection method where the matrix $A$ is first projected onto a subspace, typically a Krylov subspace, which is implemented…

Numerical Analysis · Mathematics 2024-09-17 Yanfei Yang

Constrained least squares problems arise in a variety of applications, and many iterative methods are already available to compute their solutions. This paper proposes a new efficient approach to solve nonnegative linear least squares…

Numerical Analysis · Mathematics 2017-01-09 Silvia Gazzola , Yves Wiaux

An algorithm for constructing a $J$-orthogonal basis of the extended Krylov subspace $\mathcal{K}_{r,s}=\operatorname{range}\{u,Hu, H^2u,$ $ \ldots, $ $H^{2r-1}u, H^{-1}u, H^{-2}u, \ldots, H^{-2s}u\},$ where $H \in \mathbb{R}^{2n \times…

Numerical Analysis · Mathematics 2022-02-28 Peter Benner , Heike Faßbender , Michel-Niklas Senn