English
Related papers

Related papers: Biorthogonal Extended Krylov Subspace Methods

200 papers

Gradient descent optimizations and backpropagation are the most common methods for training neural networks, but they are computationally expensive for real time applications, need high memory resources, and are difficult to converge for…

Machine Learning · Computer Science 2022-07-05 Seyyed Mostafa Mousavi Janbeh Sarayi , Mansour Nikkhah Bahrami

This paper describes a set of rational filtering algorithms to compute a few eigenvalues (and associated eigenvectors) of non-Hermitian matrix pencils. Our interest lies in computing eigenvalues located inside a given disk, and the proposed…

Numerical Analysis · Mathematics 2021-03-10 Vassilis Kalantzis , Yuanzhe Xi , Lior Horesh

An operator theoretic approach to orthogonal rational functions on the unit circle with poles in its exterior is presented in this paper. This approach is based on the identification of a suitable matrix representation of the multiplication…

Classical Analysis and ODEs · Mathematics 2007-05-23 Luis Velazquez

We devise an L-BFGS method for optimization problems in which the objective is the sum of two functions, where the Hessian of the first function is computationally unavailable while the Hessian of the second function has a computationally…

Optimization and Control · Mathematics 2024-09-10 Florian Mannel , Hari Om Aggrawal

In this work we introduce a memory-efficient method for computing the action of a Hermitian matrix function on a vector. Our method consists of a rational Lanczos algorithm combined with a basis compression procedure based on rational…

Numerical Analysis · Mathematics 2024-03-08 Angelo A. Casulli , Igor Simunec

We introduce the definition of tensorized block rational Krylov subspaces and its relation with multivariate rational functions, extending the formulation of tensorized Krylov subspaces introduced in [Kressner D., Tobler C., Krylov subspace…

Numerical Analysis · Mathematics 2023-06-02 Angelo Alberto Casulli

The rational camera model recently introduced in [19] provides a general methodology for studying abstract nonlinear imaging systems and their multi-view geometry. This paper builds on this framework to study "physical realizations" of…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Matthew Trager , Bernd Sturmfels , John Canny , Martial Hebert , Jean Ponce

The nonlinear inverse problem of exponential data fitting is separable since the fitting function is a linear combination of parameterized exponential functions, thus allowing to solve for the linear coefficients separately from the…

Numerical Analysis · Mathematics 2023-06-13 Annie Cuyt , Wen-shin Lee

A standard approach to model reduction of large-scale higher-order linear dynamical systems is to rewrite the system as an equivalent first-order system and then employ Krylov-subspace techniques for model reduction of first-order systems.…

Numerical Analysis · Mathematics 2007-05-23 Roland W. Freund

For each square complex matrix, V. I. Arnold constructed a normal form with the minimal number of parameters to which a family of all matrices B that are close enough to this matrix can be reduced by similarity transformations that smoothly…

Representation Theory · Mathematics 2010-04-22 Lena Klimenko , Vladimir V. Sergeichuk

Origami structures enabled by folding and unfolding can create complex 3D shapes. However, even a small 3D shape can have large 2D unfoldings. The huge initial dimension of the 2D flattened structure makes fabrication difficult, and defeats…

Computational Geometry · Computer Science 2018-03-12 Zhonghua Xi , Yu-Ki Lee , Young-Joo Lee , Yun-hyeong Kim , Huangxin Wang , Yue Hao , Young-Chang Joo , In-Suk Choi , Jyh-Ming Lien

A gradient recovery operator based on projecting the discrete gradient onto the standard finite element space is considered. We use an oblique projection, where the test and trial spaces are different, and the bases of these two spaces form…

Numerical Analysis · Mathematics 2013-05-02 Bishnu P. Lamichhane , Adam McNeily

In this study, we explore the geometric construction of the Klein bottle and the real projective plane ($\mathrm{RP}^2$) within the framework of tensor networks, focusing on the implementation of crosscap and rainbow boundaries. Previous…

Strongly Correlated Electrons · Physics 2026-03-11 Haruki Shimizu , Atsushi Ueda

We extend the concept of Krylov complexity to include general unitary evolutions involving multiple generators. This generalization enables us to formulate a framework for generalized Krylov complexity, which serves as a measure of the…

High Energy Physics - Theory · Physics 2025-08-14 Amin Faraji Astaneh , Niloofar Vardian

Many optimization problems require hyperparameters, i.e., parameters that must be pre-specified in advance, such as regularization parameters and parametric regularizers in variational regularization methods for inverse problems, and…

Optimization and Control · Mathematics 2025-10-09 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

Statistical image reconstruction in X-Ray computed tomography yields large-scale regularized linear least-squares problems with nonnegativity bounds, where the memory footprint of the operator is a concern. Discretizing images in…

Optimization and Control · Mathematics 2020-07-03 Guillaume Mestdagh , Yves Goussard , Dominique Orban

Random projections or sketching are widely used in many algorithmic and learning contexts. Here we study the performance of iterative Hessian sketch for least-squares problems. By leveraging and extending recent results from random matrix…

Optimization and Control · Mathematics 2020-10-26 Jonathan Lacotte , Sifan Liu , Edgar Dobriban , Mert Pilanci

Sobolev irregularity of the Bergman projection on a family of domains containing the Hartogs triangle is shown. On the Hartogs triangle itself, a sub-Bergman projection is shown to satisfy better Sobolev norm estimates than its Bergman…

Complex Variables · Mathematics 2020-04-09 L. D. Edholm , J. D. McNeal

We compute and analyse the moduli space of those real projective structures on a hyperbolic 3-orbifold that are modelled on a single ideal tetrahedron in projective space. Parameterisations are given in terms of classical invariants,…

Geometric Topology · Mathematics 2021-01-06 Joan Porti , Stephan Tillmann

Nonlinear least-squares problems are a special class of unconstrained optimization problems in which their gradient and Hessian have special structures. In this paper, we exploit these structures and proposed a matrix-free algorithm with a…

Optimization and Control · Mathematics 2020-02-06 Aliyu Muhammed Awwal , Poom Kumam , Hassan Mohammad