English
Related papers

Related papers: The matrix-vector complexity of $Ax=b$

200 papers

The article is devoted to the development of algorithmic methods ensuring efficient complexity bounds for strongly convex-concave saddle point problems in the case when one of the groups of variables is high-dimensional, and the other is…

Optimization and Control · Mathematics 2022-10-26 Egor Gladin , Ilya Kuruzov , Fedor Stonyakin , Dmitry Pasechnyuk , Mohammad Alkousa , Alexander Gasnikov

A novel algorithm for computing the action of a matrix exponential over a vector is proposed. The algorithm is based on a multilevel Monte Carlo method, and the vector solution is computed probabilistically generating suitable random paths…

Numerical Analysis · Mathematics 2019-07-05 Juan A. Acebron , Jose R. Herrero , Jose Monteiro

We consider the solution of large stiff systems of ordinary differential equations with explicit exponential Runge--Kutta integrators. These problems arise from semi-discretized semi-linear parabolic partial differential equations on…

Numerical Analysis · Mathematics 2023-08-24 Kai Bergermann , Martin Stoll

We address the problem of minimizing a convex function over the space of large matrices with low rank. While this optimization problem is hard in general, we propose an efficient greedy algorithm and derive its formal approximation…

Machine Learning · Computer Science 2011-06-09 Shai Shalev-Shwartz , Alon Gonen , Ohad Shamir

We develop an algorithm for computing the solution of a large system of linear ordinary differential equations (ODEs) with polynomial inhomogeneity. This is equivalent to computing the action of a certain matrix function on the vector…

Numerical Analysis · Mathematics 2012-05-16 Jitse Niesen , Will M. Wright

This paper considers mathematical programs, whose constraints are expressed by a parameterized vector equilibrium problem. The latter is a well recognized framework, which is able to cover multicriteria optimization, vector variational…

Optimization and Control · Mathematics 2022-10-18 Amos Uderzo

In this paper we develop randomized Krylov subspace methods for efficiently computing regularized solutions to large-scale linear inverse problems. Building on the recently developed randomized Gram-Schmidt process, where sketched inner…

Numerical Analysis · Mathematics 2025-08-29 Julianne Chung , Silvia Gazzola

Classically, a mainstream approach for solving a convex-concave min-max problem is to instead solve the variational inequality problem arising from its first-order optimality conditions. Is it possible to solve min-max problems faster by…

Optimization and Control · Mathematics 2025-11-06 Henry Shugart , Jason M. Altschuler

We develop and analyze an inexact regularized alternating projection method for nonconvex feasibility problems. Such a method employs inexact projections on one of the two sets, according to a set of well-defined conditions. We prove the…

Optimization and Control · Mathematics 2025-07-28 Stefania Bellavia , Simone Rebegoldi , Mattia Silei

Sequences of parametrized Lyapunov equations can be encountered in many application settings. Moreover, solutions of such equations are often intermediate steps of an overall procedure whose main goal is the computation of…

Numerical Analysis · Mathematics 2024-05-30 Davide Palitta , Zoran Tomljanović , Ivica Nakić , Jens Saak

Given an $n$ by $n$ matrix $A$ and an $n$-vector $b$, along with a rational function $R(z) := D(z )^{-1} N(z)$, we show how to find the optimal approximation to $R(A) b$ from the Krylov space, $\mbox{span}( b, Ab, \ldots , A^{k-1} b)$,…

Numerical Analysis · Mathematics 2023-07-03 Tyler Chen , Anne Greenbaum , Natalie Wellen

We introduce a new approach to evaluate the largest Lyapunov exponent of a family of nonnegative matrices. The method is based on using special positive homogeneous functionals on $R^{d}_+,$ which gives iterative lower and upper bounds for…

Optimization and Control · Mathematics 2012-01-17 Vladimir Yu. Protasov , Raphael M. Jungers

In an unnormalized Krylov subspace framework for solving symmetric systems of linear equations, the orthogonal vectors that are generated by a Lanczos process are not necessarily on the form of gradients. Associating each orthogonal vector…

Optimization and Control · Mathematics 2014-09-18 Anders Forsgren , Tove Odland

For a given matrix subspace, how can we find a basis that consists of low-rank matrices? This is a generalization of the sparse vector problem. It turns out that when the subspace is spanned by rank-1 matrices, the matrices can be obtained…

Numerical Analysis · Computer Science 2016-06-29 Yuji Nakatsukasa , Tasuku Soma , André Uschmajew

Among randomized numerical linear algebra strategies, so-called sketching procedures are emerging as effective reduction means to accelerate the computation of Krylov subspace methods for, e.g., the solution of linear systems, eigenvalue…

Numerical Analysis · Mathematics 2024-08-02 Davide Palitta , Marcel Schweitzer , Valeria Simoncini

Recently, Dvir, Golovnev, and Weinstein have shown that sufficiently strong lower bounds for linear data structures would imply new bounds for rigid matrices. However, their result utilizes an algorithm that requires an $NP$ oracle, and…

Computational Complexity · Computer Science 2019-10-29 Sivaramakrishnan Natarajan Ramamoorthy , Cyrus Rashtchian

An efficient Krylov subspace algorithm for computing actions of the $\varphi$ matrix function for large matrices is proposed. This matrix function is widely used in exponential time integration, Markov chains and network analysis and many…

Numerical Analysis · Mathematics 2020-10-20 Mike A. Botchev , Leonid A. Knizhnerman , Eugene E. Tyrtyshnikov

For linear inverse problems with a large number of unknown parameters, uncertainty quantification remains a challenging task. In this work, we use Krylov subspace methods to approximate the posterior covariance matrix and describe efficient…

Numerical Analysis · Mathematics 2019-05-22 Arvind K. Saibaba , Julianne Chung , Katrina Petroske

We provide a polynomial lower bound on the minimum singular value of an $m\times m$ random matrix $M$ with jointly Gaussian entries, under a polynomial bound on the matrix norm and a global small-ball probability bound $$\inf_{x,y\in…

Probability · Mathematics 2021-12-03 Zipei Nie

The computation of a matrix function $f(A)$ is an important task in scientific computing appearing in machine learning, network analysis and the solution of partial differential equations. In this work, we use only matrix-vector products…

Numerical Analysis · Mathematics 2026-03-03 Taejun Park , Yuji Nakatsukasa