English
Related papers

Related papers: Accelerating a restarted Krylov method for matrix …

200 papers

Krylov complexity measures operator growth with respect to a basis, which is adapted to the Heisenberg time evolution. The construction of that basis relies on the Lanczos algorithm, also known as the recursion method. The mathematics of…

High Energy Physics - Theory · Physics 2022-09-13 Wolfgang Mück , Yi Yang

We present a new paradigm for speeding up randomized computations of several frequently used functions in machine learning. In particular, our paradigm can be applied for improving computations of kernels based on random embeddings. Above…

Machine Learning · Statistics 2016-04-26 Krzysztof Choromanski , Francois Fagan

In classical frameworks as the Euclidean space, positive definite kernels as well as their analytic properties are explicitly available and can be incorporated directly in kernel-based learning algorithms. This is different if the…

Numerical Analysis · Mathematics 2023-01-18 Wolfgang Erb

In the present paper, we propose Krylov-based methods for solving large-scale differential Sylvester matrix equations having a low rank constant term. We present two new approaches for solving such differential matrix equations. The first…

Numerical Analysis · Mathematics 2017-07-10 M. Hached , K. Jbilou

The problem of minimizing a separable convex function under linearly coupled constraints arises from various application domains such as economic systems, distributed control, and network flow. The main challenge for solving this problem is…

Optimization and Control · Mathematics 2017-09-05 Qin Fan , Min Xu , Yiming Ying

It is shown in this paper that, almost all current prevalent iterative \mbox{methods} for solving linear system of equations can be classified as what we called extended Krylov subspace methods. In this paper a new type of iterative methods…

Numerical Analysis · Mathematics 2016-03-18 Wujian Peng , Shuhua Zhang

We describe a convergence acceleration technique for unconstrained optimization problems. Our scheme computes estimates of the optimum from a nonlinear average of the iterates produced by any optimization method. The weights in this average…

Optimization and Control · Mathematics 2019-04-16 Damien Scieur , Alexandre d'Aspremont , Francis Bach

Randomized rounding is a standard method, based on the probabilistic method, for designing combinatorial approximation algorithms. In Raghavan's seminal paper introducing the method (1988), he writes: "The time taken to solve the linear…

Data Structures and Algorithms · Computer Science 2015-06-02 Neal E. Young

We present a method for enhanced sampling of molecular dynamics simulations using stochastic resetting. Various phenomena, ranging from crystal nucleation to protein folding, occur on timescales that are unreachable in standard simulations.…

Chemical Physics · Physics 2023-02-09 Ofir Blumer , Shlomi Reuveni , Barak Hirshberg

Composite convex optimization models arise in several applications, and are especially prevalent in inverse problems with a sparsity inducing norm and in general convex optimization with simple constraints. The most widely used algorithms…

Optimization and Control · Mathematics 2016-07-15 Vahan Hovhannisyan , Panos Parpas , Stefanos Zafeiriou

We propose a block Krylov subspace version of the GCRO-DR method proposed in [Parks et al.; SISC 2005], which is an iterative method allowing for the efficient minimization of the the residual over an augmented Krylov subspace. We offer a…

Numerical Analysis · Mathematics 2026-05-14 Michael L. Parks , Kirk M. Soodhalter , Daniel B. Szyld

Tikhonov regularization is a widely used technique in solving inverse problems that can enforce prior properties on the desired solution. In this paper, we propose a Krylov subspace based iterative method for solving linear inverse problems…

Numerical Analysis · Mathematics 2023-08-15 Haibo Li

The recently developed data-driven eigenmatrix method shows very promising reconstruction accuracy in sparse recovery for a wide range of kernel functions and random sample locations. However, its current implementation can lead to…

Numerical Analysis · Mathematics 2024-05-15 Koung Hee Leem , Jun Liu , George Pelekanos

New algorithms are proposed for the Tucker approximation of a 3-tensor, that access it using only the tensor-by-vector-by-vector multiplication subroutine. In the matrix case, Krylov methods are methods of choice to approximate the dominant…

Numerical Analysis · Mathematics 2012-02-06 S. A. Goreinov , I. V. Oseledets , D. V. Savostyanov

This paper extends the framework of randomised matrix multiplication to a coarser partition and proposes an algorithm as a complement to the classical algorithm, especially when the optimal probability distribution of the latter one is…

Numerical Analysis · Mathematics 2019-05-20 Yue Wu

The Kaczmarz method is a popular iterative scheme for solving large-scale linear systems. The randomized Kaczmarz method (RK) greatly improves the convergence rate of the Kaczmarz method, by using the rows of the coefficient matrix in…

Numerical Analysis · Mathematics 2020-12-01 Yutong Jiang , Gang Wu , Long Jiang

A Monte Carlo method for computing the action of a matrix exponential for a certain class of matrices on a vector is proposed. The method is based on generating random paths, which evolve through the indices of the matrix, governed by a…

Numerical Analysis · Mathematics 2019-06-19 Juan A. Acebron

We consider a general honest homogeneous continuous-time Markov process with restarts. The process is forced to restart from a given distribution at time moments generated by an independent Poisson process. The motivation to study such…

Probability · Mathematics 2012-06-26 Konstantin Avrachenkov , Alexei Piunovskiy , Zhang Yi

A novel algorithm for computing the action of a matrix exponential over a vector is proposed. The algorithm is based on a multilevel Monte Carlo method, and the vector solution is computed probabilistically generating suitable random paths…

Numerical Analysis · Mathematics 2019-07-05 Juan A. Acebron , Jose R. Herrero , Jose Monteiro

Motivated by the randomized sketch to solve a variety of problems in scientific computation, we improve both the maximal weighted residual Kaczmarz method and the randomized block average Kaczmarz method using two new randomized sketch…

Numerical Analysis · Mathematics 2025-11-18 Haochen Jiang , Dongdong Liu , Xianping Wu , Xu Yang