English
Related papers

Related papers: Krylov subspace methods to accelerate kernel machi…

200 papers

A standard approach to model reduction of large-scale higher-order linear dynamical systems is to rewrite the system as an equivalent first-order system and then employ Krylov-subspace techniques for model reduction of first-order systems.…

Numerical Analysis · Mathematics 2007-05-23 Roland W. Freund

Many scientific applications require the evaluation of the action of the matrix function over a vector and the most common methods for this task are those based on the Krylov subspace. Since the orthogonalization cost and memory requirement…

Numerical Analysis · Mathematics 2026-03-24 Nicolas L. Guidotti , Per-Gunnar Martinsson , Juan A. Acebrón , José Monteiro

We propose a kernel regression method to predict a target signal lying over a graph when an input observation is given. The input and the output could be two different physical quantities. In particular, the input may not be a graph signal…

Information Theory · Computer Science 2019-08-02 Arun Venkitaraman , Saikat Chatterjee , Peter Händel

This work is concerned with the computation of the action of a matrix function f(A), such as the matrix exponential or the matrix square root, on a vector b. For a general matrix A, this can be done by computing the compression of A onto a…

Numerical Analysis · Mathematics 2023-06-06 Alice Cortinovis , Daniel Kressner , Yuji Nakatsukasa

Within the context of Graph Signal Processing (GSP), Graph Learning (GL) is concerned with the inference of the graph's underlying structure from nodal observations. However, real-world data often contains diverse information, necessitating…

Signal Processing · Electrical Eng. & Systems 2023-11-08 Mohamad H. Alizade , Aref Einizade , Jhony H. Giraldo

The success of kernel-based learning methods depend on the choice of kernel. Recently, kernel learning methods have been proposed that use data to select the most appropriate kernel, usually by combining a set of base kernels. We introduce…

Machine Learning · Computer Science 2011-12-21 Arash Afkanpour , Csaba Szepesvari , Michael Bowling

We propose a fast collocation method based on Krylov subspace iterative solver on general nonuniform grids for the fractional Laplacian problem, in which the fractional operator is presented in a singular integral formulation. The method is…

Numerical Analysis · Mathematics 2025-11-13 Meijie Kong , Hongfei Fu

Kernel approximation methods create explicit, low-dimensional kernel feature maps to deal with the high computational and memory complexity of standard techniques. This work studies a supervised kernel learning methodology to optimize such…

Machine Learning · Computer Science 2020-02-17 Mert Al , Zejiang Hou , Sun-Yuan Kung

The rapid development of reliable Quantum Processing Units (QPU) opens up novel computational opportunities for machine learning. Here, we introduce a procedure for measuring the similarity between graph-structured data, based on the…

Quantum Physics · Physics 2021-09-29 Louis-Paul Henry , Slimane Thabet , Constantin Dalyac , Loïc Henriet

Krylov subspace methods are widely known as efficient algebraic methods for solving large scale linear systems. However, on massively parallel hardware the performance of these methods is typically limited by communication latency rather…

Numerical Analysis · Computer Science 2018-08-22 Siegfried Cools

Performing Bayesian inference on large spatio-temporal models requires extracting inverse elements of large sparse precision matrices for marginal variances, as well as estimating model hyperparameters. Although direct matrix factorizations…

Computation · Statistics 2026-03-17 Abylay Zhumekenov , Elias T. Krainski , Håvard Rue

Despite the recent deep learning (DL) revolution, kernel machines still remain powerful methods for action recognition. DL has brought the use of large datasets and this is typically a problem for kernel approaches, which are not scaling up…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Jacopo Cavazza , Pietro Morerio , Vittorio Murino

In recent years, kernel methods are widespread in tasks of similarity measuring. Specifically, graph kernels are widely used in fields of bioinformatics, chemistry and financial data analysis. However, existing methods, especially entropy…

Machine Learning · Computer Science 2023-03-27 Chengyu Sun , Xing Ai , Zhihong Zhang , Edwin R Hancock

An efficient Krylov subspace algorithm for computing actions of the $\varphi$ matrix function for large matrices is proposed. This matrix function is widely used in exponential time integration, Markov chains and network analysis and many…

Numerical Analysis · Mathematics 2020-10-20 Mike A. Botchev , Leonid A. Knizhnerman , Eugene E. Tyrtyshnikov

This paper presents a study of the inherent structural properties of Krylov subspaces, in particular for the self-adjoint class of operators, and how they relate with the important phenomenon of `Krylov solvability' of linear inverse…

Functional Analysis · Mathematics 2024-10-31 Noè Angelo Caruso

Due to its geometric properties, hyperbolic space can support high-fidelity embeddings of tree- and graph-structured data, upon which various hyperbolic networks have been developed. Existing hyperbolic networks encode geometric priors not…

Machine Learning · Computer Science 2023-03-14 Tao Yu , Christopher De Sa

Modeling videos and image-sets as linear subspaces has proven beneficial for many visual recognition tasks. However, it also incurs challenges arising from the fact that linear subspaces do not obey Euclidean geometry, but lie on a special…

Computer Vision and Pattern Recognition · Computer Science 2014-07-07 Mehrtash T. Harandi , Mathieu Salzmann , Sadeep Jayasumana , Richard Hartley , Hongdong Li

We consider a Krylov subspace approximation method for the symmetric differential Riccati equation $\dot{X} = AX + XA^T + Q - XSX$, $X(0)=X_0$. The method we consider is based on projecting the large scale equation onto a Krylov subspace…

Numerical Analysis · Mathematics 2021-06-24 Antti Koskela , Hermann Mena

We introduce in this paper the mechanism of graph random features (GRFs). GRFs can be used to construct unbiased randomized estimators of several important kernels defined on graphs' nodes, in particular the regularized Laplacian kernel. As…

Machine Learning · Computer Science 2023-05-02 Krzysztof Choromanski

Kernel methods, being supported by a well-developed theory and coming with efficient algorithms, are among the most popular and successful machine learning techniques. From a mathematical point of view, these methods rest on the concept of…

Machine Learning · Statistics 2023-03-20 Christian Fiedler , Michael Herty , Michael Rom , Chiara Segala , Sebastian Trimpe