English
Related papers

Related papers: A Tutorial and Open Source Software for the Effici…

200 papers

We introduce a Fourier-based fast algorithm for Gaussian process regression in low dimensions. It approximates a translationally-invariant covariance kernel by complex exponentials on an equispaced Cartesian frequency grid of $M$ nodes.…

Computation · Statistics 2023-05-19 Philip Greengard , Manas Rachh , Alex Barnett

We extend the diffusion-map formalism to data sets that are induced by asymmetric kernels. Analytical convergence results of the resulting expansion are proved, and an algorithm is proposed to perform the dimensional reduction. In this work…

Machine Learning · Computer Science 2024-01-24 Alvaro Almeida Gomez , Antonio Silva Neto , Jorge zubelli

Many quantum algorithms for numerical linear algebra assume black-box access to a block-encoding of the matrix of interest, which is a strong assumption when the matrix is not sparse. Kernel matrices, which arise from discretizing a kernel…

Quantum Physics · Physics 2022-12-14 Quynh T. Nguyen , Bobak T. Kiani , Seth Lloyd

We consider fast kernel summations in high dimensions: given a large set of points in $d$ dimensions (with $d \gg 3$) and a pair-potential function (the {\em kernel} function), we compute a weighted sum of all pairwise kernel interactions…

Machine Learning · Computer Science 2015-02-16 William B. March , George Biros

This work introduces a kernel-independent, multilevel, adaptive algorithm for efficiently evaluating a discrete convolution kernel with a given source distribution. The method is based on linear algebraic tools such as low rank…

Numerical Analysis · Mathematics 2025-07-11 Anna Yesypenko , Chao Chen , Per-Gunnar Martinsson

Kernel methods are powerful tools in statistical learning, but their cubic complexity in the sample size n limits their use on large-scale datasets. In this work, we introduce a scalable framework for kernel regression with O(n log n)…

Machine Learning · Statistics 2025-09-04 Nathan Doumèche , Francis Bach , Gérard Biau , Claire Boyer

Kernel matrices are crucial in many learning tasks such as support vector machines or kernel ridge regression. The kernel matrix is typically dense and large-scale. Depending on the dimension of the feature space even the computation of all…

Machine Learning · Computer Science 2023-12-04 Franziska Nestler , Martin Stoll , Theresa Wagner

Matrices with the structures of Toeplitz, Hankel, Vandermonde and Cauchy types are omnipresent in modern computation. The four classes have distinct features, but in 1990 we showed that Vandermonde and Hankel multipliers transform all these…

Numerical Analysis · Mathematics 2013-11-18 Victor Y. Pan

Kernel matrix-vector multiplication (KMVM) is a foundational operation in machine learning and scientific computing. However, as KMVM tends to scale quadratically in both memory and time, applications are often limited by these…

Numerical Analysis · Mathematics 2025-02-25 Robert Hu , Siu Lun Chau , Dino Sejdinovic , Joan Alexis Glaunès

This paper presents an accelerated quadrature scheme for the evaluation of layer potentials in three dimensions. Our scheme combines a generic, high order quadrature method for singular kernels called Quadrature by Expansion (QBX) with a…

Numerical Analysis · Mathematics 2019-04-01 Matt Wala , Andreas Klöckner

In this work, the fast-convolving reproducing kernel particle method (FC-RKPM) is introduced. This method is hundreds to millions of times faster than the traditional RKPM for 3D meshfree simulations. In this approach, the meshfree…

Numerical Analysis · Mathematics 2024-04-01 Siavash Jafarzadeh , Michael Hillman

Matrix-vector multiplication is one of the most fundamental computing primitives. Given a matrix $A\in\mathbb{F}^{N\times N}$ and a vector $b$, it is known that in the worst case $\Theta(N^2)$ operations over $\mathbb{F}$ are needed to…

Data Structures and Algorithms · Computer Science 2017-11-21 Christopher De Sa , Albert Gu , Rohan Puttagunta , Christopher Ré , Atri Rudra

Topology optimization (TO) has been widely adopted in engineering design; however, it is prone to being trapped in local optima, particularly in strongly nonlinear problems. Sensitivity-free data-driven topology design (DDTD) offers a…

Computational Physics · Physics 2026-03-10 Jun Yang , Ziliang Wang , Shintaro Yamasaki

We study fast algorithms for computing fundamental properties of a positive semidefinite kernel matrix $K \in \mathbb{R}^{n \times n}$ corresponding to $n$ points $x_1,\ldots,x_n \in \mathbb{R}^d$. In particular, we consider estimating the…

Data Structures and Algorithms · Computer Science 2021-06-21 Arturs Backurs , Piotr Indyk , Cameron Musco , Tal Wagner

Despite their tremendous success and versatility, Deep Neural Networks (DNNs) such as Large Language Models (LLMs) suffer from inference inefficiency and rely on advanced computational infrastructure. To address these challenges and make…

Machine Learning · Computer Science 2025-05-05 Mohsen Dehghankar , Mahdi Erfanian , Abolfazl Asudeh

We introduce a novel class of explicit feature maps based on topological indices that represent each graph by a compact feature vector, enabling fast and interpretable graph classification. Using radial basis function kernels on these…

Machine Learning · Computer Science 2025-09-23 Adam Wesołowski , Ronin Wu , Karim Essafi

We present a new computationally efficient method for multi-beamforming in the broadband setting. Our "fast beamspace transformation" forms $B$ beams from $M$ sensor outputs using a number of operations per sample that scales linearly (to…

Signal Processing · Electrical Eng. & Systems 2026-04-17 Nakul Singh , Coleman DeLude , Mark Davenport , Justin Romberg

Quantum kernel methods are a promising branch of quantum machine learning, yet their effectiveness on diverse, high-dimensional, real-world data remains unverified. Current research has largely been limited to low-dimensional or synthetic…

Machine Learning · Computer Science 2026-02-19 Jiang Yuhan , Matthew Otten

Although Fourier series approximation is ubiquitous in computational physics owing to the Fast Fourier Transform (FFT) algorithm, efficient techniques for the fast evaluation of a three-dimensional truncated Fourier series at a set of…

Numerical Analysis · Mathematics 2017-03-08 Marco Caliari , Simone Zuccher

The high computational cost of ab-initio methods limits their application in predicting electronic properties at the device scale. Therefore, an efficient method is needed to map the atomic structure to the electronic structure quickly.…

Materials Science · Physics 2025-09-09 Yunlong Wang , Zhixin Liang , Chi Ding , Junjie Wang , Zheyong Fan , Hui-Tian Wang , Dingyu Xing , Jian Sun