English
Related papers

Related papers: Fast And Scalable FFT-Based GPU-Accelerated Algori…

200 papers

A robust and fast solver for the fractional differential equation (FDEs) involving the Riesz fractional derivative is developed using an adaptive finite element method on non-uniform meshes. It is based on the utilization of hierarchical…

Numerical Analysis · Mathematics 2017-10-11 Xuan Zhao , Xiaozhe Hu , Wei Cai , George Em Karniadakis

Motivated by recent developments in serverless systems for large-scale computation as well as improvements in scalable randomized matrix algorithms, we develop OverSketched Newton, a randomized Hessian-based optimization algorithm to solve…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-28 Vipul Gupta , Swanand Kadhe , Thomas Courtade , Michael W. Mahoney , Kannan Ramchandran

The finite element method is a well-established method for the numerical solution of partial differential equations (PDEs), both linear and nonlinear. However, the repeated reassemblage of finite element matrices for nonlinear PDEs is…

Numerical Analysis · Mathematics 2022-09-12 Yannis Voet

Matrix multiplication is a fundamental operation in both training of neural networks and inference. To accelerate matrix multiplication, Graphical Processing Units (GPUs) provide it implemented in hardware. Due to the increased throughput…

Mathematical Software · Computer Science 2026-04-07 Faizan A. Khattak , Mantas Mikaitis

The Hilbert-space Gaussian Process (HGP) approach offers a hyperparameter-independent basis function approximation for speeding up Gaussian Process (GP) inference by projecting the GP onto M basis functions. These properties result in a…

Machine Learning · Computer Science 2024-08-06 Frida Viset , Anton Kullberg , Frederiek Wesel , Arno Solin

We present a massively parallel, GPU-accelerated implementation of the Bethe-Salpeter equation (BSE) for the calculation of the vertical excitation energies (VEEs) and optical absorption spectra of condensed and molecular systems, starting…

Materials Science · Physics 2024-12-25 Victor Wen-zhe Yu , Yu Jin , Giulia Galli , Marco Govoni

We consider least-squares problems with quadratic regularization and propose novel sketching-based iterative methods with an adaptive sketch size. The sketch size can be as small as the effective dimension of the data matrix to guarantee…

Machine Learning · Computer Science 2021-04-30 Jonathan Lacotte , Mert Pilanci

We design and develop a work-efficient multithreaded algorithm for sparse matrix-sparse vector multiplication (SpMSpV) where the matrix, the input vector, and the output vector are all sparse. SpMSpV is an important primitive in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-26 Ariful Azad , Aydin Buluc

Matrix-free finite element implementations of massively parallel geometric multigrid save memory and are often significantly faster than implementations using classical sparse matrix techniques. They are especially well suited for…

Numerical Analysis · Mathematics 2016-08-24 Simon Bauer , Marcus Mohr , Ulrich Rüde , Jens Weismüller , Markus Wittmann , Barbara Wohlmuth

Solving inverse and optimization problems over solutions of nonlinear partial differential equations (PDEs) on complex spatial domains is a long-standing challenge. Here we introduce a method that parameterizes the solution using spectral…

Numerical Analysis · Mathematics 2025-10-30 James V. Roggeveen , Michael P. Brenner

We study the problem of recovery of matrices that are simultaneously low rank and row and/or column sparse. Such matrices appear in recent applications in cognitive neuroscience, imaging, computer vision, macroeconomics, and genetics. We…

Machine Learning · Statistics 2019-04-11 Ming Yu , Varun Gupta , Mladen Kolar

We develop a novel linear-complexity bottom-up sketching-based algorithm for constructing a $H^2$ matrix, and present its high performance GPU implementation. The construction algorithm requires both a black-box sketching operator and an…

Mathematical Software · Computer Science 2025-06-23 Wajih Halim Boukaram , Yang Liu , Pieter Ghysels , Xiaoye Sherry Li

The graph-based invariant set (GIS) algorithm is a promising set-based technique for computing the largest (with respect to inclusion) control invariant set of general discrete-time nonlinear dynamical systems. However, like other invariant…

Systems and Control · Electrical Eng. & Systems 2022-02-15 Benjamin Decardi-Nelsona , Jinfeng Liu

We are interested in solving linear systems arising from three applications: (1) kernel methods in machine learning, (2) discretization of boundary integral equations from mathematical physics, and (3) Schur complements formed in the…

Numerical Analysis · Mathematics 2022-08-15 Chao Chen , Per-Gunnar Martinsson

In this paper, we provide explicit formulas for the exact inverses of the symmetric tridiagonal near-Toeplitz matrices characterized by weak diagonal dominance in the Toeplitz part. Furthermore, these findings extend to scenarios where the…

Numerical Analysis · Mathematics 2024-07-11 Bakytzhan Kurmanbek , Yogi Erlangga , Yerlan Amanbek

We present an adaptive grid matrix-free operator approximation scheme based on a "product-convolution" interpolation of convolution operators. This scheme is appropriate for operators that are locally translation-invariant, even if these…

Numerical Analysis · Mathematics 2019-02-07 Nick Alger , Vishwas Rao , Aaron Myers , Tan Bui-Thanh , Omar Ghattas

The performance of graph programs depends highly on the algorithm, the size and structure of the input graphs, as well as the features of the underlying hardware. No single set of optimizations or one hardware platform works well across all…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-11 Ajay Brahmakshatriya , Yunming Zhang , Changwan Hong , Shoaib Kamil , Julian Shun , Saman Amarasinghe

We consider the linear time-dependent Schr\"odinger equation with a time-dependent smooth potential on an unbounded domain. A Galerkin spectral method with a tensor-product Hermite basis is used as a discretization in space. Discretizing…

Numerical Analysis · Mathematics 2015-05-14 Bernd Brumm

This paper presents an efficient method for extracting the second-order sensitivities from a system of implicit nonlinear equations on upcoming graphical processing units (GPU) dominated computer systems. We design a custom automatic…

We present a multi-block finite-difference solver for massively parallel Direct Numerical Simulations (DNS) of incompressible flows. The algorithm combines the versatility of a multi-block solver with the method of eigenfunctions…

Computational Physics · Physics 2022-09-14 Pedro Costa