English
Related papers

Related papers: Fast hardware-aware matrix-free algorithm for high…

200 papers

Numerical integration of the stiffness matrix in higher order finite element (FE) methods is recognized as one of the heaviest computational tasks in a FE solver. The problem becomes even more relevant when computing the Gram matrix in the…

Numerical Analysis · Mathematics 2017-11-06 Jaime Mora , Leszek Demkowicz

The growing demand for edge computing and AI drives research into analog in-memory computing using memristors, which overcome data movement bottlenecks by computing directly within memory. However, device failures and variations critically…

Emerging Technologies · Computer Science 2025-07-16 Zhicheng Xu , Jiawei Liu , Sitao Huang , Zefan Li , Shengbo Wang , Bo Wen , Ruibin Mao , Mingrui Jiang , Giacomo Pedretti , Jim Ignowski , Kaibin Huang , Can Li

We present a novel approach to fast on-the-fly low order finite element assembly for scalar elliptic partial differential equations of Darcy type with variable coefficients optimized for matrix-free implementations. Our approach introduces…

Numerical Analysis · Computer Science 2018-07-24 Simon Bauer , Daniel Drzisga , Marcus Mohr , Ulrich Ruede , Christian Waluga , Barbara Wohlmuth

Vectorization is increasingly important to achieve high performance on modern hardware with SIMD instructions. Assembly of matrices and vectors in the finite element method, which is characterized by iterating a local assembly kernel over…

Mathematical Software · Computer Science 2020-08-26 Tianjiao Sun , Lawrence Mitchell , Kaushik Kulkarni , Andreas Klöckner , David A. Ham , Paul H. J. Kelly

Mixed-precision quantization, where a deep neural network's layers are quantized to different precisions, offers the opportunity to optimize the trade-offs between model size, latency, and statistical accuracy beyond what can be achieved…

Machine Learning · Computer Science 2023-07-07 Georg Rutishauser , Francesco Conti , Luca Benini

Hierarchical $\mathcal{H}^2$-matrices are asymptotically optimal representations for the discretizations of non-local operators such as those arising in integral equations or from kernel functions. Their $O(N)$ complexity in both memory and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-14 Stefano Zampini , Wajih Boukaram , George Turkiyyah , Omar Knio , David E. Keyes

Fast and accurate numerical simulations are crucial for designing large-scale geological carbon storage projects ensuring safe long-term CO2 containment as a climate change mitigation strategy. These simulations involve solving numerous…

Mathematical Software · Computer Science 2024-08-08 Ryuichi Sai , Francois P. Hamon , John Mellor-Crummey , Mauricio Araya-Polo

We extend the GenTen tensor decomposition package by introducing an accelerated dense matricized tensor times Khatri-Rao product (MTTKRP), the workhorse kernel for canonical polyadic (CP) tensor decompositions, that is portable and…

Mathematical Software · Computer Science 2025-10-17 Gabriel Kosmacher , Eric T. Phipps , Sivasankaran Rajamanickam

When modeling scientific and industrial problems, geometries are typically modeled by explicit boundary representations obtained from computer-aided design software. Unfitted (also known as embedded or immersed) finite element methods offer…

Computational Engineering, Finance, and Science · Computer Science 2024-05-24 Pere A. Martorell , Santiago Badia

This work presents the efficient, matrix-free finite-element library hyper.deal for solving partial differential equations in two to six dimensions with high-order discontinuous Galerkin methods. It builds upon the low-dimensional…

Mathematical Software · Computer Science 2020-02-20 Peter Munch , Katharina Kormann , Martin Kronbichler

Matrix extensions have emerged as an essential feature in modern CPUs to address the surging demands of AI workloads. However, existing designs often incur substantial hardware and software design overhead. Tight coupling with the CPU…

Hardware Architecture · Computer Science 2026-04-14 Jinpeng Ye , Chongxi Wang , Wenqing Li , Bin Yuan , Shiyi Wang , Fenglu Zhang , Junyu Yue , Jianan Xie , Yunhao Ye , Haoyu Deng , Yingkun Zhou , Xin Cheng , Fuxin Zhang , Jian Wang

Graph analytics techniques based on spectral methods process extremely large sparse matrices with millions or even billions of non-zero values. Behind these algorithms lies the Top-K sparse eigenproblem, the computation of the largest…

Hardware Architecture · Computer Science 2022-01-20 Francesco Sgherzi , Alberto Parravicini , Marco Domenico Santambrogio

This work introduces a kernel-independent, multilevel, adaptive algorithm for efficiently evaluating a discrete convolution kernel with a given source distribution. The method is based on linear algebraic tools such as low rank…

Numerical Analysis · Mathematics 2025-07-11 Anna Yesypenko , Chao Chen , Per-Gunnar Martinsson

Matrix multiplication is a foundational operation in scientific computing and machine learning, yet its computational complexity makes it a significant bottleneck for large-scale applications. The shift to parallel architectures, primarily…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-30 Mufakir Qamar Ansari , Mudabir Qamar Ansari

Chebyshev filter diagonalization is well established in quantum chemistry and quantum physics to compute bulks of eigenvalues of large sparse matrices. Choosing a block vector implementation, we investigate optimization opportunities on the…

Mathematical Software · Computer Science 2020-06-25 Moritz Kreutzer , Georg Hager , Dominik Ernst , Holger Fehske , Alan R. Bishop , Gerhard Wellein

In this paper, we present algorithms and implementations for the end-to-end GPU acceleration of matrix-free low-order-refined preconditioning of high-order finite element problems. The methods described here allow for the construction of…

Mathematical Software · Computer Science 2023-06-05 Will Pazner , Tzanio Kolev , Jean-Sylvain Camier

Large-scale eigenvalue computations on sparse matrices are a key component of graph analytics techniques based on spectral methods. In such applications, an exhaustive computation of all eigenvalues and eigenvectors is impractical and…

Hardware Architecture · Computer Science 2021-03-19 Francesco Sgherzi , Alberto Parravicini , Marco Siracusa , Marco Domenico Santambrogio

The capability of discretization of matrix elements in the problem of quadratic functional minimization with linear member built on matrix in N-dimensional configuration space with discrete coordinates is researched. It is shown, that…

Neural and Evolutionary Computing · Computer Science 2012-05-04 Boris Kryzhanovsky , Mikhail Kryzhanovsky , Magomed Malsagov

We introduce the Fast Free Memory method (FFM), a new fast method for the numerical evaluation of convolution products. Inheriting from the Fast Multipole Method, the FFM is a descent-only and kernel-independent algorithm. We give the…

Numerical Analysis · Mathematics 2019-09-13 Matthieu Aussal , Marc Bakry

We present efficient algorithms to build data structures and the lists needed for fast multipole methods. The algorithms are capable of being efficiently implemented on both serial, data parallel GPU and on distributed architectures. With…

Mathematical Software · Computer Science 2013-01-10 Qi Hu , Nail A. Gumerov , Ramani Duraiswami