English
Related papers

Related papers: tcFFT: Accelerating Half-Precision FFT through Ten…

200 papers

There has been considerable research into improving Fast Fourier Transform (FFT) performance through parallelization and optimization for specialized hardware. However, even with those advancements, processing of very large files, over 1TB…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-28 Rostislav Tsiomenko , Bradley S. Rees

Largely due to their increased native capacity for numerical intensity and power efficiency, reduced-precision floating-point computing resources, primarily used in artificial intelligence (AI) applications, have expanded at a greater rate…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Harun Bayraktar , Cole Brower , John Gunnels , Greg Henry , Cherin Joseph , Jack Kosaian , Dmitry Lyakh , Lukas Mosimann , Victor Podlozhnyuk , Addison Richards , Paul Springer , Haicheng Wu

In this paper, we propose TensorFHE, an FHE acceleration solution based on GPGPU for real applications on encrypted data. TensorFHE utilizes Tensor Core Units (TCUs) to boost the computation of Number Theoretic Transform (NTT), which is the…

Hardware Architecture · Computer Science 2023-01-02 Shengyu Fan , Zhiwei Wang , Weizhi Xu , Rui Hou , Dan Meng , Mingzhe Zhang

Recent advances in high-resolution CT-imaging technology are creating a new class of ultra-high resolved micro-structural datasets that challenge the limits of traditional homogenization approaches. While state-of-the-art FFT-based…

Materials Science · Physics 2025-12-10 Sascha H. Hauck , Matthias Kabel , Nicolas R. Gauger

In the field of High Performance Computing, communications among processes represent a typical bottleneck for massively parallel scientific applications. Object of this research is the development of a network interface card with specific…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-07 Roberto Ammendola

The Fast Fourier Transform(FFT) is a classic signal processing algorithm that is utilized in a wide range of applications. For image processing, FFT computes on every pixel's value of an image, regardless of their properties in frequency…

Signal Processing · Electrical Eng. & Systems 2020-02-25 Sheng Shi , Runkai Yang , Haihang You

Fourier and related transforms is a family of algorithms widely employed in diverse areas of computational science, notoriously difficult to scale on high-performance parallel computers with large number of processing elements (cores). This…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-09 Dmitry Pekurovsky

Convolutional neural networks (CNNs) have a large number of variables and hence suffer from a complexity problem for their implementation. Different methods and techniques have developed to alleviate the problem of CNN's complexity, such as…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Kamran Chitsaz , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi , Shahram Shirani

Discrete cosine transform (DCT) and other Fourier-related transforms have broad applications in scientific computing. However, off-the-shelf high-performance multi-dimensional DCT (MD DCT) libraries are not readily available in parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-05 Zixuan Jiang , Jiaqi Gu , David Z. Pan

The Discrete Fourier Transform (DFT) is essential for various applications ranging from signal processing to convolution and polynomial multiplication. The groundbreaking Fast Fourier Transform (FFT) algorithm reduces DFT time complexity…

Hardware Architecture · Computer Science 2023-04-06 Orian Leitersdorf , Yahav Boneh , Gonen Gazit , Ronny Ronen , Shahar Kvatinsky

This research introduces an FPGA-based hardware accelerator to optimize the Singular Value Decomposition (SVD) and Fast Fourier transform (FFT) operations in AI models. The proposed design aims to improve processing speed and reduce…

Hardware Architecture · Computer Science 2025-04-15 Hong Ding , Chia Chao Kang , SuYang Xi , Zehang Liu , Xuan Zhang , Yi Ding

In this work, we present the \emph{twiddless fast Fourier transform (TFFT)}, a novel algorithm for computing the $N$-point discrete Fourier transform (DFT). The TFFT's divide strategy builds on recent results that decimate an $N$-point…

Computational Complexity · Computer Science 2025-12-23 Saulo Queiroz

General-purpose multiprocessors (as, in our case, Intel IvyBridge and Intel Haswell) increasingly add GPU computing power to the former multicore architectures. When used for embedded applications (for us, Synthetic aperture radar) with…

Mathematical Software · Computer Science 2015-06-01 Mohamed Amine Bergach , Emilien Kofman , Robert de Simone , Serge Tissot , Michel Syska

Nonuniform fast Fourier transforms dominate the computational cost in many applications including image reconstruction and signal processing. We thus present a general-purpose GPU-based CUDA library for type 1 (nonuniform to uniform) and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-06 Yu-hsuan Shih , Garrett Wright , Joakim Andén , Johannes Blaschke , Alex H. Barnett

The nonuniform fast Fourier transform (NUFFT) enables spectral methods for problems with irregularly spaced samples, with applications in medical imaging, molecular dynamics, and kinetic plasma simulations. Existing implementations are…

Computational Engineering, Finance, and Science · Computer Science 2026-05-12 Paul Fischill , Andreas Adelmann , Sriramkrishnan Muralikrishnan

We show that Transformer encoder architectures can be sped up, with limited accuracy costs, by replacing the self-attention sublayers with simple linear transformations that "mix" input tokens. These linear mixers, along with standard…

Computation and Language · Computer Science 2022-05-30 James Lee-Thorp , Joshua Ainslie , Ilya Eckstein , Santiago Ontanon

We present the Tucker tensor DFT (TTDFT) code which uses a tensor-structured algorithm with graphic processing unit (GPU) acceleration for conducting ground-state DFT calculations on large-scale systems. The Tucker tensor DFT algorithm uses…

Computational Physics · Physics 2021-11-01 Chih-Chuen Lin , Vikram Gavini

Graph neural networks (GNNs) have seen extensive application in domains such as social networks, bioinformatics, and recommendation systems. However, the irregularity and sparsity of graph data challenge traditional computing methods, which…

Machine Learning · Computer Science 2025-02-25 Ka Wai Wu

Tensor cores (TCs) are a type of Application-Specific Integrated Circuit (ASIC) and are a recent addition to Graphics Processing Unit (GPU) architectures. As such, TCs are purposefully designed to greatly improve the performance of Matrix…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-21 Benoit Gallet , Michael Gowanlock

Modern processors deliver higher throughput for lower-precision arithmetic than for higher-precision arithmetic. For matrix multiplication, the Ozaki scheme exploits this performance gap by splitting the inputs into lower-precision…

Mathematical Software · Computer Science 2026-04-01 Shota Kawakami , Daisuke Takahashi