English
Related papers

Related papers: Large-Scale Discrete Fourier Transform on TPUs

200 papers

As parallel computing trends towards the exascale, scientific data produced by high-fidelity simulations are growing increasingly massive. For instance, a simulation on a three-dimensional spatial grid with 512 points per dimension that…

Numerical Analysis · Computer Science 2017-01-05 Woody Austin , Grey Ballard , Tamara G. Kolda

The reason why Cooley-Tukey Fast Fourier Transform (FFT) over $\mathbb{Q}$ can be efficiently implemented using complex roots of unity is that the cyclotomic extensions of the completion $\mathbb{R}$ of $\mathbb{Q}$ are at most quadratic,…

Symbolic Computation · Computer Science 2025-05-06 Hiromasa Kondo

This work presents a highly optimized computational framework for the Discrete Dipole Approximation, a numerical method for calculating the optical properties associated with a target of arbitrary geometry that is widely used in…

Instrumentation and Methods for Astrophysics · Physics 2009-08-07 James Mc Donald , Aaron Golden , S. Gerard Jennings

The Fast Fourier Transform(FFT) is a classic signal processing algorithm that is utilized in a wide range of applications. For image processing, FFT computes on every pixel's value of an image, regardless of their properties in frequency…

Signal Processing · Electrical Eng. & Systems 2020-02-25 Sheng Shi , Runkai Yang , Haihang You

We present a new method to accelerate real time-time dependent density functional theory (rt-TDDFT) calculations with hybrid exchange-correlation functionals. For large basis set, the computational bottleneck for large scale calculations is…

Computational Physics · Physics 2019-07-24 Weile Jia , Lin Lin

Convolution models with long filters have demonstrated state-of-the-art reasoning abilities in many long-sequence tasks but lag behind the most optimized Transformers in wall-clock time. A major bottleneck is the Fast Fourier Transform…

Machine Learning · Computer Science 2023-11-13 Daniel Y. Fu , Hermann Kumbong , Eric Nguyen , Christopher Ré

We modified a MPI-friendly density functional theory (DFT) source code within hybrid parallelization including CUDA. Our objective is to find out how simple conversions within the hybrid parallelization with mid-range GPUs affect DFT code…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-23 Jae-Hyeon Parq , Erik Sevre , Sang-Mook Lee

Efficient large-scale inference of transformer-based large language models (LLMs) remains a fundamental systems challenge, frequently requiring multi-GPU parallelism to meet stringent latency and throughput targets. Conventional tensor…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-10 Chong Wang , Nan Du , Tom Gunter , Tao Lei , Kulin Seth , Senyu Tong , Jianyu Wang , Guoli Yin , Xiyou Zhou , Kelvin Zou , Ruoming Pang

Image Representation learning via input reconstruction is a common technique in machine learning for generating representations that can be effectively utilized by arbitrary downstream tasks. A well-established approach is using…

Neural and Evolutionary Computing · Computer Science 2025-06-10 Raoof HojatJalali , Edmondo Trentin

This paper presents PipeFusion, an innovative parallel methodology to tackle the high latency issues associated with generating high-resolution images using diffusion transformers (DiTs) models. PipeFusion partitions images into patches and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jiarui Fang , Jinzhe Pan , Aoyu Li , Xibo Sun , Jiannan Wang

A novel parallel hybrid quantum-classical algorithm for the solution of the quantum-chemical ground-state energy problem on gate-based quantum computers is presented. This approach is based on the reduced density-matrix functional theory…

The non-equidistant fast Fourier transform (NFFT) is an extension of the famous fast Fourier transform (FFT), which can be applied to non-equidistantly sampled data in time/space or frequency domain. It is an approximative algorithm that…

Mathematical Software · Computer Science 2023-01-31 Tobias Knopp , Marija Boberg , Mirco Grosser

Deep learning has delivered its powerfulness in many application domains, especially in image and speech recognition. As the backbone of deep learning, deep neural networks (DNNs) consist of multiple layers of various types with hundreds to…

Machine Learning · Computer Science 2017-12-14 Sheng Lin , Ning Liu , Mahdi Nazemi , Hongjia Li , Caiwen Ding , Yanzhi Wang , Massoud Pedram

Fast Fourier Transform (FFT) is one of the most important tools in digital signal processing. FFT costs O(N \log N) for transforming a signal of length N. Recently, Sparse Fourier Transform (SFT) has emerged as a critical issue addressing…

Data Structures and Algorithms · Computer Science 2015-05-25 Sung-Hsien Hsieh , Chun-Shien Lu , Soo-Chang Pei

Approximate methods have been considered as a means to the evaluation of discrete transforms. In this work, we propose and analyze a class of integer transforms for the discrete Fourier, Hartley, and cosine transforms (DFT, DHT, and DCT),…

Signal Processing · Electrical Eng. & Systems 2020-07-07 R. J. Cintra

In this paper, a new fast and low complexity transform is introduced for orthogonal frequency division multiplexing (OFDM) wireless systems. The new transform combines the effects of fast complex-Walsh-Hadamard transform (CHT) and the fast…

Signal Processing · Electrical Eng. & Systems 2023-10-30 Said Boussakta , Mounir T. Hamood , Mohammed Sh. Ahmed

In this paper, an optimized efficient VLSI architecture of a pipeline Fast Fourier transform (FFT) processor capable of producing the reverse output order sequence is presented. Paper presents Radix-2 multipath delay architecture for FFT…

Hardware Architecture · Computer Science 2017-07-07 Tanaji U. Kamble , B. G. Patil , Rakhee S. Bhojakar

The evaluation of Fock exchange is often the computationally most expensive part of hybrid functional density functional theory calculations in a systematically improvable, complete basis. In this work, we employ a Tucker tensor based…

Materials Science · Physics 2024-01-10 Vishal Subramanian , Sambit Das , Vikram Gavini

We develop a multi-dimensional, parallelized domain decomposition strategy (DDC) for mass-transfer particle tracking (MTPT) methods. These methods are a type of Lagrangian algorithm for simulating reactive transport and are able to be…

Particle Mesh Ewald (PME) methods accelerated through Fast Fourier Transforms (FFTs) for their reciprocal part are widely used to solve N -body problems over periodic structures with Laplace-like kernels. The FFT dependence of classical PME…

Numerical Analysis · Mathematics 2026-01-28 Igor Chollet