English
Related papers

Related papers: HadaCore: Tensor Core Accelerated Hadamard Transfo…

200 papers

We present novel algorithmic solutions together with implementation details utilizing non-Abelian symmetries in order to boost the current limits of tensor network state algorithms on high performance computing infrastructure. In our…

Computational Physics · Physics 2023-10-02 Andor Menczer , Örs Legeza

We present and implement the concept of the Fourier-domain dedispersion (FDD) algorithm, a brute-force incoherent dedispersion algorithm. This algorithm corrects the frequency-dependent dispersion delays in the arrival time of radio…

Instrumentation and Methods for Astrophysics · Physics 2022-01-05 C. G. Bassa , J. W. Romein , B. Veenboer , S. van der Vlugt , S. J. Wijnholds

Traditional heterogeneous parallel algorithms, designed for heterogeneous clusters of workstations, are based on the assumption that the absolute speed of the processors does not depend on the size of the computational task. This assumption…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-09-15 Alexey Lastovetsky , Ravi Reddy , Vladimir Rychkov , David Clarke

This paper presents a complete video fusion system with hardware acceleration and investigates the energy trade-offs between computing in the CPU or the FPGA device. The video fusion application is based on the Dual-Tree Complex Wavelet…

Hardware Architecture · Computer Science 2016-02-09 Jose Nunez-Yanez , Tom Sun

Tensor computations overwhelm traditional general-purpose computing devices due to the large amounts of data and operations of the computations. They call for a holistic solution composed of both hardware acceleration and software mapping.…

Hardware Architecture · Computer Science 2021-05-05 Qingcheng Xiao , Size Zheng , Bingzhe Wu , Pengcheng Xu , Xuehai Qian , Yun Liang

The discrete cosine transform (DCT) is the key step in many image and video coding standards. The 8-point DCT is an important special case, possessing several low-complexity approximations widely investigated. However, 16-point DCT…

Multimedia · Computer Science 2017-02-08 F. M. Bayer , R. J. Cintra , A. Edirisuriya , A. Madanayake

Sparse tensor algebra computations have become important in many real-world applications like machine learning, scientific simulations, and data mining. Hence, automated code generation and performance optimizations for tensor algebra…

Programming Languages · Computer Science 2022-05-25 Adhitha Dias , Kirshanthan Sundararajah , Charitha Saumya , Milind Kulkarni

Sparse Matricized Tensor Times Khatri-Rao Product (spMTTKRP) is the most time-consuming compute kernel in sparse tensor decomposition. In this paper, we introduce a novel algorithm to minimize the execution time of spMTTKRP across all modes…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-17 Sasindu Wijeratne , Rajgopal Kannan , Viktor Prasanna

The integration of dynamic, sparse structures like Mixture-of-Experts (MoE) with parameter-efficient adapters (e.g., LoRA) is a powerful technique for enhancing Large Language Models (LLMs). However, this architectural enhancement comes at…

Artificial Intelligence · Computer Science 2026-03-13 Qiyang Li , Rui Kong , Yuchen Li , Hengyi Cai , Shuaiqiang Wang , Linghe Kong , Guihai Chen , Dawei Yin

AI models are increasing in size and recent advancement in the community has shown that unlike HPC applications where double precision datatype are required, lower-precision datatypes such as fp8 or int4 are sufficient to bring the same…

Performance · Computer Science 2023-10-11 Saeed Maleki

This study investigates the integration of signal processing transformations -- Fast Fourier Transform (FFT), Walsh-Hadamard Transform (WHT), and Discrete Cosine Transform (DCT) -- within the ResNet50 convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Berk Yilmaz , Daniel Fidel Harvey , Prajit Dhuri

Recent hardware acceleration advances have enabled powerful specialized accelerators for finite element computations, spiking neural network inference, and sparse tensor operations. However, existing approaches face fundamental limitations:…

Hardware Architecture · Computer Science 2026-01-09 Chuanzhen Wang , Leo Zhang , Eric Liu

This paper is concerned with improving the empirical convergence speed of block-coordinate descent algorithms for approximate nonnegative tensor factorization (NTF). We propose an extrapolation strategy in-between block updates, referred to…

Numerical Analysis · Mathematics 2021-05-12 Andersen Man Shun Ang , Jeremy E. Cohen , Nicolas Gillis , Le Thi Khanh Hien

Predicting effective thermal conductivity by solving a Partial Differential Equation (PDE) defined on a high-resolution Representative Volume Element (RVE) is a computationally intensive task. In this paper, we tackle the task by proposing…

Numerical Analysis · Mathematics 2024-04-04 Changqing Ye , Shubin Fu , Eric T. Chung

In this work, we consider the reformulation of hierarchical ($\mathcal{H}$) matrix algorithms for many-core processors with a model implementation on graphics processing units (GPUs). $\mathcal{H}$ matrices approximate specific dense…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-04 Peter Zaspel

Sparse Matrix-Matrix Multiplication (SpMM) is a fundamental operation in graph computing and analytics. However, the irregularity of real-world graphs poses significant challenges to achieving efficient SpMM operation for graph data on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-13 Zhonggen Li , Xiangyu Ke , Yifan Zhu , Yunjun Gao , Yaofeng Tu

Various hardware accelerators have been developed for energy-efficient and real-time inference of neural networks on edge devices. However, most training is done on high-performance GPUs or servers, and the huge memory and computing costs…

Hardware Architecture · Computer Science 2021-04-21 Kaiqi Zhang , Cole Hawkins , Xiyuan Zhang , Cong Hao , Zheng Zhang

Hardware-based acceleration is an extensive attempt to facilitate many computationally-intensive mathematics operations. This paper proposes an FPGA-based architecture to accelerate the convolution operation - a complex and expensive…

Hardware Architecture · Computer Science 2023-02-28 Trung Dinh Pham , Bao Gia Bach , Lam Trinh Luu , Minh Dinh Nguyen , Hai Duc Pham , Khoa Bui Anh , Xuan Quang Nguyen , Cuong Pham Quoc

This paper develops a numerical procedure to accelerate the convergence of the Favre-averaged Non-Linear Harmonic (FNLH) method. The scheme provides a unified mathematical framework for solving the sparse linear systems formed by the mean…

Numerical Analysis · Mathematics 2024-07-26 Feng Wang , Kurt Webber , David Radford , Luca di Mare , Marcus Meyer

In our former works we have made serious efforts to improve the performance of medical image analysis methods with using ensemble-based systems. In this paper, we present a novel hardware-based solution for the efficient adoption of our…

Image and Video Processing · Electrical Eng. & Systems 2018-06-19 Laszlo Kovacs , Roland Kovacs , Andras Hajdu