English
Related papers

Related papers: High Accuracy Low Precision QR Factorization and L…

200 papers

This study presents a novel mixed-precision iterative refinement algorithm, GADI-IR, within the general alternating-direction implicit (GADI) framework, designed for efficiently solving large-scale sparse linear systems. By employing…

Numerical Analysis · Mathematics 2025-03-24 Jifeng Ge , Juan Zhang

A finite-difference Micromagnetic simulation code written in MATLAB is presented with Graphics Processing Unit (GPU) acceleration. The high performance of Graphics Processing Unit (GPU) is demonstrated compared to a typical Central…

Computational Engineering, Finance, and Science · Computer Science 2015-01-30 Ru Zhu

The recent hardware-accelerated microscaling 4-bit floating-point formats such as MXFP4 and NVFP4, supported on NVIDIA and AMD GPUs, promise to revolutionize large language model (LLM) inference. Yet, their practical benefits remain…

Hyperspectral super-resolution refers to the problem of fusing a hyperspectral image (HSI) and a multispectral image (MSI) to produce a super-resolution image (SRI) that has fine spatial and spectral resolution. State-of-the-art methods…

Signal Processing · Electrical Eng. & Systems 2018-12-05 Charilaos I. Kanatsoulis , Xiao Fu , Nicholas D. Sidiropoulos , Wing-Kin Ma

Mixed-precision computing has the potential to significantly reduce the cost of exascale computations, but determining when and how to implement it in programs can be challenging. In this article, we propose a methodology for enabling…

Mathematical Software · Computer Science 2025-07-02 Yanxiang Chen , Pablo de Oliveira Castro , Paolo Bientinesi , Niclas Jansson , Roman Iakymchuk

Multi-image super-resolution (MISR) usually outperforms single-image super-resolution (SISR) under a proper inter-image alignment by explicitly exploiting the inter-image correlation. However, the large computational demand encumbers the…

Image and Video Processing · Electrical Eng. & Systems 2021-10-07 Kaicong Sun , Trung-Hieu Tran , Jajnabalkya Guhathakurta , Sven Simon

We present a second-order recursive Fermi-operator expansion scheme using mixed precision floating point operations to perform electronic structure calculations using tensor core units. A performance of over 100 teraFLOPs is achieved for…

Recently, tensor algebra have witnessed significant applications across various domains. Each operator in tensor algebra features different computational workload and precision. However, current general accelerators, such as VPU, GPGPU, and…

Hardware Architecture · Computer Science 2024-05-06 Chenyang Ai , Lechuan Zhao , Zhijie Huang , Cangyuan Li , Xinan Wang , Ying Wang

In this paper, we introduce a quasi-Newton method optimized for efficiently solving quasi-linear elliptic equations and systems, with a specific focus on GPU-based computation. By approximating the Jacobian matrix with a combination of…

Numerical Analysis · Mathematics 2025-03-25 Wenrui Hao , Sun Lee , Xiangxiong Zhang

To achieve greater accuracy, hypergraph matching algorithms require exponential increases in computational resources. Recent kd-tree-based approximate nearest neighbor (ANN) methods, despite the sparsity of their compatibility tensor, still…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Qixuan Zheng , Ming Zhang , Hong Yan

Quantization significantly accelerates inference in large language models (LLMs) by replacing original high-precision matrices with low-precision counterparts. Recent advances in weight-activation quantization have primarily focused on…

Machine Learning · Computer Science 2026-03-31 Wenyuan Liu , Haoqian Meng , Yilun Luo , Yafei Zhao , Peng Zhang , Xindian Ma

In this paper, we propose TensorFHE, an FHE acceleration solution based on GPGPU for real applications on encrypted data. TensorFHE utilizes Tensor Core Units (TCUs) to boost the computation of Number Theoretic Transform (NTT), which is the…

Hardware Architecture · Computer Science 2023-01-02 Shengyu Fan , Zhiwei Wang , Weizhi Xu , Rui Hou , Dan Meng , Mingzhe Zhang

We describe GPU implementations of the matrix recommender algorithms CCD++ and ALS. We compare the processing time and predictive ability of the GPU implementations with existing multi-core versions of the same algorithms. Results on the…

Information Retrieval · Computer Science 2015-11-10 André Valente Rodrigues , Alípio Jorge , Inês Dutra

Tensor computations present significant performance challenges that impact a wide spectrum of applications ranging from machine learning, healthcare analytics, social network analysis, data mining to quantum chemistry and signal processing.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-06 Jiajia Li , Mahesh Lakshminarasimhan , Xiaolong Wu , Ang Li , Catherine Olschanowsky , Kevin Barker

[Abridged] We present the results of a highly parallel Kepler equation solver using the Graphics Processing Unit (GPU) on a commercial nVidia GeForce 280GTX and the "Compute Unified Device Architecture" programming environment. We apply…

Astrophysics · Physics 2008-12-17 Eric B. Ford

This work focuses on the numerical study of a recently published class of Runge-Kutta methods designed for mixed-precision arithmetic. We employ the methods in solving partial differential equations on modern hardware. In particular we…

Numerical Analysis · Mathematics 2024-12-24 Ivo Dravins , Marcel Koch , Victoria Griehl , Katharina Kormann

Over the most recent years, quantized graph neural network (QGNN) attracts lots of research and industry attention due to its high robustness and low computation and memory overhead. Unfortunately, the performance gains of QGNN have never…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-03 Yuke Wang , Boyuan Feng , Yufei Ding

We report FPGA implementation results of low precision CNN convolution layers optimized for sparse and constant parameters. We describe techniques that amortizes the cost of common factor multiplication and automatically leverage dense hand…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-16 Thiam Khean Hah , Yeong Tat Liew , Jason Ong

The performance of the Hybrid Monte Carlo algorithm is determined by the speed of sparse matrix-vector multiplication within the context of preconditioned conjugate gradient iteration. We study these operations as implemented for the…

Statistical Mechanics · Physics 2016-08-14 Kyle A. Wendt , Joaquín E. Drut , Timo A. Lähde

We introduce an algorithmic framework for performing QR factorization with column pivoting (QRCP) on general matrices. The framework enables the design of practical QRCP algorithms through user-controlled choices for the core subroutines.…

Mathematical Software · Computer Science 2025-07-02 Maksim Melnichenko , Riley Murray , William Killian , James Demmel , Michael W. Mahoney , Piotr Luszczek , Mark Gates