English
Related papers

Related papers: Double-Precision Matrix Multiplication Emulation v…

200 papers

DNNs are widely used but face significant computational costs due to matrix multiplications, especially from data movement between the memory and processing units. One promising approach is therefore Processing-in-Memory as it greatly…

Hardware Architecture · Computer Science 2024-01-19 Lorenzo Sonnino , Shaswot Shresthamali , Yuan He , Masaaki Kondo

We present the first end-to-end deployment of the Gemma3 family of large language and vision models on a tiled edge dataflow architecture (AMD Ryzen AI NPU). Our work introduces a set of hardware-aware techniques. For prefill, we introduce…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-25 Shouyu Du , Miaoxiang Yu , Zhenyu Xu , Zhiheng Ni , Jillian Cai , Qing Yang , Tao Wei

In this paper, we introduce the Phantom Domain Finite Element Method (PDFEM), a novel computational approach tailored for the efficient analysis of heterogeneous and composite materials. Inspired by fictitious domain methods, this method…

Numerical Analysis · Mathematics 2025-05-06 Tianlong He , Philippe Karamian-Surville , Daniel Choï

Single-precision floating point (FP32) data format, defined by the IEEE 754 standard, is widely employed in scientific computing, signal processing, and deep learning training, where precision is critical. However, FP32 multiplication is…

Hardware Architecture · Computer Science 2025-10-09 Bindu G Gowda , Yogesh Goyal , Yash Gupta , Madhav Rao

Deep neural network (DNN) inference using reduced integer precision has been shown to achieve significant improvements in memory utilization and compute throughput with little or no accuracy loss compared to full-precision floating-point.…

Hardware Architecture · Computer Science 2023-04-11 Yuzong Chen , Mohamed S. Abdelfattah

The optimization of the matrix multiplication (or GEMM) has been a need during the last decades. This operation is considered the flagship of current linear algebra libraries such as BLIS, OpenBLAS, or Intel OneAPI because of its widespread…

Mathematical Software · Computer Science 2023-10-30 Adrián Castelló , Julian Bellavita , Grace Dinh , Yuka Ikarashi , Héctor Martínez

We consider the least-squares approximation of a matrix C in the set of doubly stochastic matrices with the same sparsity pattern as C. Our approach is based on applying the well-known Alternating Direction Method of Multipliers (ADMM) to a…

Optimization and Control · Mathematics 2019-10-14 Nikitas Rontsis , Paul J. Goulart

Current wireless communication technologies are insufficient in the face of ever-increasing demands. Therefore, novel and high-performance communication systems are needed. In this paper, a novel high data rate and high-performance index…

Signal Processing · Electrical Eng. & Systems 2024-11-13 Burak Ahmet Ozden , Erdogan Aydin , Fatih Cogen

This paper presents a novel end-to-end methodology for enabling the deployment of low-error deep networks on microcontrollers. To fit the memory and computational limitations of resource-constrained edge-devices, we exploit mixed…

Machine Learning · Computer Science 2019-05-31 Manuele Rusci , Alessandro Capotondi , Luca Benini

Deep Gaussian processes (DGPs) provide a rich class of models that can better represent functions with varying regimes or sharp changes, compared to conventional GPs. In this work, we propose a novel inference method for DGPs for computer…

Machine Learning · Statistics 2022-08-18 Deyu Ming , Daniel Williamson , Serge Guillas

Deep Learning (DL) has developed to become a corner-stone in many everyday applications that we are now relying on. However, making sure that the DL model uses the underlying hardware efficiently takes a lot of effort. Knowledge about…

Performance · Computer Science 2023-03-22 Karthick Panner Selvam , Mats Brorsson

We propose a novel two-stage framework of generative models named Debiasing Kernel-Based Generative Models (DKGM) with the insights from kernel density estimation (KDE) and stochastic approximation. In the first stage of DKGM, we employ KDE…

Machine Learning · Statistics 2025-03-31 Tian Qin , Wei-Min Huang

An exact arithmetic, memory efficient direct solution method for finite element method (FEM) computations is outlined. Unlike conventional black-box or low-rank direct solvers that are opaque to the underlying physical problem, the proposed…

Computational Engineering, Finance, and Science · Computer Science 2020-02-13 Javad Moshfegh , Marinos N. Vouvakis

In this work, two machine learning (ML)-based structures for joint detection-channel estimation in OFDM systems are proposed and extensively characterized. Both ML architectures, namely Deep Neural Network (DNN) and Extreme Learning Machine…

Information Theory · Computer Science 2023-04-25 Wilson de Souza Junior , Taufik Abrao

Neural network quantization is a promising compression technique to reduce memory footprint and save energy consumption, potentially leading to real-time inference. However, there is a performance gap between quantized and full-precision…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Qing Jin , Jian Ren , Richard Zhuang , Sumant Hanumante , Zhengang Li , Zhiyu Chen , Yanzhi Wang , Kaiyuan Yang , Sergey Tulyakov

As Large Language Models (LLMs) scale, weight-only quantization (W4A16: 4-bit weights, 16-bit activations) becomes critical for reducing memory footprint with minimal accuracy loss. However, its efficient deployment on Huawei's Ascend 910…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-04 Yuanhong He , Peiyu Niu , Jun Chen , Chenchen Zhang , Chao Yang

The substantial memory bandwidth and computational demands of large language models (LLMs) present critical challenges for efficient inference. To tackle this, the literature has explored heterogeneous systems that combine neural processing…

Hardware Architecture · Computer Science 2026-05-05 Yuzong Chen , Chao Fang , Xilai Dai , Yuheng Wu , Thierry Tambe , Marian Verhelst , Mohamed S. Abdelfattah

Quantum emulators play an important role in the development and testing of quantum algorithms, especially given the limitations of the current FTQC era. Developing high-speed, memory-optimized quantum emulators is a growing research trend,…

Hardware Architecture · Computer Science 2024-10-16 Tran Xuan Hieu Le , Hoai Luan Pham , Tuan Hai Vu , Vu Trung Duong Le , Nakashima Yasuhiko

Largely due to their increased native capacity for numerical intensity and power efficiency, reduced-precision floating-point computing resources, primarily used in artificial intelligence (AI) applications, have expanded at a greater rate…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Harun Bayraktar , Cole Brower , John Gunnels , Greg Henry , Cherin Joseph , Jack Kosaian , Dmitry Lyakh , Lukas Mosimann , Victor Podlozhnyuk , Addison Richards , Paul Springer , Haicheng Wu

Autograd-based software packages have recently renewed interest in image registration using homography and other geometric models by gradient descent and optimization, e.g., AirLab and DRMIME. In this work, we emphasize on using complex…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Abhishek Nan , Matthew Tennant , Uriel Rubin , Nilanjan Ray