English
Related papers

Related papers: The AetherFloat Family: Block-Scale-Free Quad-Radi…

200 papers

Advanced Encryption Standard (AES) implementations on Field Programmable Gate Arrays (FPGA) commonly focus on maximizing throughput at the cost of utilizing high volumes of FPGA slice logic. High resource usage limits systems' abilities to…

Cryptography and Security · Computer Science 2019-11-12 Jacob T. Grycel , Robert J. Walls

Atomic operations (atomics) such as Compare-and-Swap (CAS) or Fetch-and-Add (FAA) are ubiquitous in parallel programming. Yet, performance tradeoffs between these operations and various characteristics of such systems, such as the structure…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-21 Hermann Schweizer , Maciej Besta , Torsten Hoefler

Classical Amdahl's Law conceptualized the limit of speedup for an era of fixed serial-parallel decomposition and homogeneous replication. Modern heterogeneous systems need a different conceptual framework: constrained resources must be…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-09 Chien-Ping Lu

Current quantum computers require algorithms that use limited resources economically. In quantum machine learning, success hinges on quantum feature maps, which embed classical data into the state space of qubits. We introduce Quantum…

Quantum Physics · Physics 2025-10-07 Jonas Jäger , Philipp Elsässer , Elham Torabian

Power consumption has become the major concern in neural network accelerators for edge devices. The novel non-volatile-memory (NVM) based computing-in-memory (CIM) architecture has shown great potential for better energy efficiency.…

Systems and Control · Electrical Eng. & Systems 2024-02-22 Haobo Liu , Zhengyang Qian , Wei Wu , Hongwei Ren , Zhiwei Liu , Leibin Ni

Low-precision formats have recently driven major breakthroughs in neural network (NN) training and inference by reducing the memory footprint of the NN models and improving the energy efficiency of the underlying hardware architectures.…

Hardware Architecture · Computer Science 2024-10-28 Luca Bertaccini , Gianna Paulin , Tim Fischer , Stefan Mach , Luca Benini

We present the first end-to-end deployment of the Gemma3 family of large language and vision models on a tiled edge dataflow architecture (AMD Ryzen AI NPU). Our work introduces a set of hardware-aware techniques. For prefill, we introduce…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-25 Shouyu Du , Miaoxiang Yu , Zhenyu Xu , Zhiheng Ni , Jillian Cai , Qing Yang , Tao Wei

Large Language Models (LLMs) are fundamentally constrained by the quadratic computational cost of self-attention and the "Lost in the Middle" phenomenon, where reasoning capabilities degrade as context windows expand. Existing solutions,…

Artificial Intelligence · Computer Science 2026-02-18 Mustafa Arslan

Floating point arithmetic is costly on FPGA platforms due to wide datapaths, normalization, and carry propagation, motivating alternative numerical representations that improve throughput and efficiency. This paper presents the Hybrid…

Hardware Architecture · Computer Science 2026-03-11 Mostafa Darvishi

8-bit integer inference, as a promising direction in reducing both the latency and storage of deep neural networks, has made great progress recently. On the other hand, previous systems still rely on 32-bit floating point for certain…

Computation and Language · Computer Science 2020-09-21 Ye Lin , Yanyang Li , Tengbo Liu , Tong Xiao , Tongran Liu , Jingbo Zhu

Fast Fourier transform (FFT) of large number of samples requires huge hardware resources of field programmable gate arrays (FPGA), which needs more area and power. In this paper, we present an area efficient architecture of FFT processor…

Hardware Architecture · Computer Science 2015-02-26 Atin Mukherjee , Amitabha Sinha , Debesh Choudhury

In recent years fused-multiply-add (FMA) units with lower-precision multiplications and higher-precision accumulation have proven useful in machine learning/artificial intelligence applications, most notably in training deep neural networks…

Mathematical Software · Computer Science 2019-04-16 Greg Henry , Ping Tak Peter Tang , Alexander Heinecke

Dynamical quantum error-correcting codes (QECC) offer wider possibilities in how one can protect logical quantum information from noise and perform fault-tolerant quantum computation compared to static QECCs. A family of dynamical QECCs…

Quantum Physics · Physics 2025-01-10 Andrew Tanggara , Mile Gu , Kishor Bharti

The precise analysis and accurate measurement of harmonic provides a reliable scientific industrial application. However, the high-performance DSP processor is the important method of electrical harmonic analysis. Hence, in this research…

Signal Processing · Electrical Eng. & Systems 2018-06-13 Rozita Teymourzadeh , Memtode Jim , Mok Vee hong

Efficient AI inference on AMD's Versal AI Engine (AIE) is challenging due to tightly coupled VLIW execution, explicit datapaths, and local memory management. Prior work focused on first-generation AIE kernel optimizations, without tackling…

We demonstrate, for the first time, fully quantized training (FQT) of large language models (LLMs) using predominantly 4-bit floating-point (FP4) precision for weights, activations, and gradients on datasets up to 200 billion tokens. We…

Machine Learning · Computer Science 2025-08-12 Brian Chmiel , Maxim Fishman , Ron Banner , Daniel Soudry

Floating point arithmetic remains expensive on FPGA platforms due to wide datapaths and normalization logic, motivating alternative representations that preserve dynamic range at lower cost. This work introduces the Hybrid Residue Floating…

Signal Processing · Electrical Eng. & Systems 2025-12-11 Mostafa Darvishi

Dynamic and polymorphic languages attach information, such as types, to run time objects, and therefore adapt the memory layout of values to include space for this information. This makes it difficult to efficiently implement IEEE754…

Programming Languages · Computer Science 2025-10-13 Olivier Melançon , Manuel Serrano , Marc Feeley

When quantizing weights and activations to increasingly narrower representations, the cost of additions begins to dominate that of multiplications in multiply-accumulate (MAC) units. Recent studies show that reducing addition costs via…

Machine Learning · Computer Science 2025-08-01 Ian Colbert , Giuseppe Franco , Fabian Grob , Jinjie Zhang , Rayan Saab

Logical qubits can be protected from decoherence by performing QEC cycles repeatedly. Algorithms for fault-tolerant QEC must be compiled to the specific hardware platform under consideration in order to practically realize a quantum memory…

Quantum Physics · Physics 2025-05-13 Sascha Heußen , David F. Locher , Markus Müller