English
Related papers

Related papers: Closing the Gap Between Float and Posit Hardware E…

200 papers

The recent advances in machine learning, in general, and Artificial Neural Networks (ANN), in particular, has made smart embedded systems an attractive option for a larger number of application areas. However, the high computational…

Hardware Architecture · Computer Science 2023-09-06 Suresh Nambi , Salim Ullah , Aditya Lohana , Siva Satyendra Sahoo , Farhad Merchant , Akash Kumar

The Fast Fourier Transform (FFT) is one of the most widely used algorithms in high performance computing, with critical applications in spectral analysis for both signal processing and the numerical solution of partial differential…

Numerical Analysis · Mathematics 2025-05-01 Laslo Hunhold , John Gustafson

The takum machine number format has been recently proposed as an enhancement over the posit number format, which is considered a promising alternative to the IEEE 754 floating-point standard. Takums retain the useful posit properties, but…

Hardware Architecture · Computer Science 2025-11-27 Laslo Hunhold

Performing the inference step of deep learning in resource constrained environments, such as embedded devices, is challenging. Success requires optimization at both software and hardware levels. Low precision arithmetic and specifically low…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Seyed H. F. Langroudi , Tej Pandit , Dhireesha Kudithipudi

Although not primarily designed for this purpose, floating-point numbers are often used to represent integral values, with some applications explicitly relying on this capability. However, the integral representation properties of IEEE 754…

Hardware Architecture · Computer Science 2025-12-01 Laslo Hunhold

In this work, we provide energy-efficient architectural support for floating point accuracy. Our goal is to provide accuracy that is far greater than that provided by the processor's hardware floating point unit (FPU). Specifically, for…

Hardware Architecture · Computer Science 2013-09-30 Ralph Nathan , Bryan Anthonio , Shih-Lien Lu , Helia Naeimi , Daniel J. Sorin , Xiaobai Sun

On modern architectures, the performance of 32-bit operations is often at least twice as fast as the performance of 64-bit operations. By using a combination of 32-bit and 64-bit floating point arithmetic, the performance of many dense and…

Mathematical Software · Computer Science 2015-05-13 Marc Baboulin , Alfredo Buttari , Jack Dongarra , Jakub Kurzak , Julie Langou , Julien Langou , Piotr Luszczek , Stanimire Tomov

In a large class of deep learning models, including vector embedding models such as word and database embeddings, we observe that floating point exponent values cluster around a few unique values, permitting entropy based data compression.…

Machine Learning · Computer Science 2022-02-04 Rajesh Bordawekar , Bulent Abali , Ming-Hung Chen

Polar codes are capacity-achieving error-correcting codes with an explicit construction that can be decoded with low-complexity algorithms. In this work, we show how the state-of-the-art low-complexity decoding algorithm can be improved to…

Information Theory · Computer Science 2016-08-29 Pascal Giard , Alexios Balatsoukas-Stimming , Gabi Sarkis , Claude Thibeault , Warren J. Gross

Block Floating-Point (BFP) is emerging as an attractive data format for edge Neural Processing Units (NPUs), combining wide dynamic range with high hardware efficiency. However, its behavior under hardware faults and suitability for…

Hardware Architecture · Computer Science 2026-04-14 Jie Zhang , Jiapeng Guan , Hao Zhou , Xiaomeng Han , Tinglue Wang , Ran Wei , Zhe Jiang

In this paper, we propose a mixed-precision convolution unit architecture which supports different integer and floating point (FP) precisions. The proposed architecture is based on low-bit inner product units and realizes higher precision…

Hardware Architecture · Computer Science 2021-01-29 Hamzah Abdel-Aziz , Ali Shafiee , Jong Hoon Shin , Ardavan Pedram , Joseph H. Hassoun

Conventional hardware-friendly quantization methods, such as fixed-point or integer, tend to perform poorly at very low word sizes as their shrinking dynamic ranges cannot adequately capture the wide data distributions commonly seen in…

Machine Learning · Computer Science 2020-02-12 Thierry Tambe , En-Yu Yang , Zishen Wan , Yuntian Deng , Vijay Janapa Reddi , Alexander Rush , David Brooks , Gu-Yeon Wei

By exploiting the modular RISC-V ISA this paper presents the customization of instruction set with posit\textsuperscript{\texttrademark} arithmetic instructions to provide improved numerical accuracy, well-defined behavior and increased…

Hardware Architecture · Computer Science 2024-04-09 Federico Rossi , Francesco Urbani , Marco Cococcioni , Emanuele Ruffaldi , Sergio Saponara

As new technologies are invented, their commercial viability needs to be carefully examined along with their technical merits and demerits. The posit data format, proposed as a drop-in replacement for IEEE 754 float format, is one such…

Hardware Architecture · Computer Science 2021-01-19 Vinay Saxena , Ankitha Reddy , Jonathan Neudorfer , John Gustafson , Sangeeth Nambiar , Rainer Leupers , Farhad Merchant

Recent research has shown that large language models (LLMs) can utilize low-precision floating point (FP) quantization to deliver high efficiency while maintaining original model accuracy. In particular, recent works have shown the…

Hardware Architecture · Computer Science 2025-06-05 Faraz Tahmasebi , Yian Wang , Benji Y. H. Huang , Hyoukjun Kwon

Advancements in clinical Brain-Computer Interfaces (BCIs) depend on precise and reliable signal interpretation. However, the high-dimensional and noisy nature of data captured from both implanted and non-implanted BCIs poses significant…

Neurons and Cognition · Quantitative Biology 2026-05-20 Elena C Offenberg , Dirk Keller , Mariska J Vansteensel , Zachary V Freudenburg , Nick F Ramsey , Julia Berezutskaya

Floating-point computations are quickly finding their way in the design of safety- and mission-critical systems, despite the fact that designing floating-point algorithms is significantly more difficult than designing integer algorithms.…

Artificial Intelligence · Computer Science 2015-08-03 Roberto Bagnara , Matthieu Carlier , Roberta Gori , Arnaud Gotlieb

Polar codes have gained significant attention in channel coding for their ability to approach the capacity of binary input discrete memoryless channels (B-DMCs), thanks to their reliability and efficiency in transmission. However, existing…

Information Theory · Computer Science 2025-01-30 Jiaxing Li , Shuwen Zhang , Zhisong Bie

Floquet codes are an intriguing generalisation of stabiliser and subsystem codes, which can provide good fault-tolerant characteristics while benefiting from reduced connectivity requirements in hardware. A recent question of interest has…

Quantum Physics · Physics 2024-12-18 Campbell McLauchlan , György P. Gehér , Alexandra E. Moylett

With the rapid development of edge computing, artificial intelligence and other fields, the accuracy and efficiency of floating-point computing have become increasingly crucial. However, the traditional IEEE 754 floating-point system faces…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-04 Xinyu Wu , Yaobin Wang , Tianyi Zhao , Jiawei Qin , Zhu Liang , Jie Fu