English
Related papers

Related papers: Design and accuracy trade-offs in Computational St…

200 papers

Floating-point operations can significantly impact the accuracy and performance of scientific applications on large-scale parallel systems. Recently, an emerging floating-point format called Posit has attracted attention as an alternative…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-26 Steven W. D. Chien , Ivy B. Peng , Stefano Markidis

In this paper, we revisit \textsf{ROOT-SGD}, an innovative method for stochastic optimization to bridge the gap between stochastic optimization and statistical efficiency. The proposed method enhances the performance and reliability of…

Machine Learning · Statistics 2024-08-26 Chris Junchi Li

Stochastic computing is a paradigm in which logical operations are performed on randomly generated bit streams. Complex arithmetic operations can be executed by simple logic circuits, resulting in a much smaller area footprint compared to…

Emerging Technologies · Computer Science 2023-07-10 Yadu Kiran , Marc Riedel

Stochastic computing (SC) allows reducing hardware complexity and improving energy efficiency of error resilient applications. However, a main limitation of the computing paradigm is the low throughput induced by the intrinsic serial…

Optics · Physics 2019-03-28 Hassnaa El-Derhalli , Sébastien Le Beux , Sofiene Tahar

The Fast Fourier Transform (FFT) is one of the most widely used algorithms in high performance computing, with critical applications in spectral analysis for both signal processing and the numerical solution of partial differential…

Numerical Analysis · Mathematics 2025-05-01 Laslo Hunhold , John Gustafson

In modern low-power embedded platforms, floating-point (FP) operations emerge as a major contributor to the energy consumption of compute-intensive applications with large dynamic range. Experimental evidence shows that 50% of the energy…

Hardware Architecture · Computer Science 2017-11-29 Giuseppe Tagliavini , Stefan Mach , Davide Rossi , Andrea Marongiu , Luca Benini

The stochastic simulation algorithm (SSA) is widely used to perform exact forward simulation of discrete stochastic processes in biology. However, the computational cost, driven by sequential event-by-event sampling across large ensembles,…

Quantitative Methods · Quantitative Biology 2026-05-04 Tom Kimpson , Mark B. Flegg , Jennifer A. Flegg

While advancements in quantization have significantly reduced the computational costs of inference in deep learning, training still predominantly relies on complex floating-point arithmetic. Low-precision fixed-point training presents a…

Machine Learning · Computer Science 2025-10-21 Hassan Hamad , Yuou Qiu , Peter A. Beerel , Keith M. Chugg

Efficient number representation is essential for federated learning, natural language processing, and network measurement solutions. Due to timing, area, and power constraints, such applications use narrow bit-width (e.g., 8-bit) number…

Networking and Internet Architecture · Computer Science 2024-10-08 Itamar Cohen , Gil Einziger

With their widespread availability, FPGA-based accelerators cards have become an alternative to GPUs and CPUs to accelerate computing in applications with certain requirements (like energy efficiency) or properties (like fixed-point…

Hardware Architecture · Computer Science 2022-10-20 Tom Vander Aa , Tom Haber , Thomas J. Ashby , Roel Wuyts , Wilfried Verachtert

The takum machine number format has been recently proposed as an enhancement over the posit number format, which is considered a promising alternative to the IEEE 754 floating-point standard. Takums retain the useful posit properties, but…

Hardware Architecture · Computer Science 2025-11-27 Laslo Hunhold

In this work, we provide energy-efficient architectural support for floating point accuracy. Our goal is to provide accuracy that is far greater than that provided by the processor's hardware floating point unit (FPU). Specifically, for…

Hardware Architecture · Computer Science 2013-09-30 Ralph Nathan , Bryan Anthonio , Shih-Lien Lu , Helia Naeimi , Daniel J. Sorin , Xiaobai Sun

While posit format offers superior dynamic range and accuracy for transprecision computing, its adoption in RISC-V processors is hindered by the lack of a unified solution for lightweight, precision-scalable, and IEEE-754 arithmetic…

Hardware Architecture · Computer Science 2025-05-27 Qiong Li , Chao Fang , Longwei Huang , Jun Lin , Zhongfeng Wang

As computer simulations continue to grow in size and complexity, they present a particularly challenging class of big data problems. Many application areas are moving toward exascale computing systems, systems that perform $10^{18}$ FLOPS…

Debugging accumulation of floating-point errors is hard; ideally, computer should track it automatically. Here we consider twofold approximation of an exact real with value + error pair of floating-point numbers. Normally, value + error sum…

Numerical Analysis · Computer Science 2014-01-06 Evgeny Latkin

This paper discusses a simple and effective method for the summation of long sequences of floating point numbers. The method comprises two phases: an accumulation phase where the mantissas of the floating point numbers are added to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Vincenzo Liguori

For scientific computations on a digital computer the set of real number is usually approximated by a finite set F of "floating-point" numbers. We compare the numerical accuracy possible with difference choices of F having approximately the…

Numerical Analysis · Computer Science 2010-04-21 Richard P. Brent

This paper presents and demonstrates a stochastic logic time delay reservoir design in FPGA hardware. The reservoir network approach is analyzed using a number of metrics, such as kernel quality, generalization rank, performance on simple…

Neural and Evolutionary Computing · Computer Science 2018-09-17 Lisa Loomis , Nathan McDonald , Cory Merkel

Increasingly FPGAs will be deployed at scale due to the need for increased need for power efficient computation and improved high level synthesis tool flows, creating a new category of device: data centre FPGAs. A method for using these…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-07-19 Gordon Inggs

The increasing computational demands of foundation models have spurred research into low-precision training, with 4-bit floating-point (\texttt{FP4}) formats emerging as a frontier for maximizing hardware throughput. While numerous…

Machine Learning · Computer Science 2025-09-23 Robert Hu , Carlo Luschi , Paul Balanca