English
Related papers

Related papers: Representing numeric data in 32 bits while preserv…

200 papers

We propose a scheme for reduced-precision representation of floating point data on a continuum between IEEE-754 floating point types. Our scheme enables the use of lower precision formats for a reduction in storage space requirements and…

Mathematical Software · Computer Science 2017-01-31 Andrew Anderson , David Gregg

Many modern search domains comprise high-dimensional vectors of floating point numbers derived from neural networks, in the form of embeddings. Typical embeddings range in size from hundreds to thousands of dimensions, making the size of…

Machine Learning · Computer Science 2025-06-03 Richard Connor , Alan Dearle , Ben Claydon

We provide tools to help automate the error analysis of algorithms that evaluate simple functions over the floating-point numbers. The aim is to obtain tight relative error bounds for these algorithms, expressed as a function of the unit…

Numerical Analysis · Mathematics 2024-05-07 Jean-Michel Muller , Bruno Salvy

Data compression algorithms typically rely on identifying repeated sequences of symbols from the original data to provide a compact representation of the same information, while maintaining the ability to recover the original data from the…

Databases · Computer Science 2023-08-08 Francesco Taurone , Daniel E. Lucani , Marcell Fehér , Qi Zhang

Neural machine translation has achieved levels of fluency and adequacy that would have been surprising a short time ago. Output quality is extremely relevant for industry purposes, however it is equally important to produce results in the…

Computation and Language · Computer Science 2018-04-16 Jerry Quinn , Miguel Ballesteros

Diffusion models are emerging models that generate images by iteratively denoising random Gaussian noise using deep neural networks. These models typically exhibit high computational and memory demands, necessitating effective post-training…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Cheng Chen , Christina Giannoula , Andreas Moshovos

Ootomo, Ozaki, and Yokota [Int. J. High Perform. Comput. Appl., 38 (2024), p. 297-313] have proposed a strategy to recast a floating-point matrix multiplication in terms of integer matrix products. The factors A and B are split into integer…

Numerical Analysis · Mathematics 2026-05-11 Ahmad Abdelfattah , Jack Dongarra , Massimiliano Fasi , Mantas Mikaitis , Françoise Tisseur

Modern programmable digital signal processing relies on floating-point numbers for their ease of use. Fixed-point number formats have the potential to save resources and improve execution time, but realising this potential burdens the…

Programming Languages · Computer Science 2024-03-12 Agathe Herrou , Florent de Dinechin , Stéphane Letz , Yann Orlarey , Anastasia Volkova

Computer representations of real numbers are necessarily discrete, with some finite resolution, discreteness, quantization, or minimum representable difference. We perform astrometric and photometric measurements on stars and co-add…

Instrumentation and Methods for Astrophysics · Physics 2014-11-20 Adrian M. Price-Whelan , David W. Hogg

Finite precision computations using digital computers involve the following inherent errors: (1) Round-off error of finite precision computations (2) Binary computer arithmetic precludes exact number representation of traditional decimal…

Computational Physics · Physics 2007-05-23 Suvarna Fadnavis

A solution for Smale's 17th problem, for the case of systems with bounded degree was recently given. This solution, an algorithm computing approximate zeros of complex polynomial systems in average polynomial time, assumed infinite…

Numerical Analysis · Mathematics 2012-05-07 Irenee Briquel , Felipe Cucker , Javier Pena , Vera Roshchina

In the early days of computing, severe memory constraints made it necessary to use lower floating-point precision. As hardware capabilities have advanced, modern systems, particularly in computational statistics and scientific computing,…

Computation · Statistics 2026-03-03 Mary Lai O. Salvana , Sameh Abdulah , Minwoo Kim , David Helmy , Ying Sun , Marc G. Genton

Our goal is to find accurate and efficient algorithms, when they exist, for evaluating rational expressions containing floating point numbers, and for computing matrix factorizations (like LU and the SVD) of matrices with rational…

Numerical Analysis · Mathematics 2025-10-20 James Demmel

We present DeepPrint, a deep network, which learns to extract fixed-length fingerprint representations of only 200 bytes. DeepPrint incorporates fingerprint domain knowledge, including alignment and minutiae detection, into the deep network…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Joshua J. Engelsma , Kai Cao , Anil K. Jain

This research investigates using a mixed-precision iterative refinement method using posit numbers instead of the standard IEEE floating-point format. The method is applied to solve a general linear system represented by the equation $Ax =…

Numerical Analysis · Mathematics 2024-08-28 James Quinlan , E. Theodore L. Omtzigt

Autonomous robots require efficient on-device learning to adapt to new environments without cloud dependency. For this edge training, Microscaling (MX) data types offer a promising solution by combining integer and floating-point…

Hardware Architecture · Computer Science 2025-12-16 Stef Cuyckens , Xiaoling Yi , Nitish Satya Murthy , Chao Fang , Marian Verhelst

Simple floating point operations like addition or multiplication on normalized floating point values can be computed by current AMD and Intel processors in three to five cycles. This is different for denormalized numbers, which appear when…

Performance · Computer Science 2015-06-15 Markus Wittmann , Thomas Zeiser , Georg Hager , Gerhard Wellein

We investigate the use of half-precision floating-point numbers (FP16) in mixed-precision linear solvers for lattice QCD simulations. Since the emergence of GPUs for general-purpose, mixed-precision algorithms that combine single-precision…

High Energy Physics - Lattice · Physics 2026-02-17 Issaku Kanamori , Hideo Matsufuru , Tatsumi Aoyama , Kazuyuki Kanaya , Yusuke Namekawa , Hidekatsu Nemura , Keigo Nitadori

FFT algorithm is one of the most applied algorithmsin digital signal processing. Digital signal processing hasgradually become important in biomedical application. Herehardware implementation of FFTs have found useful appli-cations for…

Neurons and Cognition · Quantitative Biology 2022-03-09 Bhaskar Sen

Storage systems have a strong need for substantially improving their error correction capabilities, especially for long-term storage where the accumulating errors can exceed the decoding threshold of error-correcting codes (ECCs). In this…

Information Theory · Computer Science 2018-11-12 Pulakesh Upadhyaya , Anxiao , Jiang
‹ Prev 1 3 4 5 6 7 10 Next ›