English
Related papers

Related papers: Complex Block Floating-Point Format with Box Encod…

200 papers

Large language models (LLMs), with their billions of parameters, pose substantial challenges for deployment on edge devices, straining both memory capacity and computational resources. Block Floating Point (BFP) quantisation reduces memory…

Hardware Architecture · Computer Science 2025-04-23 Xiaomeng Han , Yuan Cheng , Jing Wang , Junyang Lu , Hui Wang , X. x. Zhang , Ning Xu , Dawei Yang , Zhe Jiang

This letter introduces a novel channel coding design framework for short-length codewords that permits balancing the tradeoff between the bit error rate floor and waterfall region by modifying a single real-valued parameter. The proposed…

Information Theory · Computer Science 2016-11-17 Mikel Hernaez , Pedro M. crespo , Javier Del Ser

Finding optimal message quantization is a key requirement for low complexity belief propagation (BP) decoding. To this end, we propose a floating-point surrogate model that imitates quantization effects as additions of uniform noise, whose…

Information Theory · Computer Science 2022-08-11 Marvin Geiselhart , Ahmed Elkelesh , Jannis Clausius , Fei Liang , Wen Xu , Jing Liang , Stephan ten Brink

High-throughput QR decomposition is a key operation in many advanced signal processing and communication applications. For some of these applications, using floating-point computation is becoming almost compulsory. However, there are scarce…

Hardware Architecture · Computer Science 2020-10-26 Javier Hormigo , Sergio D. Muñoz

We propose a novel floating-point encoding scheme that builds on prior work involving fixed-point encodings. We encode floating-point numbers using Two's Complement fixed-point mantissas and Two's Complement integral exponents. We used our…

Noise is an important factor that influences the reliability of information acquisition, transmission, processing, and storage. In order to suppress the inevitable noise effects, a fault-tolerant information processing approach via quantum…

Quantum Physics · Physics 2026-03-27 Qi Song , Hongjing Li , Chengxi Yu , Jingzheng Huang , Ding Wang , Peng Huang , Guihua Zeng

Block encoding of sparse matrices underpins powerful quantum algorithms such as quantum singular value transformation, Hamiltonian simulation, and quantum linear solvers, yet its efficient gate-level realization for general sparse matrices…

Quantum Physics · Physics 2026-04-07 Abhishek Setty

The deployment of widely used Transformer architecture is challenging because of heavy computation load and memory overhead during inference, especially when the target device is limited in computational resources such as mobile or edge…

Machine Learning · Computer Science 2020-10-14 Insoo Chung , Byeongwook Kim , Yoonjung Choi , Se Jung Kwon , Yongkweon Jeon , Baeseong Park , Sangha Kim , Dongsoo Lee

Many modern search domains comprise high-dimensional vectors of floating point numbers derived from neural networks, in the form of embeddings. Typical embeddings range in size from hundreds to thousands of dimensions, making the size of…

Machine Learning · Computer Science 2025-06-03 Richard Connor , Alan Dearle , Ben Claydon

Efficient deployment of large language models (LLMs) necessitates low-bit quantization to minimize model size and inference cost. While low-bit integer formats (e.g., INT8/INT4) have been the conventional choice, emerging low-bit…

Machine Learning · Computer Science 2023-05-23 Yijia Zhang , Lingran Zhao , Shijie Cao , Wenqiang Wang , Ting Cao , Fan Yang , Mao Yang , Shanghang Zhang , Ningyi Xu

The rapidly increasing size of large language models (LLMs) presents significant challenges in memory usage and computational costs. Quantizing both weights and activations can address these issues, with hardware-supported fine-grained…

Computation and Language · Computer Science 2025-07-25 Wonsuk Jang , Thierry Tambe

One of the major promises of quantum computing is the realization of SIMD (single instruction - multiple data) operations using the phenomenon of superposition. Since the dimension of the state space grows exponentially with the number of…

Mainstream image and video coding standards -- including state-of-the-art codecs like H.266/VVC, AVS3, and AV1 -- adopt a block-based hybrid coding framework. While this framework facilitates straightforward optimization for Peak…

Image and Video Processing · Electrical Eng. & Systems 2025-10-17 Runyu Yang , Ivan V. Bajić

Fault-tolerant capacities quantify the ability of a quantum channel to reliably transmit information when every component of the encoding and decoding procedure is noisy. Earlier work analyzed achievable communication rates under such noise…

Quantum Physics · Physics 2026-02-11 Paula Belzig , Hayata Yamasaki

Block-encoding operators are one of the essential components in quantum algorithms based on Quantum Signal Processing. Their gate complexity largely determines the overall gate complexity of the full algorithm. Using variational methods, we…

The error floor phenomenon observed with LDPC codes and their graph-based, iterative, message-passing (MP) decoders is commonly attributed to the existence of error-prone substructures -- variously referred to as near codewords, trapping…

Information Theory · Computer Science 2013-09-11 Xiaojie Zhang , Paul H. Siegel

The main challenge in visible light communications (VLC) is the low modulation bandwidth of light-emitting diodes (LEDs). This forms a barrier towards achieving high data rates. Moreover, the implementation of high order modulation schemes…

Information Theory · Computer Science 2021-04-12 Hanaa Abumarshoud , Lina Mohjazi , Sami Muhaidat

In this study, we analyze the codebook design used for analog beamforming. Analog beamforming and combining suffer from a subspace sampling limitation, that is, the receiver cannot directly observe the channel coefficients; instead, the…

Information Theory · Computer Science 2020-02-12 Mehdi Ganji , Hongbing Cheng , Qi Zhan , Kee-Bong Song

As quantum computing moves toward fault-tolerant architectures, quantum error correction (QEC) decoder performance is increasingly critical for scalability. Understanding the impact of transitioning from floating-point software to…

Quantum Physics · Physics 2026-04-22 Francisco Garcia-Herrero , Javier Valls , Llanos Vergara-Picazo , Vicente Torres

Differential pulse-code modulation (DPCM) is recently coupled with uniform scalar quantization (SQ) to improve the rate-distortion (RD) performance for the block-based quantized compressive sensing (CS) of images. In this framework, for…

Information Theory · Computer Science 2016-04-26 Min Gao
‹ Prev 1 2 3 10 Next ›