English
Related papers

Related papers: Quantization for Soft-Output Demodulators in Bit-I…

200 papers

In this paper, a neural network-aided bit-interleaved coded modulation (NN-BICM) receiver is designed to mitigate the nonlinear clipping distortion in the LDPC coded direct currentbiased optical orthogonal frequency division multiplexing…

Machine Learning · Computer Science 2018-09-05 Yuan He , Ming Jiang , Chunming Zhao

We consider probabilistic shaping to maximize the achievable information rate of coded modulation (CM) with hard decision decoding. The proposed scheme using binary staircase codes outperforms its uniform CM counterpart by more than 1.3 dB…

Information Theory · Computer Science 2017-05-08 Alireza Sheikh , Alexandre Graell i Amat , Gianluigi Liva

Large language models (LLMs) have shown promising performance across various tasks. However, their autoregressive decoding process poses significant challenges for efficient deployment on existing AI hardware. Quantization alleviates memory…

Machine Learning · Computer Science 2025-12-01 Guanxi Lu , Hao Mark Chen , Zhiqiang Que , Wayne Luk , Hongxiang Fan

The deployment of large language models (LLMs) is frequently hindered by prohibitive memory and computational requirements. While quantization mitigates these bottlenecks, maintaining model fidelity in the sub-1-bit regime remains a…

Machine Learning · Computer Science 2026-02-06 Banseok Lee , Dongkyu Kim , Youngcheon You , Youngmin Kim

Blind algorithms for multiple-input multiple-output (MIMO) signals interception have recently received considerable attention because of their important applications in modern civil and military communication fields. One key step in the…

Information Theory · Computer Science 2017-03-07 Mohammad Rida Bahloul , Mohd Zuki Yusoff , Abdel-Haleem Abdel-Aty , M Naufal M Saad

Deploying large language models (LLMs) in resource-constrained environments is hindered by heavy computational and memory requirements. We present LBLLM, a lightweight binarization framework that achieves effective W(1+1)A4 quantization…

Machine Learning · Computer Science 2026-04-22 Siqing Song , Chuang Wang , Yong Lang , Yi Yang , Xu-Yao Zhang

Large Language Models (LLMs) have shown an impressive capability in code generation. The LLM effectiveness generally increases with its size: The higher the number of LLM's trainable parameters the better its ability to implement code.…

Software Engineering · Computer Science 2026-01-28 Alessandro Giagnorio , Antonio Mastropaolo , Saima Afrin , Massimiliano Di Penta , Gabriele Bavota

A likelihood encoder is studied in the context of lossy source compression. The analysis of the likelihood encoder is based on the soft-covering lemma. It is demonstrated that the use of a likelihood encoder together with the soft-covering…

Information Theory · Computer Science 2016-04-07 Eva C. Song , Paul Cuff , H. Vincent Poor

Quantization effectively reduces the serving costs of Large Language Models (LLMs) by speeding up data movement through compressed parameters and enabling faster operations via integer arithmetic. However, activating integer arithmetic…

Machine Learning · Computer Science 2025-06-04 Patrik Czakó , Gábor Kertész , Sándor Szénási

We establish that during the execution of any Guessing Random Additive Noise Decoding (GRAND) algorithm, an interpretable, useful measure of decoding confidence can be evaluated. This measure takes the form of a log-likelihood ratio (LLR)…

Information Theory · Computer Science 2023-08-11 Ken R. Duffy , Muriel Medard

Based on a new equivalent model of quantizer with noisy input recently presented in [23], we propose a new low complexity receiver that takes into account the nonlinear distortion (NLD) generated by Analog to Digital converter (ADC) with…

Signal Processing · Electrical Eng. & Systems 2019-04-23 Arkady Molev-Shteiman , Xiao-Feng Qi , Laurence Mailaender

Quantum low density parity check (qLDPC) codes, particularly bivariate bicycle (BB) codes, achieve competitive fault tolerance thresholds while offering substantially higher encoding rates than planar surface codes. However, their…

Quantum Physics · Physics 2026-05-07 Nitish Kumar Chandra , Eneet Kaur , Reza Nejabati , Kaushik P. Seshadreesan

We present a new family of signal constellations, called log constellations, that can be used to design near-capacity coded modulation schemes over additive exponential noise (AEN) channels. Log constellations are designed by geometrically…

Information Theory · Computer Science 2011-11-29 Stéphane Y. Le Goff

Locally repairable codes (LRCs) were originally introduced to enable efficient recovery from erasures in distributed storage systems by accessing only a small number of other symbols. While their structural properties-such as bounds and…

Information Theory · Computer Science 2026-02-23 Hoang Ly , Emina Soljanin , Philip Whiting

A practical rate-matching system for constructing rate-compatible polar codes is proposed. The proposed polar code circular buffer rate-matching is suitable for transmissions on communication channels that support hybrid automatic repeat…

Information Theory · Computer Science 2017-11-15 Mostafa El-Khamy , Hsien-Ping Lin , Jungwon Lee , Inyup Kang

In a networked control system, quantization is inevitable to transmit control and measurement signals. While uniform quantizers are often used in practical systems, the overloading, which is due to the limitation on the number of bits in…

Systems and Control · Computer Science 2017-04-14 Shuichi Ohno , Yuma Ishihara , Masaaki Nagahara

We extend a low-rate improvement of the random coding bound on the reliability of a classical discrete memoryless channel to its quantum counterpart. The key observation that we make is that the problem of bounding below the error exponent…

Quantum Physics · Physics 2007-05-23 Alexander Barg

In this paper, we propose a framework of the mutual information-maximizing (MIM) quantized decoding for low-density parity-check (LDPC) codes by using simple mappings and fixed-point additions. Our decoding method is generic in the sense…

Information Theory · Computer Science 2022-02-15 Peng Kang , Kui Cai , Xuan He , Shuangyang Li , Jinhong Yuan

Due to their capacity-achieving property, polar codes have become one of the most attractive channel codes. To date, the successive cancellation list (SCL) decoding algorithm is the primary approach that can guarantee outstanding…

Information Theory · Computer Science 2016-11-18 Bo Yuan , Keshab K. Parhi

Reed-Muller (RM) codes are known for their good maximum likelihood (ML) performance in the short block-length regime. Despite being one of the oldest classes of channel codes, finding a low complexity soft-input decoding scheme is still an…

Information Theory · Computer Science 2021-07-19 Marvin Geiselhart , Ahmed Elkelesh , Moustafa Ebada , Sebastian Cammerer , Stephan ten Brink
‹ Prev 1 4 5 6 7 8 10 Next ›