English
Related papers

Related papers: An Improved Majority-Logic Decoder Offering Massiv…

200 papers

Diffusion large language models (dLLMs) have recently drawn considerable attention within the research community as a promising alternative to autoregressive generation, offering parallel token prediction and lower inference latency. Yet,…

Computation and Language · Computer Science 2025-10-01 Zigeng Chen , Gongfan Fang , Xinyin Ma , Ruonan Yu , Xinchao Wang

We show that the known list-decoding algorithms for univariate multiplicity and folded Reed-Solomon codes can be made to run in $\tilde{O}(n)$ time. Univariate multiplicity codes and FRS codes are natural variants of Reed-Solomon codes that…

Information Theory · Computer Science 2024-03-13 Rohan Goyal , Prahladh Harsha , Mrinal Kumar , Ashutosh Shankar

In this paper, we propose low-complexity local detectors and log-likelihood ratio (LLR) refinement techniques for a coded cell-free massive multiple input multiple output (CF- mMIMO) systems, where an iterative detection and decoding (IDD)…

Information Theory · Computer Science 2024-05-24 T. Ssettumba , Z. Shao , L. Landau , R. C. de Lamare

We describe two implementations of the optimal error correction algorithm known as the maximum likelihood decoder (MLD) for the 2D surface code with a noiseless syndrome extraction. First, we show how to implement MLD exactly in time…

Quantum Physics · Physics 2014-10-01 Sergey Bravyi , Martin Suchara , Alexander Vargo

We consider the problem of computing the convolution of two long vectors using parallel processing units in the presence of "stragglers". Stragglers refer to the small fraction of faulty or slow processors that delays the entire computation…

Information Theory · Computer Science 2017-05-11 Sanghamitra Dutta , Viveck Cadambe , Pulkit Grover

This paper considers the input-constrained binary memoryless symmetric (BMS) channel, without feedback. The channel input sequence respects the $(d,\infty)$-runlength limited (RLL) constraint, which mandates that any pair of successive $1$s…

Information Theory · Computer Science 2022-01-07 V. Arvind Rameshwar , Navin Kashyap

We investigate iterative low-resolution message-passing algorithms for quasi-cyclic LDPC codes with horizontal and vertical layered schedules. Coarse quantization and layered scheduling are highly relevant for hardware implementations to…

Information Theory · Computer Science 2022-12-19 Philipp Mohr , Gerhard Bauch

We present a framework that can exploit the tradeoff between the undetected error rate (UER) and block error rate (BLER) of polar-like codes. It is compatible with all successive cancellation (SC)-based decoding methods and relies on a…

Information Theory · Computer Science 2024-05-03 Peihong Yuan , Ken R. Duffy , Muriel Médard

State-of-the-art multilingual machine translation relies on a universal encoder-decoder, which requires retraining the entire system to add new languages. In this paper, we propose an alternative approach that is based on language-specific…

Computation and Language · Computer Science 2020-04-15 Carlos Escolano , Marta R. Costa-jussà , José A. R. Fonollosa , Mikel Artetxe

We consider the following problem: given three sets of real numbers, output a word-RAM data structure from which we can efficiently recover the sign of the sum of any triple of numbers, one in each set. This is similar to a previous work by…

Data Structures and Algorithms · Computer Science 2019-03-08 Sergio Cabello , Jean Cardinal , John Iacono , Stefan Langerman , Pat Morin , Aurélien Ooms

Machine learning (ML) can be used in various ways to improve multi-user multiple-input multiple-output (MU-MIMO) receive processing. Typical approaches either augment a single processing step, such as symbol detection, or replace multiple…

Information Theory · Computer Science 2021-07-01 Mathieu Goutay , Fayçal Ait Aoudia , Jakob Hoydis , Jean-Marie Gorce

Quantum error-correcting codes (QECCs) can eliminate the negative effects of quantum noise, the major obstacle to the execution of quantum algorithms. However, realizing practical quantum error correction (QEC) requires resolving many…

The distance profiles of linear block codes can be employed to design variational coding scheme for encoding message with variational length and getting lower decoding error probability by large minimum Hamming distance. %, e.g. the design…

Information Theory · Computer Science 2013-06-05 Xiaogang Liu , Yuan Luo , Kenneth W. Shum

Algorithms based on multiple decoding attempts of Reed-Solomon (RS) codes have recently attracted new attention. Choosing decoding candidates based on rate-distortion (R-D) theory, as proposed previously by the authors, currently provides…

Information Theory · Computer Science 2016-11-17 Phong S. Nguyen , Henry D. Pfister , Krishna R. Narayanan

Regenerating codes provide an efficient way to recover data at failed nodes in distributed storage systems. It has been shown that regenerating codes can be designed to minimize the per-node storage (called MSR) or minimize the…

Information Theory · Computer Science 2013-01-14 Yunghsiang S. Han , Hong-Ta Pai , Rong Zheng , Pramod K. Varshney

Constrained decoding approaches aim to control the meaning or style of text generated by the pre-trained large language models (LLMs or also PLMs) for various tasks at inference time. However, these methods often guide plausible…

Computation and Language · Computer Science 2025-05-06 Chen Xu , Tian Lan , Yu Ji , Changlong Yu , Wei Wang , Jun Gao , Qunxi Dong , Kun Qian , Piji Li , Wei Bi , Bin Hu

Multiple Constant Multiplication (MCM) over integers is a frequent operation arising in embedded systems that require highly optimized hardware. An efficient way is to replace costly generic multiplication by bit-shifts and additions, i.e.…

Hardware Architecture · Computer Science 2022-10-11 Rémi Garcia , Anastasia Volkova

Extracting and analyzing iris textures for biometric recognition has been extensively studied. As the transition of iris recognition from lab technology to nation-scale applications, most systems are facing high complexity in either time or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Longyu Ma , Chiu-Wing Sham , Chun Yan Lo , Xinchao Zhong

Aligning language models (LMs) to human preferences has emerged as a critical pursuit, enabling these models to better serve diverse user needs. Existing methods primarily focus on optimizing LMs for a single reward function, limiting their…

Machine Learning · Computer Science 2024-10-29 Ruizhe Shi , Yifang Chen , Yushi Hu , Alisa Liu , Hannaneh Hajishirzi , Noah A. Smith , Simon S. Du

We propose to reduce the decoding complexity of polar codes with non-Arikan kernels by employing a (near) ML decoding algorithm for the codes generated by kernel rows. A generalization of the order statistics algorithm is presented for soft…

Information Theory · Computer Science 2018-04-03 Peter Trifonov