English
Related papers

Related papers: High-Throughput VLSI Architecture for GRAND Markov…

200 papers

The problem of learning a channel decoder is considered for two channel models. The first model is an additive noise channel whose noise distribution is unknown and nonparametric. The learner is provided with a fixed codebook and a dataset…

Information Theory · Computer Science 2023-02-17 Amit Tsvieli , Nir Weinberger

There have been significant advances in recent years in the development of forward error correction decoders that can decode codes of any structure, including practical realizations in synthesized circuits and taped out chips. While…

Signal Processing · Electrical Eng. & Systems 2025-11-11 Jiewei Feng , Ken R. Duffy , Muriel Médard

CA-Polar codes have been selected for all control channel communications in 5G NR, but accurate, computationally feasible decoders are still subject to development. Here we report the performance of a recently proposed class of optimally…

Information Theory · Computer Science 2021-02-22 Ken Duffy , Amit Solomon , Kishori M. Konwar , Muriel Medard

Speculative decoding accelerates large language model (LLM) inference by letting a lightweight draft model propose multiple tokens that the target model verifies in parallel. Yet existing training objectives optimize only a single greedy…

Computation and Language · Computer Science 2026-03-03 Shijing Hu , Jingyang Li , Zhihui Lu , Pan Zhou

In this paper, we focus on the demodulation/decoding of the complex modulations/codes that approach the Shannon capacity. Theoretically, the maximum likelihood (ML) algorithm can achieve the optimal error performance whereas it has…

Information Theory · Computer Science 2022-06-14 Boxiang He , Zitao Wu , Fanggang Wang

Speculative Decoding (SD) accelerates autoregressive large language model (LLM) inference by decoupling generation and verification. While recent methods improve draft quality by tightly coupling the drafter with the target model, the…

Machine Learning · Computer Science 2026-04-14 Jingwei Song , Xinyu Wang , Hanbin Wang , Xiaoxuan Lei , Bill Shi , Shixin Han , Eric Yang , Xiao-Wen Chang , Lynn Ai

Maximum Likelihood (ML) algorithms, for the joint estimation of synchronization impairments and channel in Multiple Input Multiple Output-Orthogonal Frequency Division Multiplexing (MIMO-OFDM) system, are investigated in this work. A system…

Information Theory · Computer Science 2012-10-30 Renu Jose , K. V. S. Hari

Large Language Models (LLMs) have achieved remarkable success across many applications, with Mixture of Experts (MoE) models demonstrating great potential. Compared to traditional dense models, MoEs achieve better performance with less…

Machine Learning · Computer Science 2026-02-17 Zongle Huang , Lei Zhu , Zongyuan Zhan , Ting Hu , Weikai Mao , Xianzhi Yu , Yongpan Liu , Tianyu Zhang

Error correcting codes are a fundamental component in modern day communication systems, demanding extremely high throughput, ultra-reliability and low latency. Recent approaches using machine learning (ML) models as the decoders offer both…

Machine Learning · Computer Science 2021-12-23 Hung T. Nguyen , Steven Bottone , Kwang Taik Kim , Mung Chiang , H. Vincent Poor

In this paper, we propose a novel transmission scheme, called sparse layered MIMO (SL-MIMO), that combines non-orthogonal transmission and singular value decomposition (SVD) precoding. Nonorthogonality in SL-MIMO allows re-using of the…

Information Theory · Computer Science 2022-08-15 Mohamad H. Dinan , Nemanja Stefan Perovic , Mark F. Flanagan

We introduce Noise Recycling, a method that enhances decoding performance of channels subject to correlated noise without joint decoding. The method can be used with any combination of codes, code-rates and decoding techniques. In the…

Information Theory · Computer Science 2020-10-16 Alejandro Cohen , Amit Solomon , Ken R. Duffy , Muriel Médard

Algorithms for Massive MIMO uplink detection and downlink precoding typically rely on a centralized approach, by which baseband data from all antenna modules are routed to a central node in order to be processed. In the case of Massive…

Signal Processing · Electrical Eng. & Systems 2020-01-29 Jesus Rodriguez Sanchez , Fredrik Rusek , Ove Edfors , Muris Sarajlic , Liang Liu

A primary source of increased read time on NAND flash comes from the fact that in the presence of noise, the flash medium must be read several times using different read threshold voltages for the decoder to succeed. This paper proposes an…

Information Theory · Computer Science 2022-02-14 Borja Peleato , Rajiv Agarwal , John Cioffi , Minghai Qin , Paul H. Siegel

A construction of big convolutional codes from short codes called block Markov superposition transmission (BMST) is proposed. The BMST is very similar to superposition blockMarkov encoding (SBME), which has been widely used to prove…

Information Theory · Computer Science 2013-08-23 Xiao Ma , Chulong Liang , Kechao Huang , Qiutao Zhuang

Despite the significant progress in multimodal large language models (MLLMs), their high computational cost remains a barrier to real-world deployment. Inspired by the mixture of depths (MoDs) in natural language processing, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Yaxin Luo , Gen Luo , Jiayi Ji , Yiyi Zhou , Xiaoshuai Sun , Zhiqiang Shen , Rongrong Ji

Present-day communication systems routinely use codes that approach the channel capacity when coupled with a computationally efficient decoder. However, the decoder is typically designed for the Gaussian noise channel and is known to be…

Signal Processing · Electrical Eng. & Systems 2019-04-26 Yihan Jiang , Hyeji Kim , Himanshu Asnani , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

We describe two implementations of the optimal error correction algorithm known as the maximum likelihood decoder (MLD) for the 2D surface code with a noiseless syndrome extraction. First, we show how to implement MLD exactly in time…

Quantum Physics · Physics 2014-10-01 Sergey Bravyi , Martin Suchara , Alexander Vargo

A complexity-adaptive tree search algorithm is proposed for $\boldsymbol{G}_N$-coset codes that implements maximum-likelihood (ML) decoding by using a successive decoding schedule. The average complexity is close to that of the successive…

Information Theory · Computer Science 2021-09-03 Peihong Yuan , Mustafa Cemil Coşkun

Speculative decoding accelerates large language model (LLM) inference by using a lightweight draft model to propose tokens that are later verified by a stronger target model. While effective in centralized systems, its behavior in…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Jingwei Song , Wanyi Chen , Xinyuan Song , Max , Chris Tong , Gufeng Chen , Tianyi Zhao , Eric Yang , Bill Shi , Lynn Ai

In massive multiple-input multiple-output (MIMO) systems, hybrid analog-digital (AD) beamforming can be used to attain a high directional gain without requiring a dedicated radio frequency (RF) chain for each antenna element, which…

Signal Processing · Electrical Eng. & Systems 2021-09-15 S. Shi , Y. Cai , Q. Hu , B. Champagne , L. Hanzo