English
Related papers

Related papers: Keep the bursts and ditch the interleavers

200 papers

For high throughput applications, turbo-like iterative decoders are implemented with parallel architectures. However, to be efficient parallel architectures require to avoid collision accesses i.e. concurrent read/write accesses should not…

Hardware Architecture · Computer Science 2010-02-23 Cyrille Chavet , Philippe Coussy , Eric Martin , Pascal Urard

We consider streaming data transmission over a discrete memoryless channel. A new message is given to the encoder at the beginning of each block and the decoder decodes each message sequentially, after a delay of $T$ blocks. In this…

Information Theory · Computer Science 2015-12-22 Si-Hyeon Lee , Vincent Y. F. Tan , Ashish Khisti

We consider the problem of reliable communication over a discrete memoryless channel (DMC) with the help of a relay, termed the information bottleneck (IB) channel. There is no direct link between the source and the destination, and the…

Information Theory · Computer Science 2023-05-02 Michael Dikshtein , Nir Weinberger , Shlomo Shamai

Large language models (LLMs) often struggle with strict memory, latency, and power demands. To meet these demands, various forms of dynamic sparsity have been proposed that reduce compute on an input-by-input basis. These methods improve…

Computation and Language · Computer Science 2024-04-09 Jordan Dotzel , Yash Akhauri , Ahmed S. AbouElhamayed , Carly Jiang , Mohamed Abdelfattah , Zhiru Zhang

The problem of learning a channel decoder is considered for two channel models. The first model is an additive noise channel whose noise distribution is unknown and nonparametric. The learner is provided with a fixed codebook and a dataset…

Information Theory · Computer Science 2023-02-17 Amit Tsvieli , Nir Weinberger

In this paper, the uplink adaptation for massive multiple-input-multiple-output (MIMO) networks without the knowledge of user density is considered. Specifically, a novel cooperative uplink transmission and detection scheme is first…

Information Theory · Computer Science 2019-04-30 Yang Li , Zezhong Zhang , Rui Wang , Kaibin Huang , Yifan Chen

This paper investigates decoding of binary linear block codes over the binary erasure channel (BEC). Of the current iterative decoding algorithms on this channel, we review the Recovery Algorithm and the Guess Algorithm. We then present a…

Information Theory · Computer Science 2007-07-13 J. Cai , C. Tjhai , M. Tomlinson , M. Ambroze , M. Ahmed

Random linear network coding is a particularly decentralized approach to the multicast problem. Use of random network codes introduces a non-zero probability however that some sinks will not be able to successfully decode the required…

Information Theory · Computer Science 2007-07-13 Adria Tauste-Campo , Alex Grant

As parallelism becomes critically important in the semiconductor technology, high-performance computing, and cloud applications, parallel network systems will increasingly follow suit. Today, parallelism is an essential architectural…

Performance · Computer Science 2017-07-11 Anna Engelmann , Wolfgang Bziuk , Admela Jukan , Muriel Medard

Ultra-reliable low latency communications (uRLLC) is adopted in the fifth generation (5G) mobile networks to better support mission-critical applications that demand high level of reliability and low latency. With the aid of…

Information Theory · Computer Science 2023-07-20 Xiaohu You , Bin Sheng , Yongming Huang , Wei Xu , Chuan Zhang , Dongming Wang , Pengcheng Zhu , Chen Ji

Large language model (LLM) serving is fundamentally limited by inefficient hardware utilization. Autoregressive (AR) decoding underutilizes GPUs due to its strictly sequential execution, while diffusion LLMs (DLLMs) improve throughput by…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-26 Chiyue Wei , Cong Guo , Bowen Duan , Junyao Zhang , Haoxuan Shan , Yifei Wang , Yangjie Zhou , Hai "Helen" Li , Danyang Zhuo , Yiran Chen

We consider communication over binary-input memoryless output-symmetric channels using low-density parity-check codes and message-passing decoding. The asymptotic (in the length) performance of such a combination for a fixed number of…

Information Theory · Computer Science 2008-02-12 Satish Babu Korada , Ruediger Urbanke

In this article, we investigate the real-world capability of the multi-link operation (MLO) framework -- one of the key MAC-layer features included in the IEEE 802.11be amendment -- by using a large dataset containing 5 GHz spectrum…

Networking and Internet Architecture · Computer Science 2023-05-04 Marc Carrascosa , Giovanni Geraci , Edward Knightly , Boris Bellalta

Interference alignment is a transmission technique for exploiting all available degrees of freedom in the interference channel with an arbitrary number of users. Most prior work on interference alignment, however, neglects interference from…

Information Theory · Computer Science 2010-10-05 Steven W. Peters , Robert W. Heath

The proliferation of large language models (LLMs) has led to the adoption of Mixture-of-Experts (MoE) architectures that dynamically leverage specialized subnetworks for improved efficiency and performance. Despite their benefits, MoE…

Computation and Language · Computer Science 2024-10-28 Ruisi Cai , Yeonju Ro , Geon-Woo Kim , Peihao Wang , Babak Ehteshami Bejnordi , Aditya Akella , Zhangyang Wang

We establish area theorems for iterative detection over coded linear systems (including multiple-input multipleoutput (MIMO) channels, inter-symbol-interference (ISI) channels, and orthogonal frequency-division multiplexing (OFDM) systems).…

Information Theory · Computer Science 2012-08-24 Xiaojun Yuan , Li Ping , Chongbin Xu , Aleksandar Kavcic

In the field of interactive coding, two or more parties wish to carry out a distributed computation over a communication network that may be noisy. The ultimate goal is to develop efficient coding schemes that can tolerate a high level of…

Data Structures and Algorithms · Computer Science 2022-08-04 Ran Gelles , Yael T. Kalai , Govind Ramnarayan

Channel uncertainty and co-channel interference are two major challenges in the design of wireless systems such as future generation cellular networks. This paper studies receiver design for a wireless channel model with both time-varying…

Information Theory · Computer Science 2009-10-15 Yan Zhu , Dongning Guo , Michael L. Honig

This paper studies the tension between throughput and decoding delay performance of two widely-used network coding schemes: random linear network coding (RLNC) and instantly decodable network coding (IDNC). A single-hop broadcasting system…

Information Theory · Computer Science 2015-03-20 Parastoo Sadeghi , Mingchao Yu

Web-scale pre-training datasets are the cornerstone of LLMs' success. However, text data curated from the Internet inevitably contains random noise caused by decoding errors or unregulated web content. In contrast to previous works that…

Computation and Language · Computer Science 2025-05-19 Jinghan Ru , Yuxin Xie , Xianwei Zhuang , Yuguo Yin , Zhihui Guo , Zhiming Liu , Qianli Ren , Yuexian Zou