English
Related papers

Related papers: The Linear Reliability Channel

200 papers

Random linear network coding (RLNC) is asymptotically throughput optimal in the wireless broadcast of a block of packets from a sender to a set of receivers, but suffers from heavy computational load and packet decoding delay. To mitigate…

Information Theory · Computer Science 2015-06-04 Mingchao Yu , Parastoo Sadeghi , Alex Sprintson

Recently, many unsupervised deep learning methods have been proposed to learn clustering with unlabelled data. By introducing data augmentation, most of the latest methods look into deep clustering from the perspective that the original…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Huasong Zhong , Chong Chen , Zhongming Jin , Xian-Sheng Hua

This paper re-examines the well-known fundamental tradeoffs between rate and reliability for the multi-antenna, block Rayleigh fading channel in the high signal to noise ratio (SNR) regime when (i) the transmitter has access to (noiseless)…

Information Theory · Computer Science 2007-07-17 Masoud Sharif , Prakash Ishwar

Large language model (LLM) routing has emerged as a crucial strategy for balancing computational costs with performance by dynamically assigning queries to the most appropriate model based on query complexity. Despite recent advances…

Computation and Language · Computer Science 2025-04-11 Aly M. Kassem , Bernhard Schölkopf , Zhijing Jin

Binary message-passing decoders for low-density parity-check (LDPC) codes are studied by using extrinsic information transfer (EXIT) charts. The channel delivers hard or soft decisions and the variable node decoder performs all computations…

Information Theory · Computer Science 2016-11-18 Gottfried Lechner , Troels Pedersen , Gerhard Kramer

Tensor-valued data arise naturally in neuroimaging, genomics, climate science, and spatiotemporal networks, where multilinear dependencies across modes carry information that is destroyed under vectorization. Existing approaches either…

Machine Learning · Statistics 2026-05-20 Elynn Chen , Jiayu Li , Zheshi Zheng , Jian Pei

For reliable transmission across a noisy communication channel, classical results from information theory show that it is asymptotically optimal to separate out the source and channel coding processes. However, this decomposition can fall…

Machine Learning · Computer Science 2019-05-15 Kristy Choi , Kedar Tatwawadi , Aditya Grover , Tsachy Weissman , Stefano Ermon

In recent years, numerous data-intensive broadcasting applications have emerged at the wireless edge, calling for a flexible tradeoff between distortion, transmission rate, and processing complexity. While deep learning-based joint…

Information Theory · Computer Science 2026-03-24 Zijun Qin , Jingxuan Huang , Zesong Fei , Haichuan Ding , Yulin Shao , Xianhao Chen

Tree-based demappers for multiple-input multiple-output (MIMO) detection such as the sphere decoder can achieve near-optimal performance but incur high computational cost due to their sequential nature. In this paper, we propose the…

Information Theory · Computer Science 2022-09-12 Daniel E. Worrall , Markus Peschl , Arash Behboodi , Roberto Bondesan

A classification algorithm, called the Linear Centralization Classifier (LCC), is introduced. The algorithm seeks to find a transformation that best maps instances from the feature space to a space where they concentrate towards the center…

Machine Learning · Computer Science 2017-12-25 Mohammad Reza Bonyadi , Viktor Vegh , David C. Reutens

We introduce a novel universal soft-decision decoding algorithm for binary block codes called ordered reliability direct error pattern testing (ORDEPT). Our results, obtained for a variety of popular short high-rate codes, demonstrate that…

Information Theory · Computer Science 2023-10-19 Reza Hadavian , Xiaoting Huang , Dmitri Truhachev , Kamal El-Sankary , Hamid Ebrahimzad , Hossein Najafi

We study the problem of channel resolvability for fixed i.i.d. input distributions and discrete memoryless channels (DMCs), and derive the strong converse theorem for any DMCs that are not necessarily full rank. We also derive the optimal…

Information Theory · Computer Science 2014-04-23 Shun Watanabe , Masahito Hayashi

The design of codes for feedback-enabled communications has been a long-standing open problem. Recent research on non-linear, deep learning-based coding schemes have demonstrated significant improvements in communication reliability over…

Information Theory · Computer Science 2023-06-09 Junghoon Kim , Taejoon Kim , David Love , Christopher Brinton

We derive a lower and upper bound on the reliability function of discrete memoryless multiple-access channel (MAC) with noiseless feedback and variable-length codes (VLCs). For the upper-bound, we use proof techniques of Burnashev for the…

Information Theory · Computer Science 2018-07-02 Mohsen Heidari , Achilleas Anastasopoulos , S. Sandeep Pradhan

Several types of AL-FEC (Application-Level FEC) codes for the Packet Erasure Channel exist. Random Linear Codes (RLC), where redundancy packets consist of random linear combinations of source packets over a certain finite field, are a…

Information Theory · Computer Science 2014-08-26 Kazuhisa Matsuzono , Vincent Roca , Hitoshi Asaeda

Accurate modeling of the correlation between the sources plays a crucial role in the efficiency of distributed source coding (DSC) systems. This correlation is commonly modeled in the binary domain by using a single binary symmetric channel…

Information Theory · Computer Science 2012-11-12 Mojtaba Vaezi , Fabrice Labeau

The Lipschitz constant of the map between the input and output space represented by a neural network is a natural metric for assessing the robustness of the model. We present a new method to constrain the Lipschitz constant of dense deep…

Machine Learning · Computer Science 2023-08-22 Ouail Kitouni , Niklas Nolte , Mike Williams

V2X (Vehicle-to-everything) communication relies on short messages for short-range transmissions over a fading wireless channel, yet requires high reliability and low latency. Hard-decision decoding sacrifices the preservation of diversity…

Information Theory · Computer Science 2024-08-08 Praveen Sai Bere , Mohammed Zafar Ali Khan , Lajos Hanzo

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar

In this paper, we propose a deep learning model for Demodulation Reference Signal (DMRS) based channel estimation task. Specifically, a novel Denoise, Linear interpolation and Refine (DLR) pipeline is proposed to mitigate the noise…

Signal Processing · Electrical Eng. & Systems 2021-09-23 Yu Tian , Chengguang Li , Sen Yang