English
Related papers

Related papers: A Universal Systematic Method to Generate Error Pa…

200 papers

This paper applies error-exponent and dispersion-style analyses to derive finite-blocklength achievability bounds for low-density parity-check (LDPC) codes over the point-to-point channel (PPC) and multiple access channel (MAC). The…

Information Theory · Computer Science 2020-05-14 Yuxin Liu , Michelle Effros

Advances in deep generative and density models have shown impressive capacity to model complex probability density functions in lower-dimensional space. Also, applying such models to high-dimensional image data to model the PDF has shown…

Machine Learning · Computer Science 2019-11-13 John Just , Sambuddha Ghosal

Spinal codes are a type of capacity-achieving rateless codes that have been proved to approach the Shannon capacity over the additive white Gaussian noise (AWGN) channel and the binary symmetric channel (BSC). In this paper, we aim to…

Information Theory · Computer Science 2022-04-05 Aimin Li , Shaohua Wu , Jian Jiao , Ning Zhang , Qinyu Zhang

This paper presents a novel compressed sensing (CS) approach to high dimensional wireless channel estimation by optimizing the input to a deep generative network. Channel estimation using generative networks relies on the assumption that…

Signal Processing · Electrical Eng. & Systems 2020-06-25 Eren Balevi , Akash Doshi , Ajil Jalal , Alexandros Dimakis , Jeffrey G. Andrews

Shannon's analysis of the fundamental capacity limits for memoryless communication channels has been refined over time. In this paper, the maximum volume $M_\avg^*(n,\epsilon)$ of length-$n$ codes subject to an average decoding error…

Information Theory · Computer Science 2016-12-28 Pierre Moulin

Existing methods for sparse channel estimation typically provide an estimate computed as the solution maximizing an objective function defined as the sum of the log-likelihood function and a penalization term proportional to the l1-norm of…

Machine Learning · Statistics 2012-04-04 Niels Lovmand Pedersen , Carles Navarro Manchón , Dmitriy Shutin , Bernard Henri Fleury

A probability density function (pdf) encodes the entire stochastic knowledge about data distribution, where data may represent stochastic observations in robotics, transition state pairs in reinforcement learning or any other empirically…

Machine Learning · Computer Science 2018-09-18 Dmitry Kopitkov , Vadim Indelman

We construct a channel coding scheme to achieve the capacity of any discrete memoryless channel based solely on the techniques of polar coding. In particular, we show how source polarization and randomness extraction via polarization can be…

Information Theory · Computer Science 2016-01-22 David Sutter , Joseph M. Renes , Frédéric Dupuis , Renato Renner

Except for a few simple digital modulation techniques, derivation of average bit error probability over fading channels is difficult and is an involved process. In this letter, curve fitting technique has been employed to express bit error…

Information Theory · Computer Science 2012-10-02 Sanjay Singh , M. Sathish Kumar , H. S. Mruthyunjaya

Likelihood-based generative models are a promising resource to detect out-of-distribution (OOD) inputs which could compromise the robustness or reliability of a machine learning system. However, likelihoods derived from such models have…

Machine Learning · Computer Science 2020-01-20 Joan Serrà , David Álvarez , Vicenç Gómez , Olga Slizovskaia , José F. Núñez , Jordi Luque

In 2009, a lossless compression algorithm based on 1D chaotic maps known as Generalized Lur\"{o}th Series (or GLS) has been proposed. This algorithm (GLS-coding) encodes the input message as a symbolic sequence on an appropriate 1D chaotic…

Information Theory · Computer Science 2013-08-13 Nithin Nagaraj

This paper studies second-order coding rates for memoryless channels with a state sequence known non-causally at the encoder. In the case of finite alphabets, an achievability result is obtained using constant-composition random coding, and…

Information Theory · Computer Science 2013-11-13 Jonathan Scarlett

Orthogonal delay-Doppler (DD) division multiplexing (ODDM) has been recently proposed as a promising multicarrier modulation scheme to tackle Doppler spread in high-mobility environments. Accurate channel estimation is of paramount…

Signal Processing · Electrical Eng. & Systems 2024-07-10 Yaru Shan , Akram Shafie , Jinhong Yuan , Fanggang Wang

Channel estimation is a critical task in digital communications that greatly impacts end-to-end system performance. In this work, we introduce a novel approach for multiple-input multiple-output (MIMO) channel estimation using score-based…

Signal Processing · Electrical Eng. & Systems 2022-02-16 Marius Arvinte , Jonathan I Tamir

In this study we consider rateless coding over discrete memoryless channels (DMC) with feedback. Unlike traditional fixed-rate codes, in rateless codes each codeword is infinitely long, and the decoding time depends on the confidence level…

Information Theory · Computer Science 2012-01-30 Navot Blits

Orthogonal delay-Doppler division multiplexing~(ODDM) modulation has recently been regarded as a promising technology to provide reliable communications in high-mobility situations. Accurate and low-complexity channel estimation is one of…

Signal Processing · Electrical Eng. & Systems 2025-07-29 Dezhi Wang , Chongwen Huang , Xiaojun Yuan , Sami Muhaidat , Lei Liu , Xiaoming Chen , Zhaoyang Zhang , Chau Yuen , Mérouane Debbah

In this work, we utilize a Gaussian mixture model (GMM) to capture the underlying probability density function (PDF) of the channel trajectories of moving mobile terminals (MTs) within the coverage area of a base station (BS) in an offline…

Signal Processing · Electrical Eng. & Systems 2024-02-14 Nurettin Turan , Benedikt Böck , Kai Jie Chan , Benedikt Fesl , Friedrich Burmeister , Michael Joham , Gerhard Fettweis , Wolfgang Utschick

We propose "Generative Fusion Decoding" (GFD), a novel shallow fusion framework designed to integrate large language models (LLMs) into cross-modal text recognition systems for automatic speech recognition (ASR) and optical character…

Computation and Language · Computer Science 2025-06-12 Chan-Jan Hsu , Yi-Chang Chen , Feng-Ting Liao , Pei-Chen Ho , Yu-Hsiang Wang , Po-Chun Hsu , Da-shan Shiu

The construction of optimal non-uniform mappings for discrete input memoryless channels (DIMCs) is investigated. An efficient algorithm to find optimal mappings is proposed and the rate by which a target distribution is approached is…

Information Theory · Computer Science 2014-07-09 Georg Böcherer

This paper studies the third-order characteristic of nonsingular discrete memoryless channels and the Gaussian channel with a maximal-power constraint. The third-order term in our expansions employs a new quantity here called the channel…

Information Theory · Computer Science 2024-08-23 Recep Can Yavas , Victoria Kostina , Michelle Effros