English
Related papers

Related papers: Finite-Support Capacity-Approaching Distributions …

200 papers

This paper investigates the problem of computing capacity-cost (C-C) functions for continuous channels. Motivated by the Kullback-Leibler divergence (KLD) proximal reformulation of the classical Blahut-Arimoto (BA) algorithm, the…

Information Theory · Computer Science 2025-03-04 Xinyang Li , Vlad C. Andrei , Ullrich J. Mönich , Fan Liu , Holger Boche

The Pseudo-Marginal (PM) algorithm is a popular Markov chain Monte Carlo (MCMC) method used to sample from a target distribution when its density is inaccessible, but can be estimated with a non-negative unbiased estimator. Its performance…

Computation · Statistics 2025-09-30 Sarra Abaoubida , Mylène Bédard , Florian Maire

Starting from Shannon's celebrated 1948 channel coding theorem, we trace the evolution of channel coding from Hamming codes to capacity-approaching codes. We focus on the contributions that have led to the most significant improvements in…

Information Theory · Computer Science 2007-07-13 Daniel J. Costello , G. David Forney

We study the classical problem of characterizing the channel capacity and its achieving distribution in a generic fashion. We derive a simple relation between three parameters: the input-output function, the input cost function and the…

Information Theory · Computer Science 2017-11-17 Jihad Fahs , Ibrahim Abou-Faycal

Probabilistic amplitude shaping (PAS) is a coded modulation strategy in which constellation shaping and channel coding are combined. PAS has attracted considerable attention in both wireless and optical communications. Achievable…

Information Theory · Computer Science 2020-07-14 Yunus Can Gültekin , Alex Alvarado , Frans M. J. Willems

This paper is concerned with particle filtering for $\alpha$-stable stochastic volatility models. The $\alpha$-stable distribution provides a flexible framework for modeling asymmetry and heavy tails, which is useful when modeling financial…

Computation · Statistics 2014-05-20 Emilian Vankov , Katherine B. Ensor

The probability density function (PDF) for critical wavefunction amplitudes is studied in the three-dimensional Anderson model. We present a formal expression between the PDF and the multifractal spectrum f(alpha) in which the role of…

Disordered Systems and Neural Networks · Physics 2009-03-13 Alberto Rodriguez , Louella J. Vasquez , Rudolf A. Roemer

We address the problem of coding for classical broadcast channels, which entails maximizing the success probability that can be achieved by sending a fixed number of messages over a broadcast channel. For point-to-point channels, Barman and…

Information Theory · Computer Science 2024-12-10 Omar Fawzi , Paul Fermé

Many-user MAC is an important model for understanding energy efficiency of massive random access in 5G and beyond. Introduced in Polyanskiy'2017 for the AWGN channel, subsequent works have provided improved bounds on the asymptotic minimum…

Information Theory · Computer Science 2022-01-05 Suhas S Kowshik

Network embedding, a graph representation learning method illustrating network topology by mapping nodes into lower-dimension vectors, is challenging to accommodate the ever-changing dynamic graphs in practice. Existing research is mainly…

Social and Information Networks · Computer Science 2023-06-16 Haoran Deng , Yang Yang , Jiahe Li , Haoyang Cai , Shiliang Pu , Weihao Jiang

Generalized mutual information (GMI) is used to compute achievable rates for fading channels with various types of channel state information at the transmitter (CSIT) and receiver (CSIR). The GMI is based on variations of auxiliary channel…

Information Theory · Computer Science 2023-05-23 Gerhard Kramer

In this paper, we study the capacity and degree-of-freedom (DoF) scaling for the continuous-time amplitude limited AWGN channels in radio frequency (RF) and intensity modulated optical communication (OC) channels. More precisely, we study…

Information Theory · Computer Science 2016-05-10 Saeid Haghighatshoar , Peter Jung , Giuseppe Caire

Probabilistic constellation shaping enables easy rate adaption and has been proven to reduce the gap to Shannon capacity. Constellation point probabilities are optimized to maximize either the mutual information or the bit-wise mutual…

Information Theory · Computer Science 2025-06-23 Shrinivas Chimmalgi , Laurent Schmalen , Vahid Aref

The employment of stochastic geometry for the analysis and design of ultra dense networks (UDNs) has provided significant insights into network densification. In addition to the characterization of the network performance and behavior,…

Signal Processing · Electrical Eng. & Systems 2024-12-04 Alexis I. Aravanis , Thanh Tu Lam , Olga Muñoz , Antonio Pascual-Iserte , Marco Di Renzo

The Jacob's ladder of density functional theory (DFT) proposes the compelling view that by extending the form of successful approximations -- being guided by exact conditions and selected (least empirical) norms -- upper rungs will do…

Materials Science · Physics 2025-02-25 Jacques K. Desmarais , Alessandro Erba , Giovanni Vignale , Stefano Pittalis

We propose the Multi-Head Density Adaptive Attention Mechanism (DAAM), a novel probabilistic attention framework that can be used for Parameter-Efficient Fine-tuning (PEFT), and the Density Adaptive Transformer (DAT), designed to enhance…

Machine Learning · Computer Science 2024-10-01 Georgios Ioannides , Aman Chadha , Aaron Elkins

Direction of arrival (DOA) estimation is an important research in the area of array signal processing, and has been studied for decades. High resolution DOA estimation requires large array aperture, which leads to the increase of hardware…

Signal Processing · Electrical Eng. & Systems 2023-09-26 Yangying Zhao , Peng Chen , Zhenxin Cao , Xianbin Wang

Deep learning aided codes have been shown to improve code performance in feedback codes in high noise regimes due to the ability to leverage non-linearity in code design. In the additive white Gaussian broadcast channel (AWGN-BC), the…

Signal Processing · Electrical Eng. & Systems 2024-10-24 Jacqueline Malayter , Christopher Brinton , David Love

The channel capacity theorem for additive white Gaussian noise channel (AWGN), widely known as the Shannon-Hartley Law, expresses the information capacity of a channel bandlimited in the conventional Fourier domain in terms of the…

Information Theory · Computer Science 2009-01-29 Kamalesh Kumar Sharma

In this letter, we propose a two-stage approach to estimate the carrier frequency offset (CFO) and channel with one-bit analog-to-digital converters (ADCs). Firstly, a simple metric which is only a function of the CFO is proposed, and the…

Information Theory · Computer Science 2018-11-22 Jiang Zhu , Hangting Cao , Zhiwei Xu