English
Related papers

Related papers: A Generalized Expression for the Gradient of Mutua…

200 papers

An abstraction for multisensor communication termed the Gaussian Multiplex Channel is presented and analyzed. In this model, the sensor outputs can be added together in any combination through a network of switches, and the combinations can…

Signal Processing · Electrical Eng. & Systems 2024-12-20 Daniel R. Fuhrmann , Muhammad Fahad

Mutual Information (MI) is a fundamental metric for quantifying dependency between two random variables. When we can access only the samples, but not the underlying distribution functions, we can evaluate MI using sample-based estimators.…

Machine Learning · Statistics 2024-10-16 Kyungeun Lee , Wonjong Rhee

Several recent works in communication systems have proposed to leverage the power of neural networks in the design of encoders and decoders. In this approach, these blocks can be tailored to maximize the transmission rate based on…

Information Theory · Computer Science 2020-07-15 Sina Molavipour , Germán Bassi , Mikael Skoglund

Reshef & Reshef recently published a paper in which they present a method called the Maximal Information Coefficient (MIC) that can detect all forms of statistical dependence between pairs of variables as sample size goes to infinity. While…

Machine Learning · Statistics 2013-08-28 Alexander Luedtke , Linh Tran

Text-to-image generation and image captioning are recently emerged as a new experimental paradigm to assess machine intelligence. They predict continuous quantity accompanied by their sampling techniques in the generation, making evaluation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jin-Hwa Kim , Yunji Kim , Jiyoung Lee , Kang Min Yoo , Sang-Woo Lee

This paper explores the Achievable Information Rate (AIR) of a diffusive Molecular Communication (MC) channel featuring a fully absorbing receiver that counts the absorbed particles during symbol time intervals (STIs) and resets the counter…

Information Theory · Computer Science 2023-08-08 Fardad Vakilipoor , Luca Barletta , Stefano Bregni , Maurizio Magarini

The ability to compress observational data and accurately estimate physical parameters relies heavily on informative summary statistics. In this paper, we introduce the use of mutual information (MI) as a means of evaluating the quality of…

Cosmology and Nongalactic Astrophysics · Physics 2023-07-12 Ce Sui , Xiaosheng Zhao , Tao Jing , Yi Mao

We investigate message identification over a K-sender Gaussian multiple access channel (K-GMAC). Unlike conventional Shannon transmission codes, the size of randomized identification (ID) codes experiences a doubly exponential growth in the…

Information Theory · Computer Science 2024-08-20 Yaning Zhao , Wafa Labidi , Holger Boche , Eduard Jorswieck , Christian Deppe

This work considers the multiuser multiple-input single-output (MISO) broadcast channel (BC), where a transmitter with M antennas transmits information to K single-antenna users, and where - as expected - the quality and timeliness of…

Information Theory · Computer Science 2013-02-05 Jinyuan Chen , Sheng Yang , Petros Elia

An alternative to extrinsic information transfer (EXIT) charts called mean squared error (MSE) charts that use a measure related to the MSE instead of mutual information is proposed. Using the relationship between mutual information and…

Information Theory · Computer Science 2007-07-13 Kapil Bhattad , Krishna Narayanan

The use of Mutual Information (MI) as a measure to evaluate the efficiency of cryptosystems has an extensive history. However, estimating MI between unknown random variables in a high-dimensional space is challenging. Recent advances in…

We consider the information fiber optical channel modeled by the nonlinear Schrodinger equation with additive Gaussian noise. Using path-integral approach and perturbation theory for the small dimensionless parameter of the second…

Information Theory · Computer Science 2023-08-03 A. V. Reznichenko , V. O. Guba

Smart wireless environments enabled by multiple distributed Reconfigurable Intelligent Surfaces (RISs) have recently attracted significant research interest as a wireless connectivity paradigm for sixth Generation (6G) networks. In this…

Information Theory · Computer Science 2024-10-11 Aris L. Moustakas , George C. Alexandropoulos

We consider the problem of shared randomness-assisted multiple access channel (MAC) simulation for product inputs and characterize the one-shot communication cost region via almost-matching inner and outer bounds in terms of the smooth…

Information Theory · Computer Science 2026-03-26 Aditya Nema , Sreejith Sreekumar , Mario Berta

It is challenging to precisely configure the phase shifts of the reflecting elements at the reconfigurable intelligent surface (RIS) due to inherent hardware impairments (HIs). In this paper, the mean square error (MSE) performance is…

Information Theory · Computer Science 2022-08-17 Jingwen Zhao , Ming Chen , Cunhua Pan , Zhiyang Li , Gui Zhou , Xiao Chen

In the context of a time-varying multiuser multiple-input-multiple-output (MIMO) system, we design recursive least squares based adaptive predictors and differential quantizers to minimize the sum mean squared error of the overall system.…

Information Theory · Computer Science 2014-02-11 Muhammad Nazmul Islam , Raviraj Adve

The vacuum mutual information (MI) of subregion algebras provides a universal window into the data of general conformal field theories (CFTs). Exploiting the geometric nature of the modular flow associated to ball-shaped regions and the…

High Energy Physics - Theory · Physics 2026-04-23 César A. Agón , Pablo Bueno , Adem Deniz Piskin , Guido van der Velde

The design of informatively rich input signals is essential for accurate system identification, yet classical Fisher-information-based methods are inherently local and often inadequate in the presence of significant model uncertainty and…

Statistics Theory · Mathematics 2025-12-15 Piotr Bania , Anna Wójcik

A two-user discrete memoryless compound multiple access channel with a common message and conferencing decoders is considered. The capacity region is characterized in the special cases of physically degraded channels and unidirectional…

Information Theory · Computer Science 2016-11-18 O. Simeone , D. Gunduz , H. V. Poor , A. Goldsmith , S. Shamai

We present a method to compute, quickly and efficiently, the mutual information achieved by an IID (independent identically distributed) complex Gaussian input on a block Rayleigh-faded channel without side information at the receiver. The…

Information Theory · Computer Science 2010-01-14 Fredrik Rusek , Angel Lozano , Nihar Jindal