English
Related papers

Related papers: Mutual Information Approximation

200 papers

Mixed noise, composed of white Gaussian noise (WGN) and impulsive noise (IN), appears in numerous communication scenarios and can severely degrade system performance. In this paper, we optimize the transmitted constellation under mixed…

Signal Processing · Electrical Eng. & Systems 2025-09-09 Tianfu Qi , Jun Wang

In this article, we introduce iterative deterministic equivalents as a novel technique for the performance analysis of communication systems whose channels are modeled by complex combinations of independent random matrices. This technique…

Information Theory · Computer Science 2011-12-20 Jakob Hoydis , Romain Couillet , Merouane Debbah

A waveform channel is considered where the transmitted signal is corrupted by Wiener phase noise and additive white Gaussian noise (AWGN). A discrete-time channel model is introduced that is based on a multi-sample receiver. Tight lower…

Information Theory · Computer Science 2013-03-28 Hassan Ghozlan , Gerhard Kramer

Mutual information (MI) is a general measure of statistical dependence with widespread application across the sciences. However, estimating MI between multi-dimensional variables is challenging because the number of samples necessary to…

Quantitative Methods · Quantitative Biology 2025-03-06 Gokul Gowri , Xiao-Kang Lun , Allon M. Klein , Peng Yin

Traditional channel capacity based on the discrete spatial dimensions mismatches the continuous electromagnetic fields. For the wireless communication system in a limited region, the spatial discretization may results in information loss…

Information Theory · Computer Science 2023-02-21 Zhongzhichao Wan , Jieao Zhu , Zijian Zhang , Linglong Dai , Chan-Byoung Chae

Mutual information (MI) is a promising candidate measure for the assessment and optimization of localization systems, as it captures nonlinear dependencies between random variables. However, the high cost of computing MI, especially for…

Signal Processing · Electrical Eng. & Systems 2025-11-04 Sven Hinderer , Manuel Buchfink , Bin Yang

This paper considers the distribution of the mutual information of frequency-selective spatially-uncorrelated Rayleigh fading MIMO channels. Results are presented for OFDM-based spatial multiplexing. New exact closed-form expressions are…

Information Theory · Computer Science 2016-11-17 Matthew R. McKay , Peter J. Smith , Himal A. Suraweera , Iain B. Collings

Noise is a vital factor in determining the accuracy of processing the information of the quantum channel. One must consider classical noise effects associated with quantum noise sources for more realistic modelling of quantum channels. A…

Signal Processing · Electrical Eng. & Systems 2024-09-10 Mouli Chakraborty , Anshu Mukherjee , Ioannis Krikidis , Avishek Nag , Subhash Chandra

Non-Gaussian impulsive noise (IN) with memory exists in many practical applications. When it is mixed with white Gaussian noise (WGN), the resultant mixed noise will be bursty. The performance of communication systems will degrade…

Signal Processing · Electrical Eng. & Systems 2024-02-12 Tianfu Qi , Jun Wang

We consider the characterization of the asymptotic behavior of the average minimum mean-squared error (MMSE) and the average mutual information in scalar and vector fading coherent channels, where the receiver knows the exact fading channel…

Information Theory · Computer Science 2012-10-17 Alberto Gil C. P. Ramos , Miguel R. D. Rodrigues

The minimum mean-square error of the estimation of a signal where observed from the additive white Gaussian noise (WGN) channel's output, is analyzed. It is assumed that the channel input's signal is composed of a (normalized) sum of N…

Information Theory · Computer Science 2007-07-13 Jacob Binia

The construction of optimal non-uniform mappings for discrete input memoryless channels (DIMCs) is investigated. An efficient algorithm to find optimal mappings is proposed and the rate by which a target distribution is approached is…

Information Theory · Computer Science 2014-07-09 Georg Böcherer

Reconfigurable intelligent surface (RIS) is very promising for wireless networks to achieve high energy efficiency, extended coverage, improved capacity, massive connectivity, etc. To unleash the full potentials of RIS-aided communications,…

Information Theory · Computer Science 2022-01-03 Yabo Guo , Peng Sun , Zhengdao Yuan , Chongwen Huang , Qinghua Guo , Zhongyong Wang , Chau Yuen

A continuous-time model for the additive white Gaussian noise (AWGN) channel in the presence of white (memoryless) phase noise is proposed and discussed. It is shown that for linear modulation the output of the baud-sampled filter matched…

Information Theory · Computer Science 2014-04-29 Luca Barletta , Gerhard Kramer

It is very difficult to solve the Maximum Mutual Information (MMI) or Maximum Likelihood (ML) for all possible Shannon Channels or uncertain rules of choosing hypotheses, so that we have to use iterative methods. According to the Semantic…

Information Theory · Computer Science 2017-06-27 Chenguang Lu

Mutual information (MI) is a fundamental measure of statistical dependence between two variables, yet accurate estimation from finite data remains notoriously difficult. No estimator is universally reliable, and common approaches fail in…

Data Analysis, Statistics and Probability · Physics 2025-10-02 Eslam Abdelaleem , K. Michael Martini , Ilya Nemenman

A new trend in deep learning, represented by Mutual Information Neural Estimation (MINE) and Information Noise Contrast Estimation (InfoNCE), is emerging. In this trend, similarity functions and Estimated Mutual Information (EMI) are used…

Information Theory · Computer Science 2023-05-25 Chenguang Lu

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2008-06-26 Marco Zaffalon , Marcus Hutter

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2014-08-08 Marco Zaffalon , Marcus Hutter

The Maximum Mutual Information (MMI) criterion is different from the Least Error Rate (LER) criterion. It can reduce failing to report small probability events. This paper introduces the Channels Matching (CM) algorithm for the MMI…

Machine Learning · Computer Science 2019-01-30 Chenguang Lu
‹ Prev 1 4 5 6 7 8 10 Next ›