English
Related papers

Related papers: Mutual-Information Based Optimal Experimental Desi…

200 papers

Mutual Information (MI) is a powerful statistical measure that quantifies shared information between random variables, particularly valuable in high-dimensional data analysis across fields like genomics, natural language processing, and…

Machine Learning · Computer Science 2024-12-02 Andre O. Falcao

This paper studies the ergodic mutual information of hybrid selection/maximal-ratio combining (H-S/MRC) diversity system under BPSK/QPSK modulations. We consider a simple single-input multiple-output (SIMO) channel, where a subset of…

Signal Processing · Electrical Eng. & Systems 2019-06-20 Zeliang Ou , Chongjun Ouyang , Pei Yang , Lu Zhang , Hongwen Yang , Xin Zhang

We introduce a novel geometric framework for optimal experimental design (OED). Traditional OED approaches, such as those based on mutual information, rely explicitly on probability densities, leading to restrictive invariance properties.…

Machine Learning · Statistics 2025-10-17 Gavin Kerrigan , Christian A. Naesseth , Tom Rainforth

Multivariate pattern analyses approaches in neuroimaging are fundamentally concerned with investigating the quantity and type of information processed by various regions of the human brain; typically, estimates of classification accuracy…

Machine Learning · Statistics 2016-10-11 Charles Y. Zheng , Yuval Benjamini

Task-adapted compressed sensing magnetic resonance imaging (CS-MRI) is emerging to address the specific demands of downstream clinical tasks with significantly fewer k-space measurements than required by Nyquist sampling. However, existing…

Machine Learning · Computer Science 2026-04-15 Xinyu Peng , Ziyang Zheng , Wenrui Dai , Duoduo Xue , Shaohui Li , Chenglin Li , Junni Zou , Hongkai Xiong

Estimating mutual information accurately is pivotal across diverse applications, from machine learning to communications and biology, enabling us to gain insights into the inner mechanisms of complex systems. Yet, dealing with…

Machine Learning · Computer Science 2024-11-12 Nunzio A. Letizia , Nicola Novello , Andrea M. Tonello

Because of the kinematic reversibility of the Stokes equation, fluid mixing at the microscale requires an interplay between advection and diffusion. Here we introduce mutual information between particle positions before and after mixing as…

Fluid Dynamics · Physics 2024-06-04 Yihong Shi , Ramin Golestanian , Andrej Vilfan

Data transmission rate in molecular communication systems can be improved by using multiple transmitters and receivers. In molecular multiple-input multiple-output (MIMO) systems which use only single type of molecules, the performance at…

Information Theory · Computer Science 2019-04-23 Nithin V. Sabu , Neeraj Varshney , Abhishek K. Gupta

Estimating Mutual Information (MI), a key measure of dependence of random quantities without specific modelling assumptions, is a challenging problem in high dimensions. We propose a novel mutual information estimator based on parametrizing…

Machine Learning · Statistics 2025-10-24 Haoran Ni , Martin Lotz

Across a variety of scientific disciplines, sparse inverse covariance estimation is a popular tool for capturing the underlying dependency relationships in multivariate data. Unfortunately, most estimators are not scalable enough to handle…

Magnetic resonance imaging (MRI) is mainly limited by long scanning time and vulnerable to human tissue motion artifacts, in 3D clinical scenarios. Thus, k-space undersampling is used to accelerate the acquisition of MRI while leading to…

Image and Video Processing · Electrical Eng. & Systems 2022-01-11 Shengke Xue , Ruiliang Bai , Xinyu Jin

Mutual information provides a powerful, general-purpose metric for quantifying the amount of shared information between variables. Estimating normalized mutual information using a k-Nearest Neighbor (k-NN) based approach involves the…

Information Theory · Computer Science 2025-07-10 Marko Tuononen , Ville Hautamäki

Quantitative magnetic resonance imaging (qMRI) allows images to be compared across sites and time points, which is particularly important for assessing long-term conditions or for longitudinal studies. The multiparametric mapping (MPM)…

Signal Processing · Electrical Eng. & Systems 2024-10-24 Klara Baś , Christian Lambert , John Ashburner

Mutual information (MI) is a useful information-theoretic measure to quantify the statistical dependence between two random variables: $X$ and $Y$. Often, we are interested in understanding how the dependence between $X$ and $Y$ in one set…

Information Theory · Computer Science 2025-07-22 Chetan Gohil , Oliver M Cliff , James M. Shine , Ben D. Fulcher , Joseph T. Lizier

Mutual information (MI) is an information-theoretic measure of dependency between two random variables. Several methods to estimate MI, from samples of two random variables with unknown underlying probability distributions have been…

Machine Learning · Computer Science 2020-11-18 P Aditya Sreekar , Ujjwal Tiwari , Anoop Namboodiri

Multi-modal magnetic resonance imaging (MRI) provides information of lesions for computer-aided diagnosis from different views. Deep learning algorithms are suitable for identifying specific anatomical structures, segmenting lesions, and…

Image and Video Processing · Electrical Eng. & Systems 2025-01-17 Linxuan Han , Sa Xiao , Zimeng Li , Haidong Li , Xiuchao Zhao , Yeqing Han , Fumin Guo , Xin Zhou

This paper proposes an Incremental Learning (IL) approach to enhance the accuracy and efficiency of deep learning models in analyzing T2-weighted (T2w) MRI medical images prostate cancer detection using the PI-CAI dataset. We used multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Sara Yavari , Jacob Furst

Mutual information (MI) is one of the most general ways to measure relationships between random variables, but estimating this quantity for complex systems is challenging. Denoising diffusion models have recently set a new bar for density…

Machine Learning · Computer Science 2025-11-20 Longxuan Yu , Xing Shi , Xianghao Kong , Tong Jia , Greg Ver Steeg

Stacked intelligent metasurface (SIM) is a promising enabler for next-generation high-capacity networks that exhibit better performance compared to its single-layer counterpart by means of just wave propagation. However, the study of…

Information Theory · Computer Science 2025-10-24 Anastasios Papazafeiropoulos , Pandelis Kourtessis , Dimitra I. Kaklamani , Iakovos S. Venieris

Inverse Ising inference allows pairwise interactions of complex binary systems to be reconstructed from empirical correlations. Typical estimators used for this inference, such as Pseudo-likelihood maximization (PLM), are biased. Using the…

Disordered Systems and Neural Networks · Physics 2023-07-19 Maximilian Benedikt Kloucek , Thomas Machon , Shogo Kajimura , C. Patrick Royall , Naoki Masuda , Francesco Turci