English
Related papers

Related papers: Fast Mutual Information Computation for Large Bina…

200 papers

The mutual information is a core statistical quantity that has applications in all areas of machine learning, whether this is in training of density models over multiple data modalities, in maximising the efficiency of noisy transmission…

Machine Learning · Statistics 2015-09-30 Shakir Mohamed , Danilo Jimenez Rezende

Modularity, first proposed by [Newman and Girvan, 2004], is one of the most popular ways to quantify the significance of community structure in complex networks. It can serve as both a standard benchmark to compare different community…

Social and Information Networks · Computer Science 2022-02-14 Qian Wang , Yongkang Guo , Zhihuan Huang , Yuqing Kong

Mutual information is a nonlinear measure used in time series analysis in order to measure the linear and non-linear correlations at any lag $\tau$. The aim of this study is to evaluate some of the most commonly used mutual information…

Chaotic Dynamics · Physics 2008-09-15 A. Papana , D. Kugiumtzis

Reconstructing the structural connectivity between interacting units from observed activity is a challenge across many different disciplines. The fundamental first step is to establish whether or to what extent the interactions between the…

Neurons and Cognition · Quantitative Biology 2016-11-02 Elliot A. Martin , Jaroslav Hlinka , Jörn Davidsen

Bioinformatics research is characterized by voluminous and incremental datasets and complex data analytics methods. The machine learning methods used in bioinformatics are iterative and parallel. These methods can be scaled to handle big…

Computational Engineering, Finance, and Science · Computer Science 2015-06-17 Hirak Kashyap , Hasin Afzal Ahmed , Nazrul Hoque , Swarup Roy , Dhruba Kumar Bhattacharyya

Simulation-based inference enables learning the parameters of a model even when its likelihood cannot be computed in practice. One class of methods uses data simulated with different parameters to infer models of the likelihood-to-evidence…

Machine Learning · Computer Science 2022-06-08 Giulio Isacchini , Natanael Spisak , Armita Nourmohammad , Thierry Mora , Aleksandra M. Walczak

Lower bounds on mutual information (MI) of long-haul optical fiber systems for hard-decision and soft-decision decoding are studied. Ready-to-use expressions to calculate the MI are presented. Extensive numerical simulations are used to…

Information Theory · Computer Science 2015-04-06 Tobias Fehenberger , Alex Alvarado , Polina Bayvel , Norbert Hanik

We address the practical problems of estimating the information relations that characterize large networks. Building on methods developed for analysis of the neural code, we show that reliable estimates of mutual information can be obtained…

Information Theory · Computer Science 2007-07-13 Noam Slonim , Gurinder S. Atwal , Gasper Tkacik , William Bialek

Estimating the mutual information from samples from a joint distribution is a challenging problem in both science and engineering. In this work, we realize a variational bound that generalizes both discriminative and generative approaches.…

Machine Learning · Statistics 2023-06-05 Marco Federici , David Ruhe , Patrick Forré

We propose novel techniques that exploit data and computation sharing to improve the performance of complex stateful parallel computations, like agent-based simulations. Parallel computations are translated into behavioral equations, a…

Databases · Computer Science 2025-04-15 Zilu Tian , Dan Olteanu , Christoph Koch

Recent contrastive representation learning methods rely on estimating mutual information (MI) between multiple views of an underlying context. E.g., we can derive multiple views of a given image by applying data augmentation, or we can…

Machine Learning · Computer Science 2021-06-28 Alessandro Sordoni , Nouha Dziri , Hannes Schulz , Geoff Gordon , Phil Bachman , Remi Tachet

The conditional mutual information I(X;Y|Z) measures the average information that X and Y contain about each other given Z. This is an important primitive in many learning problems including conditional independence testing, graphical model…

Information Theory · Computer Science 2017-10-16 Arman Rahimzamani , Sreeram Kannan

To provide an efficient approach to characterize the input-output mutual information (MI) under additive white Gaussian noise (AWGN) channel, this short report fits the curves of exact MI under multilevel quadrature amplitude modulation…

Information Theory · Computer Science 2019-08-27 Chongjun Ouyang , Sheng Wu , Hongwen Yang

Forecasting techniques for assessing the power of future experiments to discriminate between theories or discover new laws of nature are of great interest in many areas of science. In this paper, we introduce a Bayesian forecasting method…

Data Analysis, Statistics and Probability · Physics 2024-09-24 Mohammad Hossein Namjoo

While the quantum mutual information is a fundamental measure of quantum information, it is only defined for spacelike-separated quantum systems. Such a limitation is not present in the theory of classical information, where the mutual…

Quantum Physics · Physics 2024-10-04 James Fullwood , Zhen Wu , Arthur J. Parzygnat , Vlatko Vedral

Selective rationalization improves neural network interpretability by identifying a small subset of input features -- the rationale -- that best explains or supports the prediction. A typical rationalization criterion, i.e. maximum mutual…

Machine Learning · Computer Science 2020-03-24 Shiyu Chang , Yang Zhang , Mo Yu , Tommi S. Jaakkola

Curating, processing, and combining large-scale medical imaging datasets from national studies is a non-trivial task due to the intense computation and data throughput required, variability of acquired data, and associated financial…

We introduce the Mutual Information Machine (MIM), a probabilistic auto-encoder for learning joint distributions over observations and latent variables. MIM reflects three design principles: 1) low divergence, to encourage the encoder and…

Machine Learning · Computer Science 2020-02-24 Micha Livne , Kevin Swersky , David J. Fleet

Recently, token-level adaptive training has achieved promising improvement in machine translation, where the cross-entropy loss function is adjusted by assigning different training weights to different tokens, in order to alleviate the…

Computation and Language · Computer Science 2021-05-28 Yangyifan Xu , Yijin Liu , Fandong Meng , Jiajun Zhang , Jinan Xu , Jie Zhou

While deep learning excels in natural image and language processing, its application to high-dimensional data faces computational challenges due to the dimensionality curse. Current large-scale data tools focus on business-oriented…

Machine Learning · Computer Science 2025-07-01 Chen Zhang