English
Related papers

Related papers: Assessing Information Transmission in Data Transfo…

200 papers

Most of the existing classification methods are aimed at minimization of empirical risk (through some simple point-based error measured with loss function) with added regularization. We propose to approach this problem in a more information…

Machine Learning · Computer Science 2015-01-22 Wojciech Marian Czarnecki , Jacek Tabor

Entropy estimation is of practical importance in information theory and statistical science. Many existing entropy estimators suffer from fast growing estimation bias with respect to dimensionality, rendering them unsuitable for…

Information Theory · Computer Science 2023-08-22 Ziqiao Ao , Jinglai Li

From a machine learning point of view, identifying a subset of relevant features from a real data set can be useful to improve the results achieved by classification methods and to reduce their time and space complexity. To achieve this…

Machine Learning · Computer Science 2017-05-23 Pietro Cassara , Alessandro Rozza , Mirco Nanni

Information theory is an outstanding framework to measure uncertainty, dependence and relevance in data and systems. It has several desirable properties for real world applications: it naturally deals with multivariate data, it can handle…

Machine Learning · Statistics 2024-10-30 Valero Laparra , J. Emmanuel Johnson , Gustau Camps-Valls , Raul Santos-Rodríguez , Jesus Malo

The translation of written language has been known since the 3rd century BC; however, its necessity has become increasingly common in the information age. Today, many translators exist, based on encoder-decoder deep architectures,…

Computation and Language · Computer Science 2025-11-18 Ronit D. Gross , Yanir Harel , Ido Kanter

While most successful approaches for machine reading comprehension rely on single training objective, it is assumed that the encoder layer can learn great representation through the loss function we define in the predict layer, which is…

Computation and Language · Computer Science 2022-11-18 Yifeng Xie

Information theory provides principled ways to analyze different inference and learning problems such as hypothesis testing, clustering, dimensionality reduction, classification, among others. However, the use of information theoretic…

Machine Learning · Computer Science 2014-09-03 Luis G. Sanchez Giraldo , Murali Rao , Jose C. Principe

Cells can be considered as systems that utilize changes in thermodynamic entropy as information. Therefore, they serve as useful models for investigating the relationships between entropy production and information transmission, i.e.,…

Molecular Networks · Quantitative Biology 2017-03-09 Tatsuaki Tsuruyama

Mutual information is widely applied to learn latent representations of observations, whilst its implication in classification neural networks remain to be better explained. We show that optimising the parameters of classification neural…

Machine Learning · Computer Science 2020-09-18 Zhenyue Qin , Dongwoo Kim , Tom Gedeon

Transfer Entropy, a generalisation of Granger Causality, promises to measure "information transfer" from a source to a target signal by ignoring self-predictability of a target signal when quantifying the source-target relationship. A…

Neurons and Cognition · Quantitative Biology 2022-05-23 Christoph Daube , Joachim Gross , Robin A. A. Ince

Information-theoretic quantities, such as entropy, are used to quantify the amount of information a given variable provides. Entropies can be used together to compute the mutual information, which quantifies the amount of information two…

Data Analysis, Statistics and Probability · Physics 2014-12-22 Kevin H. Knuth , Deniz Gençağa , William B. Rossow

Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms,…

Methodology · Statistics 2017-08-21 Luca Faes , Daniele Marinazzo , Sebastiano Stramaglia

Phase-transition phenomena in deep learning (grokking, emergent capabilities, and ontological reorganization under context shift) have been studied through several lenses, including representational compression, singular learning theory,…

Machine Learning · Computer Science 2026-05-19 Truong Xuan Khanh

We propose a novel tensor-based formalism for inferring causal structures from time series. An information theoretical analysis of transfer entropy, shows that transfer entropy results from transmission of information over a set of…

Information Theory · Computer Science 2020-04-22 David Sigtermans

Imaging systems are commonly described using resolution, contrast, and signal-to-noise ratio, but these quantities do not provide a general account of how physical transformations affect the flow of information. This paper introduces an…

Image and Video Processing · Electrical Eng. & Systems 2026-02-11 Charles Wood

Using the formalism of information theory, we analyze the mechanism of information transduction in a simple one-step signaling cascade S$\rightarrow$X representing the gene regulatory network. Approximating the signaling channel to be…

Molecular Networks · Quantitative Biology 2018-11-14 Mintu Nandi , Ayan Biswas , Suman K Banik , Pinaki Chaudhury

Tabular data inherently exhibits significant feature heterogeneity, but existing transformer-based methods lack specialized mechanisms to handle this property. To bridge the gap, we propose MAYA, an encoder-decoder transformer-based…

Machine Learning · Computer Science 2025-09-23 Xuechen Li , Yupeng Li , Jian Liu , Xiaolin Jin , Xin Hu

The information shared among observables representing processes of interest is traditionally evaluated in terms of macroscale measures characterizing aggregate properties of the underlying processes and their interactions. Traditional…

Information Theory · Computer Science 2018-01-31 Rui A. P. Perdigão

Information theoretic measures (entropies, entropy rates, mutual information) are nowadays commonly used in statistical signal processing for real-world data analysis. The present work proposes the use of Auto Mutual Information (Mutual…

Data Analysis, Statistics and Probability · Physics 2019-07-24 C Granero-Belinchón , S. Roux , P. Abry , N. Garnier

We explore the connection between deep learning and information theory through the paradigm of diffusion models. A diffusion model converts noise into structured data by reinstating, imperfectly, information that is erased when data was…

Machine Learning · Computer Science 2025-11-04 Akhil Premkumar