English
Related papers

Related papers: Partial information decomposition: redundancy as i…

200 papers

To characterize the complex higher-order interactions among variables within a system, this study introduces a novel framework, termed System Information Decomposition (SID), aimed at decomposing the information entropy of variables into…

Information Theory · Computer Science 2024-11-12 Aobo Lyu , Bing Yuan , Ou Deng , Mingzhe Yang , Jiang Zhang

Learning invariant (causal) features for out-of-distribution (OOD) generalization has attracted extensive attention recently, and among the proposals invariant risk minimization (IRM) is a notable solution. In spite of its theoretical…

Machine Learning · Computer Science 2023-02-01 Bin Deng , Kui Jia

Information theory has inspired numerous advancements in multi-view learning. Most multi-view methods incorporating information-theoretic principles rely an assumption called multi-view redundancy which states that common information…

Machine Learning · Computer Science 2025-09-03 Long Shi , Yunshan Ye , Wenjie Wang , Tao Lei , Yu Zhao , Gang Kou , Badong Chen

The feature attribution method reveals the contribution of input variables to the decision-making process to provide an attribution map for explanation. Existing methods grounded on the information bottleneck principle compute information…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jung-Ho Hong , Ho-Joong Kim , Kyu-Sung Jeon , Seong-Whan Lee

In the past decade, deep neural networks have seen unparalleled improvements that continue to impact every aspect of today's society. With the development of high performance GPUs and the availability of vast amounts of data, learning…

Machine Learning · Computer Science 2021-05-12 Mohammad Ali Alomrani

This paper investigates a multi-terminal source coding problem under a logarithmic loss fidelity which does not necessarily lead to an additive distortion measure. The problem is motivated by an extension of the Information Bottleneck…

Information Theory · Computer Science 2021-11-29 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Information bottleneck (IB) and privacy funnel (PF) are two closely related optimization problems which have found applications in machine learning, design of privacy algorithms, capacity problems (e.g., Mrs. Gerber's Lemma), strong data…

Information Theory · Computer Science 2020-12-30 Shahab Asoodeh , Flavio Calmon

Distributional discrepancy between training and test data can lead models to make inaccurate predictions when encountering out-of-distribution (OOD) samples in real-world applications. Although existing graph OOD detection methods leverage…

Machine Learning · Computer Science 2025-10-17 Yue Hou , He Zhu , Ruomei Liu , Yingke Su , Junran Wu , Ke Xu

Retrieval-augmented generation integrates the capabilities of large language models with relevant information retrieved from an extensive corpus, yet encounters challenges when confronted with real-world noisy data. One recent solution is…

Computation and Language · Computer Science 2025-09-30 Kun Zhu , Xiaocheng Feng , Xiyuan Du , Yuxuan Gu , Weijiang Yu , Haotian Wang , Qianglong Chen , Zheng Chu , Jingchang Chen , Bing Qin

The information bottleneck (IB) method offers an attractive framework for understanding representation learning, however its applications are often limited by its computational intractability. Analytical characterization of the IB method is…

Information Theory · Computer Science 2023-04-03 Vudtiwat Ngampruetikorn , David J. Schwab

This paper investigates task-oriented communication for edge inference, where a low-end edge device transmits the extracted feature vector of a local data sample to a powerful edge server for processing. It is critical to encode the data…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Jiawei Shao , Yuyi Mao , Jun Zhang

Invariant risk minimization (IRM) has recently emerged as a promising alternative for domain generalization. Nevertheless, the loss function is difficult to optimize for nonlinear classifiers and the original optimization objective could…

Machine Learning · Computer Science 2022-03-22 Bo Li , Yifei Shen , Yezhen Wang , Wenzhen Zhu , Colorado J. Reed , Jun Zhang , Dongsheng Li , Kurt Keutzer , Han Zhao

The inference of causal relationships using observational data from partially observed multivariate systems with hidden variables is a fundamental question in many scientific domains. Methods extracting causal information from conditional…

Machine Learning · Statistics 2020-10-13 Daniel Chicharro , Michel Besserve , Stefano Panzeri

We quantify the average amount of redundant information that is transferred from a subset of relevant random source processes to a target process. To identify the relevant source processes, we consider those that are connected to the target…

Information Theory · Computer Science 2024-05-02 Jan Østergaard

Pretrained transformers achieve the state of the art across tasks in natural language processing, motivating researchers to investigate their inner mechanisms. One common direction is to understand what features are important for…

Computation and Language · Computer Science 2021-08-06 Zhiying Jiang , Raphael Tang , Ji Xin , Jimmy Lin

For readers already familiar with Partial Information Decomposition (PID), we show that PID's definition of synergy enables quantifying at least four different notions of irreducibility. First, we show four common notions of "parts" give…

Information Theory · Computer Science 2013-12-13 Virgil Griffith , Jonathan Harel

Multimodal models trained on complete modality data often exhibit a substantial decrease in performance when faced with imperfect data containing corruptions or missing modalities. To address this robustness challenge, prior methods have…

Multimedia · Computer Science 2023-10-24 Mengxi Chen , Jiangchao Yao , Linyu Xing , Yu Wang , Ya Zhang , Yanfeng Wang

The Information Bottleneck (IB) provides an information theoretic principle for representation learning, by retaining all information relevant for predicting label while minimizing the redundancy. Though IB principle has been applied to a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Xudong Tian , Zhizhong Zhang , Shaohui Lin , Yanyun Qu , Yuan Xie , Lizhuang Ma

Packets originated from an information source in the network can be highly correlated. These packets are often routed through different paths, and compressing them requires to process them individually. Traditional universal compression…

Information Theory · Computer Science 2019-01-14 Ahmad Beirami , Faramarz Fekri

Multiview data contain information from multiple modalities and have potentials to provide more comprehensive features for diverse machine learning tasks. A fundamental question in multiview analysis is what is the additional information…

Machine Learning · Computer Science 2021-05-18 Feng Bao