English
Related papers

Related papers: Mutual Information Surprise: Rethinking Unexpected…

200 papers

Importance sampling (IS) is a popular technique in off-policy evaluation, which re-weights the return of trajectories in the replay buffer to boost sample efficiency. However, training with IS can be unstable and previous attempts to…

Machine Learning · Computer Science 2025-05-20 Chengyang Ying , Zhongkai Hao , Xinning Zhou , Hang Su , Dong Yan , Jun Zhu

Normalized mutual information is widely used as a similarity measure for evaluating the performance of clustering and classification algorithms. In this paper, we argue that results returned by the normalized mutual information are biased…

Social and Information Networks · Computer Science 2025-12-23 Maximilian Jerdee , Alec Kirkley , M. E. J. Newman

Reconfigurable Intelligent Surfaces (RISs) are regarded as a key technology for future wireless communications, enabling programmable radio propagation environments. However, the passive reflecting feature of RISs induces notable challenges…

Signal Processing · Electrical Eng. & Systems 2022-02-15 Liuhang Wang , Nir Shlezinger , George C. Alexandropoulos , Haiyang Zhang , Baoyun Wang , Yonina C. Elda

Shannon defined the mutual information between two variables. We illustrate why the true mutual information between a variable and the predictions made by a prediction algorithm is not a suitable measure of prediction quality, but the…

Statistics Theory · Mathematics 2025-04-11 Roger Sewell

Providing natural language-based explanations to justify recommendations helps to improve users' satisfaction and gain users' trust. However, as current explanation generation methods are commonly trained with an objective to mimic existing…

Information Retrieval · Computer Science 2024-08-22 Yurou Zhao , Yiding Sun , Ruidong Han , Fei Jiang , Lu Guan , Xiang Li , Wei Lin , Weizhi Ma , Jiaxin Mao

The major challenge of offline RL is the distribution shift that appears when out-of-distribution actions are queried, which makes the policy improvement direction biased by extrapolation errors. Most existing methods address this problem…

Machine Learning · Computer Science 2024-02-29 Xiao Ma , Bingyi Kang , Zhongwen Xu , Min Lin , Shuicheng Yan

We envision future technologies through science fiction, strategic planning, or academic research. Yet, our expectations do not always match with what actually unfolds, much like navigating a story where some events align with expectations…

Physics and Society · Physics 2024-12-12 Oh-Hyun Kwon , Jisung Yoon , Lav R. Varshney , Woo-Sung Jung , Hyejin Youn

Reconfigurable intelligent surfaces (RISs) are an emerging technology for enhancing the performance of wireless networks at a low and affordable cost, complexity, and power consumption. We introduce an algorithm for optimizing a…

Information Theory · Computer Science 2020-12-01 Xuewen Qian , Marco Di Renzo

Machine learning approaches commonly rely on the assumption of independent and identically distributed (i.i.d.) data. In reality, however, this assumption is almost always violated due to distribution shifts between environments. Although…

Machine Learning · Computer Science 2022-10-18 Ronan Perry , Julius von Kügelgen , Bernhard Schölkopf

Variational approaches based on neural networks are showing promise for estimating mutual information (MI) between high dimensional variables. However, they can be difficult to use in practice due to poorly understood bias/variance…

Machine Learning · Computer Science 2020-03-25 Jiaming Song , Stefano Ermon

Masked autoencoders (MAEs) represent a prominent self-supervised learning paradigm in computer vision. Despite their empirical success, the underlying mechanisms of MAEs remain insufficiently understood. Recent studies have attempted to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Tao Huang , Yanxiang Ma , Shan You , Chang Xu

CTR prediction is essential for modern recommender systems. Ranging from early factorization machines to deep learning based models in recent years, existing CTR methods focus on capturing useful feature interactions or mining important…

Information Retrieval · Computer Science 2022-01-31 Wei Guo , Can Zhang , Zhicheng He , Jiarui Qin , Huifeng Guo , Bo Chen , Ruiming Tang , Xiuqiang He , Rui Zhang

The persistent mutual information (PMI) is a complexity measure for stochastic processes. It is related to well-known complexity measures like excess entropy or statistical complexity. Essentially it is a variation of the excess entropy so…

Mathematical Physics · Physics 2012-10-19 Peter Gmeiner

We derive a well-defined renormalized version of mutual information that allows to estimate the dependence between continuous random variables in the important case when one is deterministically dependent on the other. This is the situation…

Machine Learning · Computer Science 2021-05-26 Leopoldo Sarra , Andrea Aiello , Florian Marquardt

Computer simulators can be computationally intensive to run over a large number of input values, as required for optimization and various uncertainty quantification tasks. The standard paradigm for the design and analysis of computer…

Computation · Statistics 2015-09-11 Joakim Beck , Serge Guillas

Estimating Mutual Information (MI), a key measure of dependence of random quantities without specific modelling assumptions, is a challenging problem in high dimensions. We propose a novel mutual information estimator based on parametrizing…

Machine Learning · Statistics 2025-10-24 Haoran Ni , Martin Lotz

Mutual information $I(X;Y)$ is a useful definition in information theory to estimate how much information the random variable $Y$ holds about the random variable $X$. One way to define the mutual information is by comparing the joint…

Information Theory · Computer Science 2022-04-14 Bulut Kuskonmaz , Jaron Skovsted Gundersen , Rafal Wisniewski

A sequence of social sensors estimate an unknown parameter (modeled as a state of nature) by performing Bayesian Social Learning, and myopically optimize individual reward functions. The decisions of the social sensors contain quantized…

Social and Information Networks · Computer Science 2020-03-31 Sujay Bhatt , Vikram Krishnamurthy

A recommender system that optimizes its recommendations solely to fit a user's history of ratings for consumed items can create a filter bubble, wherein the user does not get to experience items from novel, unseen categories. One approach…

Information Retrieval · Computer Science 2023-10-20 Tonmoy Hasan , Razvan Bunescu

Recent theoretical advancement of information density in natural language has brought the following question on desk: To what degree does natural language exhibit periodicity pattern in its encoded information? We address this question by…

Computation and Language · Computer Science 2026-04-27 Yulin Ou , Yu Wang , Yang Xu , Hendrik Buschmeier