English
Related papers

Related papers: An Information Bottleneck Problem with R\'enyi's E…

200 papers

In the context of statistical learning, the Information Bottleneck method seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description…

Information Theory · Computer Science 2021-02-16 Mohammad Mahdi Mahvari , Mari Kobayashi , Abdellatif Zaidi

In this work, we generalize the information bottleneck (IB) approach to the multi-view learning context. The exponentially growing complexity of the optimal representation motivates the development of two novel formulations with more…

Information Theory · Computer Science 2022-09-20 Teng-Hui Huang , Aly El Gamal , Hesham El Gamal

This tutorial paper focuses on the variants of the bottleneck problem taking an information theoretic perspective and discusses practical methods to solve it, as well as its connection to coding and learning aspects. The intimate…

Information Theory · Computer Science 2020-02-19 Abdellatif Zaidi , Inaki Estella Aguerri , Shlomo Shamai

Accounting for the non-normality of asset returns remains challenging in robust portfolio optimization. In this article, we tackle this problem by assessing the risk of the portfolio through the "amount of randomness" conveyed by its…

Portfolio Management · Quantitative Finance 2018-07-03 Nathan Lassance , Frédéric Vrins

The information bottleneck (IB) principle has been adopted to explain deep learning in terms of information compression and prediction, which are balanced by a trade-off hyperparameter. How to optimize the IB principle for better robustness…

Machine Learning · Computer Science 2021-03-04 Penglong Zhai , Shihua Zhang

In this paper, we consider contention resolution algorithms that are augmented with predictions about the network. We begin by studying the natural setup in which the algorithm is provided a distribution defined over the possible network…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-27 Seth Gilbert , Calvin Newport , Nitin Vaidya , Alex Weaver

An uncertainty relation for the R\'enyi entropies of conjugate quantum observables is used to obtain a strong Heisenberg limit of the form ${\rm RMSE} \geq f(\alpha)/(\langle N\rangle+\frac12)$, bounding the root mean square error of any…

Quantum Physics · Physics 2022-11-21 Michael J. W. Hall

Information bottleneck (IB) is a paradigm to extract information in one target random variable from another relevant random variable, which has aroused great interest due to its potential to explain deep neural networks in terms of…

Information Theory · Computer Science 2023-08-23 Lingyi Chen , Shitong Wu , Wenhao Ye , Huihui Wu , Hao Wu , Wenyi Zhang , Bo Bai , Yining Sun

The muti-layer information bottleneck (IB) problem, where information is propagated (or successively refined) from layer to layer, is considered. Based on information forwarded by the preceding layer, each stage of the network is required…

Machine Learning · Statistics 2017-11-15 Qianqian Yang , Pablo Piantanida , Deniz Gündüz

Large Language Models increasingly rely on self-explanations, such as chain of thought reasoning, to improve performance on multi step question answering. While these explanations enhance accuracy, they are often verbose and costly to…

Computation and Language · Computer Science 2026-02-17 Ali Zahedzadeh , Behnam Bahrak

We formulate and analyze the compound information bottleneck programming. In this problem, a Markov chain $ \mathsf{X} \rightarrow \mathsf{Y} \rightarrow \mathsf{Z} $ is assumed with fixed marginal distributions $\mathsf{P}_{\mathsf{X}}$…

Information Theory · Computer Science 2022-05-11 Michael Dikshtein , Nir Weinberger , Shlomo Shamai

The optimal transport problem studies how to transport one measure to another in the most cost-effective way and has wide range of applications from economics to machine learning. In this paper, we introduce and study an information…

Information Theory · Computer Science 2020-08-25 Yikun Bai , Xiugang Wu , Ayfer Ozgur

It is known that given the real sum of two independent uniformly distributed lattice points from the same nested lattice codebook, the eavesdropper can obtain at most 1 bit of information per channel regarding the value of one of the…

Information Theory · Computer Science 2009-10-15 Xiang He , Aylin Yener

Information is a valuable asset for agents in socio-economic systems, a significant part of the information being entailed into the very network of connections between agents. The different interlinkages patterns that agents establish may,…

Social and Information Networks · Computer Science 2018-07-20 Paolo Barucca , Guido Caldarelli , Tiziano Squartini

The presence of symmetries imposes a stringent set of constraints on a system. This constrained structure allows intelligent agents interacting with such a system to drastically improve the efficiency of learning and generalization, through…

Information Theory · Computer Science 2024-10-03 Hippolyte Charvin , Nicola Catenacci Volpi , Daniel Polani

Estimation of Shannon and R\'enyi entropies of unknown discrete distributions is a fundamental problem in statistical property testing and an active research topic in both theoretical computer science and information theory. Tight bounds on…

Quantum Physics · Physics 2023-07-19 Tongyang Li , Xiaodi Wu

We derive the amount of information retrieved by a quantum measurement in estimating an unknown maximally entangled state, along with the pertaining disturbance on the state itself. The optimal tradeoff between information and disturbance…

Quantum Physics · Physics 2007-05-23 Massimiliano F. Sacchi

The concept of Shannon entropy of random variables was generalized to measurable functions in general, and to simple functions with finite values in particular. It is shown that the information measure of a function is related to the time…

Information Theory · Computer Science 2017-01-25 Guo Zhao

The R\'enyi and Shannon entropies are information-theoretic measures which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation.…

Quantum Physics · Physics 2013-05-24 Pablo Sánchez-Moreno , Steeve Zozor , Jesus S. Dehesa

The matrix-based R\'enyi's entropy allows us to directly quantify information measures from given data, without explicit estimation of the underlying probability distribution. This intriguing property makes it widely applied in statistical…

Machine Learning · Computer Science 2022-12-01 Yuxin Dong , Tieliang Gong , Shujian Yu , Hong Chen , Chen Li