English
Related papers

Related papers: Ribbons from Independence Structure: Hypercontract…

200 papers

This paper proposes a geometric estimator of dependency between a pair of multivariate samples. The proposed estimator of dependency is based on a randomly permuted geometric graph (the minimal spanning tree) over the two multivariate…

Machine Learning · Computer Science 2019-10-02 Salimeh Yasaei Sekeh , Alfred O. Hero

We develop a framework to apply tropical and nonarchimedean analytic techniques to multiplication maps on linear series and study degenerations of these multiplications maps when the special fiber is not of compact type. As an application,…

Algebraic Geometry · Mathematics 2016-01-20 David Jensen , Sam Payne

The aim of this work is to provide bounds connecting two probability measures of the same event using R\'enyi $\alpha$-Divergences and Sibson's $\alpha$-Mutual Information, a generalization of respectively the Kullback-Leibler Divergence…

Information Theory · Computer Science 2020-01-20 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

Describing statistical dependencies is foundational to empirical scientific research. For uncovering intricate and possibly non-linear dependencies between a single target variable and several source variables within a system, a principled…

Information Theory · Computer Science 2024-03-28 David A. Ehrlich , Kyle Schick-Poland , Abdullah Makkeh , Felix Lanfermann , Patricia Wollstadt , Michael Wibral

Given a closed, orientable surface of constant negative curvature and genus $g \ge 2$, we study the topological entropy and measure-theoretic entropy (with respect to a smooth invariant measure) of generalized Bowen--Series boundary maps.…

Dynamical Systems · Mathematics 2022-10-10 Adam Abrams , Svetlana Katok , Ilie Ugarcovici

The achievable error-exponent pairs for the type I and type II errors are characterized in a hypothesis testing setup where the observation consists of independent and identically distributed samples from either a known joint probability…

Information Theory · Computer Science 2018-09-19 Amos Lapidoth , Christoph Pfister

The simple Hubbard Hamiltonian with the mean field approximation is used to know about the energy bands and spin susceptibilities of zigzag graphene nanoribbons. Depending on the electron doping, antiferromagnetic or ferromagnetic…

Mesoscale and Nanoscale Physics · Physics 2015-06-03 Juan-Antonio Casao-Perez

We study elastic ribbons subject to large, tensile pre-stress confined to a central region within the cross-section. These ribbons can buckle spontaneously to form helical shapes, featuring regions of alternating chirality (phases) that are…

Soft Condensed Matter · Physics 2023-09-06 Michael Gomez , Pedro M. Reis , Basile Audoly

We propose a partial information decomposition based on the newly introduced framework of causal tensors, i.e., multilinear stochastic maps that transform source data into destination data. This framework enables us to express an indirect…

Information Theory · Computer Science 2020-05-04 David Sigtermans

The interactions between three or more random variables are often nontrivial, poorly understood, and yet, are paramount for future advances in fields such as network information theory, neuroscience, genetics and many others. In this work,…

Information Theory · Computer Science 2016-04-20 Fernando Rosas , Vasilis Ntranos , Christopher J. Ellison , Sofie Pollin , Marian Verhelst

We work out the general theory of one-parameter families of partial entanglement properties and the resulting entanglement depth-like quantities. Special cases of these are the depth of partitionability, the depth of producibility (or…

Quantum Physics · Physics 2025-12-12 Szilárd Szalay , Géza Tóth

New families of Fisher information and entropy power inequalities for sums of independent random variables are presented. These inequalities relate the information in the sum of $n$ independent random variables to the information contained…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Andrew Barron

Mutual Information (MI) is an useful tool for the recognition of mutual dependence berween data sets. Differen methods for the estimation of MI have been developed when both data sets are discrete or when both data sets are continuous. The…

Applications · Statistics 2017-08-30 Miguel A. Ré , Guillermo G. Aguirre Varela

Markov Random Field models are powerful tools for the study of complex systems. However, little is known about how the interactions between the elements of such systems are encoded, especially from an information-theoretic perspective. In…

Information Theory · Computer Science 2015-03-19 Alexandre L. M. Levada

By using the $\Phi$-entropy inequality derived in \cite{Wu, Ch} for Poisson measures, the same type of inequality is established for a class of stochastic differential equations driven by purely jump L\'evy processes. The semigroup…

Probability · Mathematics 2013-09-06 Feng-Yu Wang

This paper studies contractivity of firing-rate and Hopfield recurrent neural networks. We derive sharp LMI conditions on the synaptic matrices that characterize contractivity of both architectures, for activation functions that are either…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Anand Gokhale , Anton V. Proskurnikov , Yu Kawano , Francesco Bullo

Maximum entropy distributions with discrete support in $m$ dimensions arise in machine learning, statistics, information theory, and theoretical computer science. While structural and computational properties of max-entropy distributions…

Data Structures and Algorithms · Computer Science 2019-06-04 Damian Straszak , Nisheeth K. Vishnoi

The matrix-based Renyi's \alpha-order entropy functional was recently introduced using the normalized eigenspectrum of a Hermitian matrix of the projected data in a reproducing kernel Hilbert space (RKHS). However, the current theory in the…

Information Theory · Computer Science 2019-08-01 Shujian Yu , Luis Gonzalo Sanchez Giraldo , Robert Jenssen , Jose C. Principe

Estimating Mutual Information (MI), a key measure of dependence of random quantities without specific modelling assumptions, is a challenging problem in high dimensions. We propose a novel mutual information estimator based on parametrizing…

Machine Learning · Statistics 2025-10-24 Haoran Ni , Martin Lotz

Information-theoretic inequalities play a fundamental role in numerous scientific and technological areas as they generally express the impossibility to have a complete description of a system via a finite number of information measures. In…

Mathematical Physics · Physics 2017-10-03 Steeve Zozor , David Puertas-Centeno , Jesús S. Dehesa