English
Related papers

Related papers: Renyi Dimension and Gaussian Filtering II

200 papers

This paper studies the complexity of estimating Renyi divergences of discrete distributions: $p$ observed from samples and the baseline distribution $q$ known \emph{a priori}. Extending the results of Acharya et al. (SODA'15) on estimating…

Information Theory · Computer Science 2017-02-09 Maciej Skorski

In this paper, we consider single- and multi-user Gaussian channels with feedback under expected power constraints and with non-vanishing error probabilities. In the first of two contributions, we study asymptotic expansions for the…

Information Theory · Computer Science 2016-09-22 Lan V. Truong , Silas L. Fong , Vincent Y. F. Tan

Under certain conditions on k we calculate the limit distribution of the k:th largest eigenvalue, x_k, of the Gaussian Unitary Ensemble (GUE). More specifically, if n is the dimension of a random matrix from the GUE and k is such that both…

Probability · Mathematics 2015-06-26 Jonas Gustavsson

We derive a scale-free bound on the density of the maximum of a centered Gaussian vector. The basic bound is non-uniform, depends logarithmically on the dimension, and allows any covariance matrix. When the largest marginal variance is…

Statistics Theory · Mathematics 2026-05-29 Suhas Vijaykumar

We prove a variational principle for the upper and lower metric mean dimension of level sets \[ \left\{x\in X: \lim_{n\to\infty}\frac{1}{n}\sum_{j=0}^{n-1}\varphi(f^{j}(x))=\alpha\right\} \] associated to continuous potentials $\varphi:X\to…

Dynamical Systems · Mathematics 2023-08-28 Lucas Backes , Fagner B. Rodrigues

We are interested in a framework of online learning with kernels for low-dimensional but large-scale and potentially adversarial datasets. We study the computational and theoretical performance of online variations of kernel Ridge…

Machine Learning · Statistics 2019-05-30 Rémi Jézéquel , Pierre Gaillard , Alessandro Rudi

We present simple, user-friendly bounds for the expected operator norm of a random kernel matrix under general conditions on the kernel function $k(\cdot,\cdot)$. Our approach uses decoupling results for U-statistics and the non-commutative…

Machine Learning · Statistics 2025-11-07 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

Entropy comparison inequalities are obtained for the differential entropy $h(X+Y)$ of the sum of two independent random vectors $X,Y$, when one is replaced by a Gaussian. For identically distributed random vectors $X,Y$, these are closely…

Information Theory · Computer Science 2024-07-24 Lampros Gavalakis , Ioannis Kontoyiannis , Mokshay Madiman

Kernel expansions are a topic of considerable interest in machine learning, also because of their relation to the so-called feature maps introduced in machine learning. Properties of the associated basis functions and weights (corresponding…

Machine Learning · Computer Science 2024-10-03 Mauro Bisiacco , Gianluigi Pillonetto

We discuss some properties of the generalized entropies, called Renyi entropies and their application to the case of continuous distributions. In particular it is shown that these measures of complexity can be divergent, however, their…

Disordered Systems and Neural Networks · Physics 2007-05-23 I. Varga , J. Pipek

We construct and analyze conformally invariant random fields on 4-dimensional Riemannian manifolds $(M,g)$. These centered Gaussian fields $h$, called \emph{co-biharmonic Gaussian fields}, are characterized by their covariance kernels $k$…

Probability · Mathematics 2024-01-24 Karl-Theodor Sturm

We investigate the asymptotic behavior of the q-Racah probability measure on lozenge tilings of a hexagon whose side lengths scale linearly with a large parameter $L$, while the parameters $q\in(0,1)$ and $\kappa\in \mathbf{i}\mathbb{R}$…

Probability · Mathematics 2025-07-30 Alisa Knizel , Leonid Petrov

A $q$-Gaussian measure is a generalization of a Gaussian measure. This generalization is obtained by replacing the exponential function with the power function of exponent $1/(1-q)$ ($q\neq 1$). The limit case $q=1$ recovers a Gaussian…

Quantum Algebra · Mathematics 2020-02-18 Hiroshi Matsuzoe , Asuka Takatsu

We consider 3d N>= 2 superconformal field theories on a branched covering of a three-sphere. The Renyi entropy of a CFT is given by the partition function on this space, but conical singularities break the supersymmetry preserved in the…

High Energy Physics - Theory · Physics 2015-06-16 Tatsuma Nishioka , Itamar Yaakov

We prove a convergence theorem for U-statistics of degree two, where the data dimension $d$ is allowed to scale with sample size $n$. We find that the limiting distribution of a U-statistic undergoes a phase transition from the…

Statistics Theory · Mathematics 2023-07-04 Kevin H. Huang , Xing Liu , Andrew B. Duncan , Axel Gandy

The response of four dimensional quantum field theories to a Weyl rescaling of the metric in the presence of local couplings and which involve $a$, the coefficient of the Euler density in the energy momentum tensor trace on curved space, is…

High Energy Physics - Theory · Physics 2015-02-10 I. Jack , H. Osborn

The entanglement entropy of a subsystem $A$ of a quantum system is expressed, in the replica method, through analytic continuation with respect to n of the trace of the n-th power of the reduced density matrix $\tr\rho_A^n$. We study the…

Statistical Mechanics · Physics 2010-03-25 F. Gliozzi , L. Tagliacozzo

Given a subset K of the unit Euclidean sphere, we estimate the minimal number m = m(K) of hyperplanes that generate a uniform tessellation of K, in the sense that the fraction of the hyperplanes separating any pair x, y in K is nearly…

Probability · Mathematics 2013-09-27 Yaniv Plan , Roman Vershynin

A method to reconstruct fields, source strengths and physical parameters based on Gaussian process regression is presented for the case where data are known to fulfill a given linear differential equation with localized sources. The…

Data Analysis, Statistics and Probability · Physics 2019-09-10 Christopher G. Albert

We tighten the Entropy Power Inequality (EPI) when one of the random summands is Gaussian. Our strengthening is closely connected to the concept of strong data processing for Gaussian channels and generalizes the (vector extension of)…

Information Theory · Computer Science 2016-02-10 Thomas A. Courtade