English
Related papers

Related papers: On the entropy of a noisy function

200 papers

Much of the theory for the lasso in the linear model $Y = X \beta^* + \varepsilon$ hinges on the quantity $2 \| X^\top \varepsilon \|_{\infty} / n$, which we call the lasso's effective noise. Among other things, the effective noise plays an…

Methodology · Statistics 2022-01-24 Johannes Lederer , Michael Vogt

This paper provides tight bounds on the R\'enyi entropy of a function of a discrete random variable with a finite number of possible values, where the considered function is not one-to-one. To that end, a tight lower bound on the R\'enyi…

Information Theory · Computer Science 2018-12-11 Igal Sason

Contemporary predictive models are hard to interpret as their deep nets exploit numerous complex relations between input elements. This work suggests a theoretical framework for model interpretability by measuring the contribution of…

Machine Learning · Computer Science 2022-06-15 Itai Gat , Nitay Calderon , Roi Reichart , Tamir Hazan

We consider a situation where the distribution of a random variable is being estimated by the empirical distribution of noisy measurements of that variable. This is common practice in, for example, teacher value-added models and other…

Econometrics · Economics 2021-12-08 Koen Jochmans , Martin Weidner

We consider the stochastic optimization problem with smooth but not necessarily convex objectives in the heavy-tailed noise regime, where the stochastic gradient's noise is assumed to have bounded $p$th moment ($p\in(1,2]$). Zhang et al.…

Machine Learning · Computer Science 2023-09-06 Zijian Liu , Jiawei Zhang , Zhengyuan Zhou

We quantify the minimax rate for a nonparametric regression model over a star-shaped function class $\mathcal{F}$ with bounded diameter. We obtain a minimax rate of ${\varepsilon^{\ast}}^2\wedge\mathrm{diam}(\mathcal{F})^2$ where…

Statistics Theory · Mathematics 2025-08-20 Akshay Prasadan , Matey Neykov

Building on the recently introduced notion of Boolean entropy, we define the corresponding Boolean Fisher information via a de Bruijn identity. We study the monotonicity of this Fisher information in the Boolean Central Limit Theorem and…

Probability · Mathematics 2026-03-02 Guillaume Cébron , Kewei Pan

We study estimation of a multivariate function $f:{\bf R}^d \to {\bf R}$ when the observations are available from function $Af$, where $A$ is a known linear operator. Both the Gaussian white noise model and density estimation are studied.…

Statistics Theory · Mathematics 2009-04-21 Jussi Klemelä , Enno Mammen

We study the probability of Boolean functions with small max influence to become constant under random restrictions. Let $f$ be a Boolean function such that the variance of $f$ is $\Omega(1)$ and all its individual influences are bounded by…

Computational Complexity · Computer Science 2022-08-19 Ronen Eldan , Avi Wigderson , Pei Wu

We consider an agent trying to bring a system to an acceptable state by repeated probabilistic action. Several recent works on algorithmizations of the Lovasz Local Lemma (LLL) can be seen as establishing sufficient conditions for the agent…

Discrete Mathematics · Computer Science 2016-11-29 Dimitris Achlioptas , Fotis Iliopoulos , Nikos Vlassis

Quantum annealing provides a practical realization of adiabatic quantum computation and has emerged as a promising approach for solving large-scale combinatorial optimization problems. However, current devices remain constrained by sparse…

Quantum Physics · Physics 2025-10-09 Seon-Geun Jeong , Mai Dinh Cong , Dae-Il Noh , Quoc-Viet Pham , Won-Joo Hwang

We provide matching upper and lower bounds of order $\sigma^2/\log(d/n)$ for the prediction error of the minimum $\ell_1$-norm interpolator, a.k.a. basis pursuit. Our result is tight up to negligible terms when $d \gg n$, and is the first…

Statistics Theory · Mathematics 2022-03-09 Guillaume Wang , Konstantin Donhauser , Fanny Yang

Dynamics of deterministic systems perturbed by random additive noise is characterized quantitatively. Since for such systems the KS-entropy diverges we analyse the difference between the total entropy of a noisy system and the entropy of…

It is proved that the width of a function and the width of the distribution of its values cannot be made arbitrarily small simultaneously. In the case of ergodic stochastic processes, an ensuing uncertainty relationship is demonstrated for…

Statistical Mechanics · Physics 2019-04-30 Timur E. Gureyev , Alexander Kozlov , Yakov I. Nesterets , David M. Paganin , Harry M. Quiney

We introduce a novel notion of invariance feedback entropy to quantify the state information that is required by any controller that enforces a given subset of the state space to be invariant. We establish a number of elementary properties,…

Systems and Control · Computer Science 2019-08-07 Mahendra Singh Tomar , Matthias Rungger , Majid Zamani

We study estimation of a multivariate function $f:\mathbf{R}^d\to\mathbf{R}$ when the observations are available from the function $Af$, where $A$ is a known linear operator. Both the Gaussian white noise model and density estimation are…

Statistics Theory · Mathematics 2010-01-14 Jussi Klemelä , Enno Mammen

This paper presents a simple yet efficient method for statistical inference of tensor linear forms using incomplete and noisy observations. Under the Tucker low-rank tensor model and the missing-at-random assumption, we utilize an…

Statistics Theory · Mathematics 2024-11-04 Wanteng Ma , Dong Xia

Entropy comparison inequalities are obtained for the differential entropy $h(X+Y)$ of the sum of two independent random vectors $X,Y$, when one is replaced by a Gaussian. For identically distributed random vectors $X,Y$, these are closely…

Information Theory · Computer Science 2024-07-24 Lampros Gavalakis , Ioannis Kontoyiannis , Mokshay Madiman

Most compressed sensing algorithms do not account for the effect of saturation in noisy compressed measurements, though saturation is an important consequence of the limited dynamic range of existing sensors. The few algorithms that handle…

Machine Learning · Computer Science 2021-02-09 Shuvayan Banerjee , Radhe Srivastava , Ajit Rajwade

When monitoring the dynamics of stochastic systems, such as interacting particles agitated by thermal noise, disentangling deterministic forces from Brownian motion is challenging. Indeed, we show that there is an information-theoretic…

Soft Condensed Matter · Physics 2020-04-16 Anna Frishman , Pierre Ronceray