English
Related papers

Related papers: Gaussian Bounds for Noise Correlation of Resilient…

200 papers

Let $0 < \epsilon < 1/2$ be a noise parameter, and let $T_{\epsilon}$ be the noise operator acting on functions on the boolean cube $\{0,1\}^n$. Let $f$ be a nonnegative function on $\{0,1\}^n$. We upper bound the entropy of $T_{\epsilon}…

Information Theory · Computer Science 2016-06-23 Alex Samorodnitsky

Most compressed sensing algorithms do not account for the effect of saturation in noisy compressed measurements, though saturation is an important consequence of the limited dynamic range of existing sensors. The few algorithms that handle…

Machine Learning · Computer Science 2021-02-09 Shuvayan Banerjee , Radhe Srivastava , Ajit Rajwade

Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statistical machine learning, particularly for applications in safety-critical domains. In this…

Machine Learning · Computer Science 2026-05-12 Johannes Teutsch , Oleksii Molodchyk , Marion Leibold , Timm Faulwasser , Armin Lederer

We prove an exact relationship between the optimal denoising function and the data distribution in the case of additive Gaussian noise, showing that denoising implicitly models the structure of data allowing it to be exploited in the…

Neural and Evolutionary Computing · Computer Science 2017-09-11 Heikki Arponen , Matti Herranen , Harri Valpola

We provide asymptotically sharp bounds for the Gaussian surface area and the Gaussian noise sensitivity of polynomial threshold functions. In particular we show that if $f$ is a degree-$d$ polynomial threshold function, then its Gaussian…

Computational Complexity · Computer Science 2009-12-15 Daniel M. Kane

Expected improvement (EI) is one of the most widely used acquisition functions in Bayesian optimization (BO). Despite its proven success in applications for decades, important open questions remain on the theoretical convergence behaviors…

Machine Learning · Statistics 2025-02-13 Jingyi Wang , Haowei Wang , Nai-Yuan Chiang , Cosmin G. Petra

In this paper, we examine the effects of correlated Gaussian noise on a two-dimensional neuronal network that is locally modeled by the Rulkov map. More precisely, we study the effects of the noise correlation on the variations of the mean…

Disordered Systems and Neural Networks · Physics 2010-09-23 Xiaojuan Sun , Matjaz Perc , Qishao Lu , Jürgen Kurths

In this note we obtain tight bounds on the space-complexity of computing the ergodic measure of a low-dimensional discrete-time dynamical system affected by Gaussian noise. If the scale of the noise is $\varepsilon$, and the function…

Computational Complexity · Computer Science 2015-08-24 Mark Braverman , Cristobal Rojas , Jon Schneider

We present upper and lower bounds for the prediction error of the Lasso. For the case of random Gaussian design, we show that under mild conditions the prediction error of the Lasso is up to smaller order terms dominated by the prediction…

Statistics Theory · Mathematics 2018-04-04 Sara van de Geer

This paper studies the classification of high-dimensional Gaussian signals from low-dimensional noisy, linear measurements. In particular, it provides upper bounds (sufficient conditions) on the number of measurements required to drive the…

Information Theory · Computer Science 2016-11-03 Hugo Reboredo , Francesco Renna , Robert Calderbank , Miguel R. D. Rodrigues

We apply Bayesian statistics to the estimation of correlation functions. We give the probability distributions of auto- and cross-correlations as functions of the data. Our procedure uses the measured data optimally and informs about the…

Data Analysis, Statistics and Probability · Physics 2022-12-27 Angel Gutierrez-Rubio , Juan S. Rojas-Arias , Jun Yoneda , Seigo Tarucha , Daniel Loss , Peter Stano

Non-Gaussian noise is omnipresent in systems where the central-limit theorem is inapplicable. We here investigate the stochastic thermodynamics of small systems that are described by a general Kramers-Moyal equation that includes both…

Statistical Mechanics · Physics 2025-02-28 Arthur M. Faria , Marcus V. S. Bonanca , Eric Lutz

Let $T_{\epsilon}$ be the noise operator acting on functions on the boolean cube $\{0,1\}^n$. Let $f$ be a nonnegative function on $\{0,1\}^n$ and let $q \ge 1$. We upper bound the $\ell_q$ norm of $T_{\epsilon} f$ by the average $\ell_q$…

Information Theory · Computer Science 2019-11-13 Alex Samorodnitsky

Let $T_{\epsilon}$, $0 \le \epsilon \le 1/2$, be the noise operator acting on functions on the boolean cube $\{0,1\}^n$. Let $f$ be a nonnegative function on $\{0,1\}^n$ and let $q \ge 1$. In arXiv:1809.09696 the $\ell_q$ norm of…

Information Theory · Computer Science 2020-10-07 Alex Samorodnitsky

We give the first non-trivial upper bounds on the average sensitivity and noise sensitivity of polynomial threshold functions. More specifically, for a Boolean function f on n variables equal to the sign of a real, multivariate polynomial…

Computational Complexity · Computer Science 2014-03-28 Prahladh Harsha , Adam Klivans , Raghu Meka

The noise sensitivity of a Boolean function $f: \{0,1\}^n \rightarrow \{0,1\}$ is one of its fundamental properties. A function of a positive noise parameter $\delta$, it is denoted as $NS_{\delta}[f]$. Here we study the algorithmic problem…

Data Structures and Algorithms · Computer Science 2019-04-16 Ronitt Rubinfeld , Arsen Vasilyan

Let $T_{\epsilon}$ be the noise operator acting on Boolean functions $f:\{0, 1\}^n\to \{0, 1\}$, where $\epsilon\in[0, 1/2]$ is the noise parameter. Given $\alpha>1$ and fixed mean $\mathbb{E} f$, which Boolean function $f$ has the largest…

Probability · Mathematics 2021-01-27 Jiange Li , Muriel Medard

Recent works explore deep learning's success by examining functions or data with hierarchical structure. To study the learning complexity of functions with hierarchical structure, we study the noise stability of functions with tree…

Probability · Mathematics 2025-09-30 Rupert Li , Elchanan Mossel

We approach the theoretical problem of compressing a signal dominated by Gaussian noise. We present expressions for the compression ratio which can be reached, under the light of Shannon's noiseless coding theorem, for a linearly quantized…

Data Analysis, Statistics and Probability · Physics 2009-10-31 August Romeo , Enrique Gaztanaga , Jose Barriga , Emilio Elizalde

Stochastic averaging problems with Gaussian forcing have been studied thoroughly for many years, but far less attention has been paid to problems where the stochastic forcing has infinite variance, such as an {\alpha}-stable noise forcing.…

Dynamical Systems · Mathematics 2017-05-24 William F. Thompson , Rachel A. Kuske , Adam. H. Monahan