English
Related papers

Related papers: Generalized Samorodnitsky noisy function inequalit…

200 papers

Given an unknown signal $\mathbf{x}_0\in\mathbb{R}^n$ and linear noisy measurements $\mathbf{y}=\mathbf{A}\mathbf{x}_0+\sigma\mathbf{v}\in\mathbb{R}^m$, the generalized $\ell_2^2$-LASSO solves…

Statistics Theory · Mathematics 2015-02-24 Christos Thrampoulidis , Ashkan Panahi , Babak Hassibi

In this paper, we study the approximation problem for functions in the Gaussian-weighted Sobolev space $W^\alpha_p(\mathbb{R}^d, \gamma)$ of mixed smoothness $\alpha \in \mathbb{N}$ with error measured in the Gaussian-weighted space…

Functional Analysis · Mathematics 2023-09-29 Van Kien Nguyen

An important problem in machine learning theory is to understand the approximation and generalization properties of two-layer neural networks in high dimensions. To this end, researchers have introduced the Barron space…

Machine Learning · Statistics 2024-01-02 Lei Wu

Error bounds are central objects in optimization theory and its applications. They were for a long time restricted only to the theory before becoming over the course of time a field of itself. This paper is devoted to the study of error…

Optimization and Control · Mathematics 2023-11-17 Zhou Wei , Michel Théra , Jen-Chih Yao

For each $q\in{\mathbb{N}}_0$, we construct positive linear polynomial approximation operators $M_n$ that simultaneously preserve $k$-monotonicity for all $0\leq k\leq q$ and yield the estimate \[ |f(x)-M_n(f, x)| \leq c…

Classical Analysis and ODEs · Mathematics 2016-08-02 K. Kopotun , D. Leviatan , A. Prymak , I. A. Shevchuk

Let $\mathbb F=\mathbb R$ or $\mathbb C$ and $n\in\b N$. Let $(S_k)_{k\ge0}$ be a time-homogeneous random walk on $GL_n(\b F)$ associated with an $U_n(\b F)$-biinvariant measure $\nu\in M^1(GL_n(\b F))$. We derive a central limit theorem…

Classical Analysis and ODEs · Mathematics 2012-05-23 Michael Voit

Convex potential minimisation is the de facto approach to binary classification. However, Long and Servedio [2010] proved that under symmetric label noise (SLN), minimisation of any convex potential over a linear function class can result…

Machine Learning · Computer Science 2015-05-29 Brendan van Rooyen , Aditya Krishna Menon , Robert C. Williamson

Robust loss functions are essential for training deep neural networks with better generalization power in the presence of noisy labels. Symmetric loss functions are confirmed to be robust to label noise. However, the symmetric condition is…

Machine Learning · Computer Science 2021-06-08 Xiong Zhou , Xianming Liu , Junjun Jiang , Xin Gao , Xiangyang Ji

Solomonoff's uncomputable universal prediction scheme $\xi$ allows to predict the next symbol $x_k$ of a sequence $x_1...x_{k-1}$ for any Turing computable, but otherwise unknown, probabilistic environment $\mu$. This scheme will be…

Machine Learning · Computer Science 2007-05-23 Marcus Hutter

We characterize the symmetric distributions that can be (approximately) generated by shallow Boolean circuits. More precisely, let $f\colon \{0,1\}^m \to \{0,1\}^n$ be a Boolean function where each output bit depends on at most $d$ input…

Computational Complexity · Computer Science 2025-11-19 Daniel M. Kane , Anthony Ostuni , Kewen Wu

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

We recently showed in [1] the superiority of certain structured coding matrices ensembles (such as partial row-orthogonal) for sparse superposition codes when compared with purely random matrices with i.i.d. entries, both…

Information Theory · Computer Science 2022-07-12 YuHao Liu , Teng Fu , Jean Barbier , TianQi Hou

For a function $F$ represented as $F(x)=\sum_{n=0}^\infty{f_n (x) e^{2 \pi i \lambda_n x}},$ where each $f_n$ satisfies $\operatorname{spec}(f_n) \subset [0, 1]$ and $(\lambda_n)_{n\geq 0}\subset \mathbb{R}_+$ is a lacunary sequence, we…

Classical Analysis and ODEs · Mathematics 2026-03-24 Miquel Saucedo , Sergey Tikhonov

Let $\mathscr{C}_n=\{-1,1\}^n$ be the discrete hypercube equipped with the uniform probability measure $\sigma_n$. We prove that if $(E,\|\cdot\|_E)$ is a Banach space of finite cotype and $p\in[1,\infty)$, then every function…

Functional Analysis · Mathematics 2024-02-21 Dario Cordero-Erausquin , Alexandros Eskenazis

This paper studies several properties of channel codes that approach the fundamental limits of a given (discrete or Gaussian) memoryless channel with a non-vanishing probability of error. The output distribution induced by an…

Information Theory · Computer Science 2013-09-03 Yury Polyanskiy , Sergio Verdu

For $\alpha >0$, let $$\mathscr{A}=\{ a_1<a_2<a_3<\cdots\}$$ and $$\mathscr{L}=\{ \ell_1, \ell_2, \ell_3,\cdots\} \quad \text{(not~necessarily~different)}$$ be two sequences of positive integers with $\mathscr{A}(m)>(\log m)^\alpha $ for…

Number Theory · Mathematics 2023-04-14 Yong-Gao Chen , Yuchen Ding

We consider symmetric hypothesis testing in quantum statistics, where the hypotheses are density operators on a finite-dimensional complex Hilbert space, representing states of a finite quantum system. We prove a lower bound on the…

Quantum Physics · Physics 2009-04-30 Michael Nussbaum , Arleta Szkoła

Labeling a training set is often expensive and susceptible to errors, making the design of robust loss functions for label noise an important problem. The symmetry condition provides theoretical guarantees for robustness to such noise. In…

Machine Learning · Computer Science 2026-05-21 Alexandre Lemire Paquin , Brahim Chaib-Draa , Philippe Giguère

We give a $2^{\tilde{O}(\sqrt{n}/\epsilon)}$-time algorithm for properly learning monotone Boolean functions under the uniform distribution over $\{0,1\}^n$. Our algorithm is robust to adversarial label noise and has a running time nearly…

Data Structures and Algorithms · Computer Science 2023-03-29 Jane Lange , Ronitt Rubinfeld , Arsen Vasilyan

Fault tolerant quantum error correction (QEC) networks are studied by a combination of numerical and approximate analytical treatments. The probability of failure of the recovery operation is calculated for a variety of CSS codes, including…

Quantum Physics · Physics 2009-11-07 Andrew M. Steane