English
Related papers

Related papers: Tight Bounds on $\ell_1$ Approximation and Learnin…

200 papers

A seminal result of Nisan and Szegedy (STOC, 1992) shows that for any total Boolean function, the degree of the real polynomial that computes the function, and the minimal degree of a real polynomial that point-wise approximates the…

Computational Complexity · Computer Science 2025-07-21 Arkadev Chattopadhyay , Yogesh Dahiya , Shachar Lovett

We give a $2^{\tilde{O}(\sqrt{n}/\epsilon)}$-time algorithm for properly learning monotone Boolean functions under the uniform distribution over $\{0,1\}^n$. Our algorithm is robust to adversarial label noise and has a running time nearly…

Data Structures and Algorithms · Computer Science 2023-03-29 Jane Lange , Ronitt Rubinfeld , Arsen Vasilyan

An information-theoretic upper bound on the generalization error of supervised learning algorithms is derived. The bound is constructed in terms of the mutual information between each individual training sample and the output of the…

Machine Learning · Computer Science 2020-08-06 Yuheng Bu , Shaofeng Zou , Venugopal V. Veeravalli

This paper develops upper and lower bounds for the probability of Boolean functions by treating multiple occurrences of variables as independent and assigning them new individual probabilities. We call this approach dissociation and give an…

Artificial Intelligence · Computer Science 2015-06-30 Wolfgang Gatterbauer , Dan Suciu

We give the first non-trivial upper bounds on the average sensitivity and noise sensitivity of degree-$d$ polynomial threshold functions (PTFs). These bounds hold both for PTFs over the Boolean hypercube and for PTFs over $\R^n$ under the…

Computational Complexity · Computer Science 2009-10-19 Ilias Diakonikolas , Prasad Raghavendra , Rocco A. Servedio , Li-Yang Tan

We consider the problem of testing whether an unknown Boolean function $f$ is monotone versus $\epsilon$-far from every monotone function. The two main results of this paper are a new lower bound and a new algorithm for this well-studied…

Computational Complexity · Computer Science 2014-12-19 Xi Chen , Rocco A. Servedio , Li-Yang Tan

In the noisy query model, the (binary) return value of every query (possibly repeated) is independently flipped with some fixed probability $p \in (0, 1/2)$. In this paper, we obtain tight bounds on the noisy query complexity of several…

Data Structures and Algorithms · Computer Science 2025-02-17 Yuzhou Gu , Xin Li , Yinzhan Xu

We present a bound for value-prediction error with respect to model misspecification that is tight, including constant factors. This is a direct improvement of the "simulation lemma," a foundational result in reinforcement learning. We…

Machine Learning · Computer Science 2024-10-28 Sam Lobel , Ronald Parr

Upper semicontinuous (usc) functions arise in the analysis of maximization problems, distributionally robust optimization, and function identification, which includes many problems of nonparametric statistics. We establish that every usc…

Optimization and Control · Mathematics 2019-07-09 Johannes O. Royset

We study the complexity of smoothed agnostic learning, recently introduced by~\cite{CKKMS24}, in which the learner competes with the best classifier in a target class under slight Gaussian perturbations of the inputs. Specifically, we focus…

Machine Learning · Computer Science 2026-02-25 Ilias Diakonikolas , Daniel M. Kane

We analyze rates of approximation by quantized, tensor-structured representations of functions with isolated point singularities in ${\mathbb R}^3$. We consider functions in countably normed Sobolev spaces with radial weights and analytic-…

Numerical Analysis · Mathematics 2019-12-18 Carlo Marcati , Maxim Rakhuba , Christoph Schwab

We consider the problem of computing the partition function $\sum_x e^{f(x)}$, where $f: \{-1, 1\}^n \longrightarrow {\Bbb R}$ is a quadratic or cubic polynomial on the Boolean cube $\{-1, 1\}^n$. In the case of a quadratic polynomial $f$,…

Probability · Mathematics 2021-07-01 Alexander Barvinok , Nicholas Barvinok

We give a non-adaptive algorithm that makes $2^{\tilde{O}(\sqrt{k\log(1/\varepsilon_2 - \varepsilon_1)})}$ queries to a Boolean function $f:\{\pm 1\}^n \rightarrow \{\pm 1\}$ and distinguishes between $f$ being $\varepsilon_1$-close to some…

Data Structures and Algorithms · Computer Science 2024-04-23 Shivam Nadimpalli , Shyamal Patel

A fundamental problem in numerical analysis and approximation theory is approximating smooth functions by polynomials. A much harder version under recent consideration is to enforce bounds constraints on the approximating polynomial. In…

Numerical Analysis · Mathematics 2021-12-28 Larry Allen , Robert C. Kirby

We consider the problem of approximating a smooth function from finitely-many pointwise samples using $\ell^1$ minimization techniques. In the first part of this paper, we introduce an infinite-dimensional approach to this problem. Three…

Numerical Analysis · Mathematics 2016-12-16 Ben Adcock

The purpose of this paper is to study the lower semicontinuity with respect to the strong $L^1$-convergence, of some integral functionals defined in the space SBD of special functions with bounded deformation. Precisely, let $U$ be a…

Functional Analysis · Mathematics 2007-05-23 Francois Ebobisse

Let $g: \{-1,1\}^k \to \{-1,1\}$ be any Boolean function and $q_1,\dots,q_k$ be any degree-2 polynomials over $\{-1,1\}^n.$ We give a \emph{deterministic} algorithm which, given as input explicit descriptions of $g,q_1,\dots,q_k$ and an…

Computational Complexity · Computer Science 2013-11-28 Anindya De , Ilias Diakonikolas , Rocco A. Servedio

Estimates are constructed for the deviation of the concentration functions of sums of independent random variables with finite variances from the folded normal distribution function without any assumptions concerning the existence of the…

Probability · Mathematics 2016-08-11 V. Yu. Korolev , A. V. Dorofeeva

We call a function $f$ in $C(X)$ to be hard-bounded if $f$ is bounded on every hard subset, a special kind of closed subset, of $X$. We call a subset $T$ of $X$ to be $S$-embedded if every hard-bounded continuous function of $T$ can be…

General Topology · Mathematics 2022-04-22 Biswajit Mitra , Sanjib Das

A Boolean function f of n variables is said to be q-locally correctable if, given a black-box access to a function g which is "close" to an isomorphism f_sigma(x)=f_sigma(x_1, ..., x_n) = f(x_sigma(1), ..., x_sigma(n)) of f, we can compute…

Computational Complexity · Computer Science 2012-10-23 Noga Alon , Amit Weinstein