English
Related papers

Related papers: Learning low-degree functions from a logarithmic n…

200 papers

For $V : \mathbb{R}^d \to \mathbb{R}$ coercive, we study the convergence rate for the $L^1$-distance of the empiric minimizer, which is the true minimum of the function $V$ sampled with noise with a finite number $n$ of samples, to the…

Statistics Theory · Mathematics 2023-03-09 Pierre Bras

A loss function measures the discrepancy between the true values (observations) and their estimated fits, for a given instance of data. A loss function is said to be proper (unbiased, Fisher consistent) if the fits are defined over a unit…

Information Theory · Computer Science 2018-05-11 Amichai Painsky , Gregory W. Wornell

We prove a Lusin approximation of functions of bounded variation. If $f$ is a function of bounded variation on an open set $\Omega\subset X$, where $X=(X,d,\mu)$ is a given complete doubling metric measure space supporting a $1$-Poincar\'e…

Functional Analysis · Mathematics 2025-01-14 Panu Lahti , Khanh Nguyen

Let $X$ be a real-valued random variable with distribution function $F$. Set $X_1,\dots, X_m$ to be independent copies of $X$ and let $F_m$ be the corresponding empirical distribution function. We show that there are absolute constants…

Probability · Mathematics 2023-08-10 Daniel Bartl , Shahar Mendelson

Let $\Lambda = \mathrm{SL}_2(\Bbb Z)$ be the modular group and let $c_n(\Lambda)$ be the number of congruence subgroups of $\Lambda$ of index at most $n$. We prove that $\lim\limits_{n\to \infty} \frac{\log c_n(\Lambda)}{(\log n)^2/\log\log…

Group Theory · Mathematics 2009-11-10 D. Goldfeld , A. Lubotzky , N. Nikolov , L. Pyber

Loss functions serve as the foundation of supervised learning and are often chosen prior to model development. To avoid potentially ad hoc choices of losses, statistical decision theory describes a desirable property for losses known as…

Machine Learning · Statistics 2023-11-30 Kevin Lam , Christian Walder , Spiridon Penev , Richard Nock

The Local Computation Algorithm (LCA) model is a popular model in the field of sublinear-time algorithms that measures the complexity of an algorithm by the number of probes the algorithm makes in the neighborhood of one node to determine…

Data Structures and Algorithms · Computer Science 2021-12-06 Sebastian Brandt , Christoph Grunau , Václav Rozhoň

Littlewood asked how small the ratio $||f||_4/||f||_2$ (where $||.||_\alpha$ denotes the $L^\alpha$ norm on the unit circle) can be for polynomials $f$ having all coefficients in $\{1,-1\}$, as the degree tends to infinity. Since 1988, the…

Number Theory · Mathematics 2013-09-19 Jonathan Jedwab , Daniel J. Katz , Kai-Uwe Schmidt

The theorem states that: Every Boolean function can be $\epsilon -approximated$ by a Disjunctive Normal Form (DNF) of size $O_{\epsilon}(2^{n}/\log{n})$. This paper will demonstrate this theorem in detail by showing how this theorem is…

Computational Complexity · Computer Science 2020-05-13 Yunhao Yang , Andrew Tan

A classical theorem of Nisan and Szegedy says that a boolean function with degree $d$ as a real polynomial depends on at most $d2^{d-1}$ of its variables. In recent work by Chiarelli, Hatami and Saks, this upper bound was improved to $C…

Discrete Mathematics · Computer Science 2019-03-22 Jake Wellens

We study batch learning with log-loss in the individual setting, where the outcome sequence is deterministic. Because empirical statistics are not directly applicable in this regime, obtaining regret guarantees for batch learning has long…

Information Theory · Computer Science 2025-11-18 Yaniv Fogel , Meir Feder

We prove that the finite-difference based derivative-free descent (FD-DFD) methods have a capability to find the global minima for a class of multiple minima problems. Our main result shows that, for a class of multiple minima objectives…

Optimization and Control · Mathematics 2020-06-26 Xiaopeng Luo , Xin Xu , Daoyi Dong

We study the approximation of measurable functions on the hypercube by functions arising from affine neural networks. Our main achievement is an approximation of any measurable function $f \colon W_n \to [-1,1]$ up to a prescribed precision…

Machine Learning · Computer Science 2019-01-30 Andreas Thom

We present an algorithm for testing halfspaces over arbitrary, unknown rotation-invariant distributions. Using $\tilde O(\sqrt{n}\epsilon^{-7})$ random examples of an unknown function $f$, the algorithm determines with high probability…

Data Structures and Algorithms · Computer Science 2018-11-02 Nathaniel Harms

We present effective algorithms for uniform approximation of multivariate functions satisfying some prescribed inner structure. We extend in several directions the analysis of recovery of ridge functions $f(x)=g(\langle a,x\rangle)$ as…

Functional Analysis · Mathematics 2014-06-09 Anton Kolleck , Jan Vybiral

This is a conitunation of [1] and [2]. We prove that if function $f$ belongs to the class $\Lambda_{\omega} \overset{\text{def}}{=} \{f: \omega_{f}(\delta)\leq \text{const} \omega(\delta)\} $ for an arbitrary modulus of continuity $\omega$,…

Functional Analysis · Mathematics 2016-05-18 Qinbo Liu

In this paper, we study the learnability of the Boolean class of $d$-monotone functions $f:{\cal X}\to\{0,1\}$ from membership and equivalence queries, where $({\cal X},\le)$ is a finite lattice. We show that the class of $d$-monotone…

Machine Learning · Computer Science 2025-02-04 Nader H. Bshouty

We give a lower bound for the maximum value of class group $L$-functions attached to $\mathbb{Q}(\sqrt{-D})$ at the central point and show that this value is on average at least $$\exp\Bigg(\delta\sqrt{\frac{\log D \log \log \log D}{\log…

Number Theory · Mathematics 2025-09-09 João Campos-Vargas

We prove that for every decision tree, the absolute values of the Fourier coefficients of a given order $\ell\geq1$ sum to at most $c^{\ell}\sqrt{\binom{d}{\ell}(1+\log n)^{\ell-1}},$ where $n$ is the number of variables, $d$ is the tree…

Computational Complexity · Computer Science 2023-01-31 Alexander A. Sherstov , Andrey A. Storozhenko , Pei Wu

We show a procedure that, given oracle access to a function $f\colon \{0,1\}^n\to\{0,1\}$, produces oracle access to a function $f'\colon \{0,1\}^{n'}\to\{0,1\}$ such that if $f$ is monotone, then $f'$ is monotone, and if $f$ is…

Computational Complexity · Computer Science 2025-12-16 Dor Minzer