English
Related papers

Related papers: Sparse juntas on the biased hypercube

200 papers

We study the approximation of arbitrary distributions $P$ on $d$-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback--Leibler-type functional. We show that such an approximation exists if…

Statistics Theory · Mathematics 2011-10-17 Lutz Duembgen , Richard Samworth , Dominic Schuhmacher

We derive fundamental lower bounds on the connectivity and the memory requirements of deep neural networks guaranteeing uniform approximation rates for arbitrary function classes in $L^2(\mathbb R^d)$. In other words, we establish a…

Machine Learning · Computer Science 2018-05-17 Helmut Bölcskei , Philipp Grohs , Gitta Kutyniok , Philipp Petersen

We study projective dimension, a graph parameter (denoted by pd$(G)$ for a graph $G$), introduced by (Pudl\'ak, R\"odl 1992), who showed that proving lower bounds for pd$(G_f)$ for bipartite graphs $G_f$ associated with a Boolean function…

Computational Complexity · Computer Science 2020-01-10 Krishnamoorthy Dinesh , Sajin Koroth , Jayalal Sarma

Let $k$ be a perfect field of characteristic $p>0$, $\mathcal{V}$ a complete discrete valuation ring with residue field $k$ and field of fractions $K$ of characteristic 0, and $S$ a separated $k$-scheme of finite type. When $S$ is smooth…

Algebraic Geometry · Mathematics 2008-12-18 Jean-Yves Etesse

We prove that the weak-$L^{p}$ norms, and in fact the sparse $(p,1)$-norms, of the Carleson maximal partial Fourier sum operator are $\lesssim (p-1)^{-1}$ as $p\to 1^+$. This is an improvement on the Carleson-Hunt theorem, where the same…

Classical Analysis and ODEs · Mathematics 2022-04-19 Francesco Di Plinio , Anastasios Fragkos

We propose a novel algorithm for efficiently computing a sparse directed adjacency matrix from a group of time series following a causal graph process. Our solution is scalable for both dense and sparse graphs and automatically selects the…

Machine Learning · Statistics 2019-11-19 Théophile Griveau-Billion , Ben Calderhead

The Courtade-Kumar conjecture posits that dictatorship functions maximize the mutual information between the function's output and a noisy version of its input over the Boolean hypercube. We present two significant advancements related to…

Information Theory · Computer Science 2026-01-15 Adel Javanmard , David P. Woodruff

We propose o1Neuro, a new neural network model built on sparse indicator activation neurons, with two key statistical properties. (1) Constructive universal approximation: At the population level, a deep o1Neuro can approximate any…

Machine Learning · Statistics 2025-09-15 Chien-Ming Chi

We consider the problem of deciding whether an $n$-qubit unitary (or $n$-bit Boolean function) is $\varepsilon_1$-close to some $k$-junta or $\varepsilon_2$-far from every $k$-junta, where $k$-junta unitaries act non-trivially on at most…

Quantum Physics · Physics 2025-10-23 Zongbo Bao , Yuxuan Liu , Penghui Yao , Zekun Ye , Jialin Zhang

We extend the functional Breuer-Major theorem for Gaussians to the Poisson case, where the stationary sequence arises from a Poisson point process. We use the $L^p$ spectral gap inequality of Poisson point process as a tool to prove…

Probability · Mathematics 2025-10-31 Fanhao Kong , Haiyi Wang

We present a method to perform fully selfconsistent density-functional calculations, which scales linearly with the system size and which is well suited for very large systems. It uses strictly localized pseudoatomic orbitals as basis…

Condensed Matter · Physics 2009-10-28 Pablo Ordejon , Emilio Artacho , Jose M. Soler

The well-known proof of Beurling's Theorem in the Hardy space $H^2$, which describes all shift-invariant subspaces, rests on calculating the orthogonal projection of the unit constant function onto the subspace in question. Extensions to…

This paper deals with the approximation of discrete real-valued functions by first-degree splines (broken lines) with free knots for arbitrary $L_p$-norms ($1 \leq p \leq \infty)$. We prove the existence of best approximations und derive…

Numerical Analysis · Mathematics 2017-04-20 Ludwig J. Cromme , Jens Kunath

We prove a theorem concerning the approximation of multivariate functions by deep ReLU networks. We present new error estimates for which the curse of the dimensionality is lessened by establishing a connection with sparse grids.

Numerical Analysis · Mathematics 2018-08-15 Hadrien Montanelli , Qiang Du

We consider sparsity-based techniques for the approximation of high-dimensional functions from random pointwise evaluations. To date, almost all the works published in this field contain some a priori assumptions about the error corrupting…

Numerical Analysis · Mathematics 2019-05-10 Ben Adcock , Anyi Bao , Simone Brugiapaglia

We consider conformal perturbation theory for $n$-point functions on the sphere in general 2D CFTs to first order in coupling constant. We regulate perturbation integrals using canonical hard disk excisions of size $\epsilon$ around the…

High Energy Physics - Theory · Physics 2023-12-22 Benjamin A. Burrington , Ida G. Zadeh

We show that \emph{efficient Turing computability} at any fixed input/output precision implies the existence of \emph{compositionally sparse} (bounded-fan-in, polynomial-size) DAG representations and of corresponding neural approximants…

Machine Learning · Computer Science 2025-10-15 Tomaso Poggio

Constructing neural networks for function approximation is a classical and longstanding topic in approximation theory. In this paper, we aim at constructing deep neural networks (deep nets for short) with three hidden layers to approximate…

Information Theory · Computer Science 2020-01-14 Xia Liu

This work explores the neural network approximation capabilities for functions within the spectral Barron space $\mathscr{B}^s$, where $s$ is the smoothness index. We demonstrate that for functions in $\mathscr{B}^{1/2}$, a shallow neural…

Numerical Analysis · Mathematics 2025-07-10 Yulei Liao , Pingbing Ming , Hao Yu

We study a natural complexity measure of Boolean functions known as the rational degree. Denoted $\textrm{rdeg}(f)$, it is the minimal degree of a rational function that is equal to $f$ on the Boolean hypercube. For total functions $f$, it…

Computational Complexity · Computer Science 2025-04-16 Vishnu Iyer , Siddhartha Jain , Robin Kothari , Matt Kovacs-Deak , Vinayak M. Kumar , Luke Schaeffer , Daochen Wang , Michael Whitmeyer