English
Related papers

Related papers: Toward $L_\infty$-recovery of Nonlinear Functions:…

200 papers

Polynomial regression is a basic primitive in learning and statistics. In its most basic form the goal is to fit a degree $d$ polynomial to a response variable $y$ in terms of an $n$-dimensional input vector $x$. This is extremely…

Data Structures and Algorithms · Computer Science 2020-04-30 Sitan Chen , Raghu Meka

The problem of population recovery refers to estimating a distribution based on incomplete or corrupted samples. Consider a random poll of sample size $n$ conducted on a population of individuals, where each pollee is asked to answer $d$…

Statistics Theory · Mathematics 2020-04-30 Yury Polyanskiy , Ananda Theertha Suresh , Yihong Wu

We provide a new upper bound for sampling numbers $(g_n)_{n\in \mathbb{N}}$ associated to the compact embedding of a separable reproducing kernel Hilbert space into the space of square integrable functions. There are universal constants…

Numerical Analysis · Mathematics 2021-02-11 Nicolas Nagel , Martin Schäfer , Tino Ullrich

This work represents a natural coalescence of two important lines of work: learning mixtures of Gaussians and algorithmic robust statistics. In particular we give the first provably robust algorithm for learning mixtures of any constant…

Data Structures and Algorithms · Computer Science 2021-07-27 Allen Liu , Ankur Moitra

We consider the problem of recovering a real-valued $n$-dimensional signal from $m$ phaseless, linear measurements and analyze the amplitude-based non-smooth least squares objective. We establish local convergence of subgradient descent…

Machine Learning · Computer Science 2021-08-31 Paul Hand , Oscar Leong , Vladislav Voroninski

In this paper, we introduce a method known as polynomial frame approximation for approximating smooth, multivariate functions defined on irregular domains in $d$ dimensions, where $d$ can be arbitrary. This method is simple, and relies only…

Numerical Analysis · Mathematics 2020-05-27 Ben Adcock , Daan Huybrechs

We consider the problem of learning the underlying graph of a sparse Ising model with $p$ nodes from $n$ i.i.d. samples. The most recent and best performing approaches combine an empirical loss (the logistic regression loss or the…

Machine Learning · Statistics 2021-09-17 Antoine Dedieu , Miguel Lázaro-Gredilla , Dileep George

We give the first non-trivial upper bounds on the average sensitivity and noise sensitivity of degree-$d$ polynomial threshold functions (PTFs). These bounds hold both for PTFs over the Boolean hypercube and for PTFs over $\R^n$ under the…

Computational Complexity · Computer Science 2009-10-19 Ilias Diakonikolas , Prasad Raghavendra , Rocco A. Servedio , Li-Yang Tan

We investigate the characteristic polynomials of the Gaussian $\beta$-ensemble for general $\beta>0$ through its transfer matrix recurrence. We show that the rescaled characteristic polynomial converges to a random entire function in a…

Probability · Mathematics 2021-08-03 Gaultier Lambert , Elliot Paquette

We develop an operator-theoretic framework for stability and statistical concentration in nonlinear inverse problems with block-structured parameters. Under a unified set of assumptions combining blockwise Lipschitz geometry, local…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Joe-Mei Feng , Hsin-Hsiung Kao

We develop a general framework for estimating the $L_\infty(\mathbb{T}^d)$ error for the approximation of multivariate periodic functions belonging to specific reproducing kernel Hilbert spaces (RHKS) using approximants that are…

Numerical Analysis · Mathematics 2019-09-06 Lutz Kämmerer

Sampled Gabor phase retrieval - the problem of recovering a square-integrable signal from the magnitude of its Gabor transform sampled on a lattice - is a fundamental problem in signal processing, with important applications in areas such…

Functional Analysis · Mathematics 2025-05-07 Rima Alaifari , Francesca Bartolucci , Matthias Wellershoff

We consider the problem of recovering polynomials that are sparse with respect to the basis of Legendre polynomials from a small number of random samples. In particular, we show that a Legendre s-sparse polynomial of maximal degree N can be…

Numerical Analysis · Mathematics 2011-04-05 Holger Rauhut , Rachel Ward

In this paper, we study the phase retrieval problem in the situation where the vector to be recovered has an a priori structure that can encoded into a regularization term. This regularizer is intended to promote solutions conforming to…

Optimization and Control · Mathematics 2024-07-24 Jean-Jacques Godeme , Jalal Fadili

We introduce a generalized Fourier ratio, the \(\ell^1/\ell^2\) norm ratio of coefficients in an \emph{arbitrary} orthonormal system, as a single, basis-invariant measure of \emph{effective dimension} that governs fundamental limits across…

Classical Analysis and ODEs · Mathematics 2026-01-26 Will Burstein , Alex Iosevich , Hari Sarang Nathan

Pointwise error analysis of the linear finite element approximation for $-\Delta u + u = f$ in $\Omega$, $\partial_n u = \tau$ on $\partial\Omega$, where $\Omega$ is a bounded smooth domain in $\mathbb R^N$, is presented. We establish…

Numerical Analysis · Mathematics 2018-04-03 Takahito Kashiwabara , Tomoya Kemmochi

Convex regularization techniques are now widespread tools for solving inverse problems in a variety of different frameworks. In some cases, the functions to be reconstructed are naturally viewed as realizations from random processes; an…

Probability · Mathematics 2018-01-09 Valentina Cammarota , Domenico Marinucci

We investigate the sample complexity of bounded two-layer neural networks using different activation functions. In particular, we consider the class $$ \mathcal{H} = \left\{\textbf{x}\mapsto \langle \textbf{v}, \sigma \circ W\textbf{b} +…

Machine Learning · Computer Science 2024-01-23 Amit Daniely , Elad Granot

We consider the problem of learning multi-ridge functions of the form f(x) = g(Ax) from point evaluations of f. We assume that the function f is defined on an l_2-ball in R^d, g is twice continuously differentiable almost everywhere, and A…

Machine Learning · Statistics 2016-06-07 Hemant Tyagi , Volkan Cevher

This work investigates the problem of signal recovery from undersampled noisy sub-Gaussian measurements under the assumption of a synthesis-based sparsity model. Solving the $\ell^1$-synthesis basis pursuit allows for a simultaneous…

Information Theory · Computer Science 2020-04-16 Maximilian März , Claire Boyer , Jonas Kahn , Pierre Weiss