English
Related papers

Related papers: Near-Optimal and Tractable Estimation under Shift-…

200 papers

Bayesian nonparametric regression under a rescaled Gaussian process prior offers smoothness-adaptive function estimation with near minimax-optimal error rates. Hierarchical extensions of this approach, equipped with stochastic variable…

Statistics Theory · Mathematics 2020-12-15 Sheng Jiang , Surya T. Tokdar

This paper is concerned with estimation and inference for ultrahigh dimensional partially linear single-index models. The presence of high dimensional nuisance parameter and nuisance unknown function makes the estimation and inference…

Methodology · Statistics 2024-04-09 Shijie Cui , Xu Guo , Zhe Zhang

In the context of high-dimensional linear regression models, we propose an algorithm of exact support recovery in the setting of noisy compressed sensing where all entries of the design matrix are independent and identically distributed…

Statistics Theory · Mathematics 2019-10-23 Mohamed Ndaoud , Alexandre B. Tsybakov

We study the complexity of high-dimensional approximation in the $L_2$-norm when different classes of information are available; we compare the power of function evaluations with the power of arbitrary continuous linear measurements. Here,…

Numerical Analysis · Mathematics 2023-03-23 David Krieg , Pawel Siedlecki , Mario Ullrich , Henryk Woźniakowski

Given an $n \times d$ dimensional dataset $A$, a projection query specifies a subset $C \subseteq [d]$ of columns which yields a new $n \times |C|$ array. We study the space complexity of computing data analysis functions over such…

Data Structures and Algorithms · Computer Science 2021-01-20 Graham Cormode , Charlie Dickens , David P. Woodruff

This paper considers the deconvolution problem in the case where the target signal is multidimensional and no information is known about the noise distribution. More precisely, no assumption is made on the noise distribution and no samples…

Statistics Theory · Mathematics 2021-02-18 Elisabeth Gassiat , Sylvain Le Corff , Luc Lehéricy

We derive fundamental sampling bounds for smooth signals in continuous settings without sparsity assumptions. By introducing the Fourier ratio as a measure of spectral compressibility induced by smoothness, we obtain explicit, deterministic…

Classical Analysis and ODEs · Mathematics 2026-01-27 A. Iosevich , E. Palsson , A. Yavicoli

Reproducibility is imperative for any scientific discovery. More often than not, modern scientific findings rely on statistical analysis of high-dimensional data. At a minimum, reproducibility manifests itself in stability of statistical…

Statistics Theory · Mathematics 2013-10-02 Bin Yu

The problem of estimating a complex measure made up by a linear combination of Dirac distributions centered on points of the complex plane from a finite number of its complex moments affected by additive i.i.d. Gaussian noise is considered.…

Statistics Theory · Mathematics 2012-05-03 Piero Barone

This paper studies the learning of linear operators between infinite-dimensional Hilbert spaces. The training data comprises pairs of random input vectors in a Hilbert space and their noisy images under an unknown self-adjoint linear…

Statistics Theory · Mathematics 2023-05-12 Maarten V. de Hoop , Nikola B. Kovachki , Nicholas H. Nelsen , Andrew M. Stuart

We show that for every $k\in\mathbb{N}$ and $\varepsilon>0$, for large enough alphabet $R$, given a $k$-CSP with alphabet size $R$, it is NP-hard to distinguish between the case that there is an assignment satisfying at least…

Computational Complexity · Computer Science 2025-10-29 Dor Minzer , Kai Zhe Zheng

In this paper, we find a sample complexity bound for learning a simplex from noisy samples. Assume a dataset of size $n$ is given which includes i.i.d. samples drawn from a uniform distribution over an unknown simplex in $\mathbb{R}^K$,…

Machine Learning · Statistics 2023-05-02 Amir Hossein Saberi , Amir Najafi , Seyed Abolfazl Motahari , Babak H. Khalaj

The paper presents analytic expressions of minimax (worst-case) estimates for solutions of linear abstract Neumann problems in Hilbert space with uncertain (not necessarily bounded!) inputs and boundary conditions given incomplete…

Optimization and Control · Mathematics 2017-12-27 Alexander Nakonechnyi , Sergiy Zhuk

Sample complexity of bias estimation is a lower bound on the runtime of any bias detection method. Many regulatory frameworks require the bias to be tested for all subgroups, whose number grows exponentially with the number of protected…

Machine Learning · Computer Science 2025-02-06 German Martinez Matilla , Jakub Marecek

This paper considers the problem of recovering the permutation of an n-dimensional random vector X observed in Gaussian noise. First, a general expression for the probability of error is derived when a linear decoder (i.e., linear estimator…

Information Theory · Computer Science 2021-05-10 Minoh Jeong , Alex Dytso , Martina Cardone

A typical desideratum for quantifying the uncertainty from a classification model as a prediction set is class-conditional singleton set calibration. That is, such sets should map to the output of well-calibrated selective classifiers,…

Machine Learning · Computer Science 2022-12-02 Allen Schmaltz , Danielle Rasooly

We consider the problem of constructing confidence intervals (CIs) for the population mean of $N$ values $\{x_1, \ldots, x_N\} \subset \Sigma^N$ based on a random sample of size $n$, denoted by $X^n \equiv (X_1, \ldots, X_n)$, drawn…

Statistics Theory · Mathematics 2026-03-17 Shubhanshu Shekhar , Aaditya Ramdas

With the advent of massive data outputs at a regular rate, admittedly, signal processing technology plays an increasingly key role. Nowadays, signals are not merely restricted to physical sources, they have been extended to digital sources…

Information Theory · Computer Science 2015-07-28 Yi Lu

Stochastic approximation is a foundation for many algorithms found in machine learning and optimization. It is in general slow to converge: the mean square error vanishes as $O(n^{-1})$. A deterministic counterpart known as quasi-stochastic…

Optimization and Control · Mathematics 2024-03-26 Caio Kalil Lauand , Sean Meyn

This paper establishes the first almost sure convergence rate and the first maximal concentration bound with exponential tails for general contractive stochastic approximation algorithms with Markovian noise. As a corollary, we also obtain…

Machine Learning · Computer Science 2024-11-22 Xiaochi Qian , Zixuan Xie , Xinyu Liu , Shangtong Zhang