English

Wavelet regression and additive models for irregularly spaced data

Machine Learning 2019-03-13 v1 Machine Learning

Abstract

We present a novel approach for nonparametric regression using wavelet basis functions. Our proposal, waveMesh\texttt{waveMesh}, can be applied to non-equispaced data with sample size not necessarily a power of 2. We develop an efficient proximal gradient descent algorithm for computing the estimator and establish adaptive minimax convergence rates. The main appeal of our approach is that it naturally extends to additive and sparse additive models for a potentially large number of covariates. We prove minimax optimal convergence rates under a weak compatibility condition for sparse additive models. The compatibility condition holds when we have a small number of covariates. Additionally, we establish convergence rates for when the condition is not met. We complement our theoretical results with empirical studies comparing waveMesh\texttt{waveMesh} to existing methods.

Keywords

Cite

@article{arxiv.1903.04631,
  title  = {Wavelet regression and additive models for irregularly spaced data},
  author = {Asad Haris and Noah Simon and Ali Shojaie},
  journal= {arXiv preprint arXiv:1903.04631},
  year   = {2019}
}
R2 v1 2026-06-23T08:04:58.175Z