English
Related papers

Related papers: Additive models in high dimensions

200 papers

In this article we recover the distribution function (and possible density) of an arbitrary random variable that is subject to an additive measurement error. This problem is also known as deconvolution and has a long tradition in…

Statistics Theory · Mathematics 2025-10-07 Henrik Kaiser

As demonstrated in many areas of real-life applications, neural networks have the capability of dealing with high dimensional data. In the fields of optimal control and dynamical systems, the same capability was studied and verified in many…

Machine Learning · Computer Science 2020-12-04 Wei Kang , Qi Gong

This paper concerns the estimation of sums of functions of observable and unobservable variables. Lower bounds for the asymptotic variance and a convolution theorem are derived in general finite- and infinite-dimensional models. An explicit…

Statistics Theory · Mathematics 2007-06-13 Cun-Hui Zhang

The approximation of smooth functions with a spectral basis typically leads to rapidly decaying coefficients where the rate of decay depends on the smoothness of the function and vice-versa. The optimal number of degrees of freedom in the…

Numerical Analysis · Mathematics 2020-04-24 Vincent Coppé , Daan Huybrechs

We study the numerical integration problem for functions with infinitely many variables. The function spaces of integrands we consider are weighted reproducing kernel Hilbert spaces with norms related to the ANOVA decomposition of the…

Numerical Analysis · Mathematics 2021-09-21 Josef Dick , Michael Gnewuch

We consider the problem of estimating a function $s$ on $[-1,1]^{k}$ for large values of $k$ by looking for some best approximation by composite functions of the form $g\circ u$. Our solution is based on model selection and leads to a very…

Statistics Theory · Mathematics 2013-01-29 Yannick Baraud , Lucien Birgé

In this paper we present results on asymptotic characteristics of multivariate function classes in the uniform norm. Our main interest is the approximation of functions with mixed smoothness parameter not larger than $1/2$. Our focus will…

Functional Analysis · Mathematics 2021-11-01 Vladimir Temlyakov , Tino Ullrich

High dimensional superposition models characterize observations using parameters which can be written as a sum of multiple component parameters, each with its own structure, e.g., sum of low rank and sparse matrices, sum of sparse and…

Machine Learning · Computer Science 2017-06-01 Qilong Gu , Arindam Banerjee

In a previous paper [Adcock & Huybrechs, 2019] we described the numerical approximation of functions using redundant sets and frames. Redundancy in the function representation offers enormous flexibility compared to using a basis, but…

Numerical Analysis · Mathematics 2020-07-13 Ben Adcock , Daan Huybrechs

We consider a framework for the construction of iterative schemes for operator equations that combine low-rank approximation in tensor formats and adaptive approximation in a basis. Under fairly general assumptions, we obtain a rigorous…

Numerical Analysis · Mathematics 2014-03-17 Markus Bachmayr , Wolfgang Dahmen

A deep approximation is an approximating function defined by composing more than one layer of simple functions. We study deep approximations of functions of one variable using layers consisting of low-degree polynomials or simple conformal…

Numerical Analysis · Mathematics 2025-04-25 Kingsley Yeon

High-dimensional statistical inference deals with models in which the the number of parameters p is comparable to or larger than the sample size n. Since it is usually impossible to obtain consistent procedures unless $p/n\rightarrow0$, a…

Statistics Theory · Mathematics 2013-03-13 Sahand N. Negahban , Pradeep Ravikumar , Martin J. Wainwright , Bin Yu

In this paper, we introduce a method known as polynomial frame approximation for approximating smooth, multivariate functions defined on irregular domains in $d$ dimensions, where $d$ can be arbitrary. This method is simple, and relies only…

Numerical Analysis · Mathematics 2020-05-27 Ben Adcock , Daan Huybrechs

In Bayesian inverse problems sampling the posterior distribution is often a challenging task when the underlying models are computationally intensive. To this end, surrogates or reduced models are often used to accelerate the computation.…

Numerical Analysis · Mathematics 2019-09-04 Qifeng Liao , Jinglai Li

Many problems of theoretical and practical interest involve finding an optimum over a family of convex functions. For instance, finding the projection on the convex functions in $H^k(\Omega)$, and optimizing functionals arising from some…

Numerical Analysis · Mathematics 2008-04-11 Néstor E. Aguilera , Pedro Morin

In this paper we consider an orthonormal basis, generated by a tensor product of Fourier basis functions, half period cosine basis functions, and the Chebyshev basis functions. We deal with the approximation problem in high dimensions…

Numerical Analysis · Mathematics 2024-04-26 Daniel Potts , Pascal Schröter

This article advocates factorized and hybrid dimensional decompositions (FDD/HDD), as alternatives to analysis-of-variance dimensional decomposition (ADD), for second-moment statistical analysis of multivariate functions. New formulae…

Numerical Analysis · Mathematics 2013-10-28 Sharif Rahman

We study numerical integration of functions depending on an infinite number of variables. We provide lower error bounds for general deterministic linear algorithms and provide matching upper error bounds with the help of suitable multilevel…

Numerical Analysis · Mathematics 2021-02-09 Josef Dick , Michael Gnewuch

Subadditive set functions play a pivotal role in computational economics (especially in combinatorial auctions), combinatorial optimization or artificial intelligence applications such as interpretable machine learning. However, specifying…

Machine Learning · Computer Science 2026-03-12 Martin Černý , David Sychrovský , Filip Úradník , Jakub Černý

This paper introduces a novel algorithmic solution for the approximation of a given multivariate function by a nomographic function that is composed of a one-dimensional continuous and monotone outer function and a sum of univariate…

Information Theory · Computer Science 2015-07-14 Steffen Limmer , Jafar Mohammadi , Slawomir Stanczak