English
Related papers

Related papers: Learning multivariate functions with low-dimension…

200 papers

In this paper we consider an orthonormal basis, generated by a tensor product of Fourier basis functions, half period cosine basis functions, and the Chebyshev basis functions. We deal with the approximation problem in high dimensions…

Numerical Analysis · Mathematics 2024-04-26 Daniel Potts , Pascal Schröter

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

For multivariate nonparametric regression, functional analysis-of-variance (ANOVA) modeling aims to capture the relationship between a response and covariates by decomposing the unknown function into various components, representing main…

Methodology · Statistics 2019-06-20 Ting Yang , Zhiqiang Tan

In this paper, we concentrate on new methodologies for copulas introduced and developed by Joe, Cooke, Bedford, Kurowica, Daneshkhah and others on the new class of graphical models called vines as a way of constructing higher dimensional…

Computation · Statistics 2012-10-30 Alireza Daneshkhah , Golamali Parham , Omid Chatrabgoun , M. Jokar

Analysis of variance (ANOVA) is an extremely important method in exploratory and confirmatory data analysis. Unfortunately, in complex problems (e.g., split-plot designs), it is not always easy to set up an appropriate ANOVA. We propose a…

Statistics Theory · Mathematics 2007-06-13 Andrew Gelman

In recent years, the use of sparse recovery techniques in the approximation of high-dimensional functions has garnered increasing interest. In this work we present a survey of recent progress in this emerging topic. Our main focus is on the…

Numerical Analysis · Mathematics 2017-06-12 Ben Adcock , Simone Brugiapaglia , Clayton G. Webster

Functional decomposition is a powerful tool for systems analysis because it can reduce a function of arbitrary input dimensions to the sum and superposition of functions of a single variable, thereby mitigating (or potentially avoiding) the…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Jonah J. Glunt , Jacob A. Siefert , Andrew F. Thompson , Justin Ruths , Herschel C. Pangborn

We present a dimension-incremental method for function approximation in bounded orthonormal product bases to learn the solutions of various differential equations. Therefore, we decompose the source function of the differential equation…

Numerical Analysis · Mathematics 2025-05-20 Daniel Potts , Fabian Taubert

We study reduction schemes for functions of "many" variables into system of functions in one variable. Our setting includes infinite-dimensions. Following Cybenko-Kolmogorov, the outline for our results is as follows: We present explicit…

Functional Analysis · Mathematics 2019-03-08 Palle Jorgensen , Feng Tian

We study the numerical integration problem for functions with infinitely many variables. The function spaces of integrands we consider are weighted reproducing kernel Hilbert spaces with norms related to the ANOVA decomposition of the…

Numerical Analysis · Mathematics 2021-09-21 Josef Dick , Michael Gnewuch

A primary interest in dynamic inverse problems is to identify the underlying temporal behaviour of the system from outside measurements. In this work we consider the case, where the target can be represented by a decomposition of spatial…

Numerical Analysis · Mathematics 2020-06-09 Simon Arridge , Pascal Fernsel , Andreas Hauptmann

We enhance the approximation capabilities of algebraic polynomials by composing them with homeomorphisms. This composition yields families of functions that remain dense in the space of continuous functions, while enabling more accurate…

Numerical Analysis · Mathematics 2025-12-17 Álvaro Fernández Corral , Yahya Saleh

In this paper, we develop a systematic theory for high dimensional analysis of variance in multivariate linear regression, where the dimension and the number of coefficients can both grow with the sample size. We propose a new \emph{U}~type…

Methodology · Statistics 2023-01-12 Zhipeng Lou , Xianyang Zhang , Wei Biao Wu

We introduce a sampling theoretic framework for the recovery of smooth surfaces and functions living on smooth surfaces from few samples. The proposed approach can be thought of as a nonlinear generalization of union of subspace models…

Signal Processing · Electrical Eng. & Systems 2019-03-05 Qing Zou , Mathews Jacob

This paper discusses a methodology for determining a functional representation of a random process from a collection of scattered pointwise samples. The present work specifically focuses onto random quantities lying in a high dimensional…

Numerical Analysis · Mathematics 2014-01-03 Lionel Mathelin

A deep approximation is an approximating function defined by composing more than one layer of simple functions. We study deep approximations of functions of one variable using layers consisting of low-degree polynomials or simple conformal…

Numerical Analysis · Mathematics 2025-04-25 Kingsley Yeon

Supervised learning in function spaces is an emerging area of machine learning research with applications to the prediction of complex physical systems such as fluid flows, solid mechanics, and climate modeling. By directly learning maps…

Machine Learning · Computer Science 2022-06-09 Jacob H. Seidman , Georgios Kissas , Paris Perdikaris , George J. Pappas

This paper describes a novel method to approximate the polynomial coefficients of regression functions, with particular interest on multi-dimensional classification. The derivation is simple, and offers a fast, robust classification…

Machine Learning · Statistics 2012-03-27 Péter Kövesárki

We use hyperbolic wavelet regression for the fast reconstruction of high-dimensional functions having only low dimensional variable interactions. Compactly supported periodic Chui-Wang wavelets are used for the tensorized hyperbolic wavelet…

Numerical Analysis · Mathematics 2024-05-30 Daniel Potts , Laura Weidensager

In this paper, we address the problem of approximating a multivariate function defined on a general domain in $d$ dimensions from sample points. We consider weighted least-squares approximation in an arbitrary finite-dimensional space $P$…

Numerical Analysis · Mathematics 2019-12-17 Ben Adcock , Juan M. Cardenas