English
Related papers

Related papers: Infinite-Dimensional Integration in Weighted Hilbe…

200 papers

Smolyak's method, also known as hyperbolic cross approximation or sparse grid method, is a powerful tool to tackle multivariate tensor product problems solely with the help of efficient algorithms for the corresponding univariate problem.…

Numerical Analysis · Mathematics 2021-09-21 Michael Gnewuch , Marcin Wnuk

We consider the global minimization of smooth functions based solely on function evaluations. Algorithms that achieve the optimal number of function evaluations for a given precision level typically rely on explicitly constructing an…

Optimization and Control · Mathematics 2020-12-23 Alessandro Rudi , Ulysse Marteau-Ferey , Francis Bach

Consider the numerical integration $${\rm Int}_{\mathbb S^d,w}(f)=\int_{\mathbb S^d}f({\bf x})w({\bf x}){\rm d}\sigma({\bf x}) $$ for weighted Sobolev classes $BW_{p,w}^r(\mathbb S^d)$ with a Dunkl weight $w$ and weighted Besov classes…

Numerical Analysis · Mathematics 2024-12-24 Jiansong Li , Heping Wang

We study the recovery of multivariate functions from reproducing kernel Hilbert spaces in the uniform norm. Our main interest is to obtain preasymptotic estimates for the corresponding sampling numbers. We obtain results in terms of the…

Numerical Analysis · Mathematics 2024-10-29 Kateryna Pozharska , Tino Ullrich

We show that a very simple randomised algorithm for numerical integration can produce a near optimal rate of convergence for integrals of functions in the $d$-dimensional weighted Korobov space. This algorithm uses a lattice rule with a…

Numerical Analysis · Mathematics 2023-04-21 Frances Y. Kuo , Dirk Nuyens , Laurence Wilkes

It is more and more frequently the case in applications that the data we observe come from one or more random variables taking values in an infinite dimensional space, e.g. curves. The need to have tools adapted to the nature of these data…

Statistics Theory · Mathematics 2023-06-01 Angelina Roche

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

In this article, we study the convergence behavior of the regularization-based algorithm for solving the polynomial regression model when both input data and responses are from infinite-dimensional Hilbert spaces. We derive convergence…

Statistics Theory · Mathematics 2025-12-02 Naveen Gupta , Sivananthan Sampath

We study the convergence of a random iterative sequence of a family of operators on infinite dimensional Hilbert spaces, inspired by the Stochastic Gradient Descent (SGD) algorithm in the case of the noiseless regression, as studied in [1].…

Functional Analysis · Mathematics 2022-09-02 Soumyadip Ghosh , Yingdong Lu , Tomasz J. Nowicki

We present and analyze a novel sparse polynomial technique for approximating high-dimensional Hilbert-valued functions, with application to parameterized partial differential equations (PDEs) with deterministic and stochastic inputs. Our…

Numerical Analysis · Mathematics 2020-01-22 Nick Dexter , Hoang Tran , Clayton Webster

A central challenge in transfer learning is designing algorithms that can quickly adapt and generalize to new tasks without retraining. Yet, the conditions of when and how algorithms can effectively transfer to new tasks is poorly…

Machine Learning · Computer Science 2025-05-20 Tyler Ingebrand , Adam J. Thorpe , Ufuk Topcu

In this paper, we study the approximation of $d$-dimensional $\rho$-weighted integrals over unbounded domains $\mathbb{R}_+^d$ or $\mathbb{R}^d$ using a special change of variables, so that quasi-Monte Carlo (QMC) or sparse grid rules can…

Numerical Analysis · Mathematics 2018-12-12 Peter Kritzer , Friedrich Pillichshammer , Leszek Plaskota , G. W. Wasilkowski

Adapting pre-trained foundation models for various downstream tasks has been prevalent in artificial intelligence. Due to the vast number of tasks and high costs, adjusting all parameters becomes unfeasible. To mitigate this, several…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Chongjie Si , Xuehui Wang , Xue Yang , Zhengqin Xu , Qingyun Li , Jifeng Dai , Yu Qiao , Xiaokang Yang , Wei Shen

We address the problem of estimating a high-dimensional matrix from linear measurements, with a focus on designing optimal rank-adaptive algorithms. These algorithms infer the matrix by estimating its singular values and the corresponding…

Information Theory · Computer Science 2026-05-12 Frédéric Zheng , Yassir Jedra , Alexandre Proutiere

In this paper, we show that the approximation of high-dimensional functions, which are effectively low-dimensional, does not suffer from the curse of dimensionality. This is shown first in a general reproducing kernel Hilbert space set-up…

Numerical Analysis · Mathematics 2024-11-28 Christian Rieger , Holger Wendland

The computational cost of solving an inverse problem governed by PDEs, using multiple experiments, increases linearly with the number of experiments. A recently proposed method to decrease this cost uses only a small number of random linear…

Optimization and Control · Mathematics 2017-08-02 Benjamin Crestel , Alen Alexanderian , Georg Stadler , Omar Ghattas

We mainly study numerical integration of real valued functions defined on the $d$-dimensional unit cube with all partial derivatives up to some finite order $r\ge1$ bounded by one. It is well known that optimal algorithms that use $n$…

Numerical Analysis · Mathematics 2017-06-22 Aicke Hinrichs , Erich Novak , Mario Ullrich , Henryk Wozniakowski

Modern datasets across many disciplines increasingly consist of time-evolving, potentially infinite-dimensional random objects, such as dynamic functional data, which are naturally modeled in Hilbert spaces. In these settings,…

Machine Learning · Statistics 2026-05-08 Daniel López-Montero , Antonio Álvarez-López , Marcos Matabuena

We design a Quasi-Polynomial time deterministic approximation algorithm for computing the integral of a multi-dimensional separable function, supported by some underlying hyper-graph structure, appropriately defined. Equivalently, our…

Data Structures and Algorithms · Computer Science 2024-02-14 David Gamarnik , Devin Smedira

Classifying points in high dimensional spaces is a fundamental geometric problem in machine learning. In this paper, we address classifying points in the $d$-dimensional Hilbert polygonal metric. The Hilbert metric is a generalization of…

Computational Geometry · Computer Science 2026-01-21 Aditya Acharya , Auguste H. Gezalyan , David M. Mount