English
Related papers

Related papers: The Random Feature Model for Input-Output Maps bet…

200 papers

Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed…

Numerical Analysis · Mathematics 2023-05-08 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino

We present a collection of algorithms which utilize dimensional reduction to perform mesh refinement and study possibly singular solutions of time-dependent partial differential equations. The algorithms are inspired by constructions used…

Numerical Analysis · Mathematics 2007-06-21 Panagiotis Stinis

In this article, we solve a deterministically generalized interpolation problem by a stochastic approach. We introduce a kernel-based probability measure on a Banach space by a covariance kernel which is defined on the dual space of the…

Numerical Analysis · Mathematics 2017-10-17 Qi Ye

Let $(e_i)$ be a fundamental system of a Banach space. We consider the problem of approximating linear combinations of elements of this system by linear combinations using quantized coefficients. We will concentrate on systems which are…

Functional Analysis · Mathematics 2015-05-13 P. G. Casazza , S. J. Dilworth , E. Odell , Th. Schlumprecht , Andras Zsak

Research in machine learning has polarized into two general approaches for regression tasks: Transductive methods construct estimates directly from available data but are usually problem unspecific. Inductive methods can be much more…

Machine Learning · Computer Science 2023-05-19 Mathieu Chalvidal , Thomas Serre , Rufin VanRullen

Over the last decade, approximating functions in infinite dimensions from samples has gained increasing attention in computational science and engineering, especially in computational uncertainty quantification. This is primarily due to the…

Numerical Analysis · Mathematics 2023-10-18 Ben Adcock , Nick Dexter , Sebastian Moraga

This paper introduces a hypothesis space for deep learning based on deep neural networks (DNNs). By treating a DNN as a function of two variables - the input variable and the parameter variable - we consider the set of DNNs where the…

Machine Learning · Statistics 2025-08-15 Rui Wang , Yuesheng Xu , Mingsong Yan

We present two effective methods for solving high-dimensional partial differential equations (PDE) based on randomized neural networks. Motivated by the universal approximation property of this type of networks, both methods extend the…

Numerical Analysis · Mathematics 2023-09-14 Yiran Wang , Suchuan Dong

Metric projection operators can be defined in similar wayin Hilbert and Banach spaces. At the same time, they differ signifitiantly in their properties. Metric projection operator in Hilbert space is a monotone and nonexpansive operator. It…

funct-an · Mathematics 2016-08-31 Ya. I. Alber

A powerful and flexible approach to structured prediction consists in embedding the structured objects to be predicted into a feature space of possibly infinite dimension by means of output kernels, and then, solving a regression problem in…

Machine Learning · Statistics 2020-11-03 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc

Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated…

Machine Learning · Statistics 2017-12-29 Fatemeh Sheikholeslami , Dimitris Berberidis , Georgios B. Giannakis

Geometric quantiles are location parameters which extend classical univariate quantiles to normed spaces (possibly infinite-dimensional) and which include the geometric median as a special case. The infinite-dimensional setting is highly…

Statistics Theory · Mathematics 2026-02-13 Gabriel Romon

Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In…

We propose inferential tools for functional linear quantile regression where the conditional quantile of a scalar response is assumed to be a linear functional of a functional covariate. In contrast to conventional approaches, we employ…

Statistics Theory · Mathematics 2022-02-25 Peijun Sang , Zuofeng Shang , Pang Du

Kernel method has been developed as one of the standard approaches for nonlinear learning, which however, does not scale to large data set due to its quadratic complexity in the number of samples. A number of kernel approximation methods…

Machine Learning · Computer Science 2018-09-20 Lingfei Wu , Ian E. H. Yen , Jie Chen , Rui Yan

Random features are a powerful technique for rewriting positive-definite kernels as linear products. They bring linear tools to bear in important nonlinear domains like KNNs and attention. Unfortunately, practical implementations require…

Machine Learning · Computer Science 2024-10-25 Luke Sernau , Silvano Bonacina , Rif A. Saurous

Kernel methods in machine learning use a kernel function that takes two data points as input and returns their inner product after mapping them to a Hilbert space, implicitly and without actually computing the mapping. For many kernel…

Machine Learning · Computer Science 2024-10-17 Kamaledin Ghiasi-Shirazi , Mohammadreza Qaraei

Random feature maps are used to decrease the computational cost of kernel machines in large-scale problems. The Mondrian kernel is one such example of a fast random feature approximation of the Laplace kernel, generated by a computationally…

Machine Learning · Computer Science 2025-03-13 Calvin Osborne , Eliza O'Reilly

This paper explores the efficacy of diffusion-based generative models as neural operators for partial differential equations (PDEs). Neural operators are neural networks that learn a mapping from the parameter space to the solution space of…

Machine Learning · Computer Science 2024-12-17 Katsiaryna Haitsiukevich , Onur Poyraz , Pekka Marttinen , Alexander Ilin

Here we research the univariate quantitative approximation, ordinary and fractional, of Banach space valued continuous functions on a compact interval or all the real line by quasi-interpolation Banach space valued neural network operators.…

Machine Learning · Statistics 2022-02-16 George A Anastassiou