English
Related papers

Related papers: An Optimal Weighted Least-Squares Method for Opera…

200 papers

Minimizing PDE-residual losses is a common strategy to promote physical consistency in neural operators. However, standard formulations often lack variational correctness, meaning that small residuals do not guarantee small solution errors…

Numerical Analysis · Mathematics 2025-12-25 Yuan Qiu , Wolfgang Dahmen , Peng Chen

We consider the problem of approximating a function in general nonlinear subsets of $L^2$ when only a weighted Monte Carlo estimate of the $L^2$-norm can be computed. Of particular interest in this setting is the concept of sample…

Numerical Analysis · Mathematics 2021-08-12 Philipp Trunschke

Hypothesis testing procedures are developed to assess linear operator constraints in function-on-scalar regression when incomplete functional responses are observed. The approach enables statistical inferences about the shape and other…

Methodology · Statistics 2022-12-06 Yeonjoo Park , Kyunghee Han , Douglas G. Simpson

The least-squares support vector machine is a frequently used kernel method for non-linear regression and classification tasks. Here we discuss several approximation algorithms for the least-squares support vector machine classifier. The…

Machine Learning · Computer Science 2017-03-24 M. Andrecut

This work develops algorithms for non-parametric confidence regions for samples from a univariate distribution whose support is a discrete mesh bounded on the left. We generalize the theory of Learned-Miller to preorders over the sample…

Computation · Statistics 2026-02-11 George Bissias

In this chapter, we discuss recent work on learning sparse approximations to high-dimensional functions on data, where the target functions may be scalar-, vector- or even Hilbert space-valued. Our main objective is to study how the…

Numerical Analysis · Mathematics 2022-02-08 Ben Adcock , Juan M. Cardenas , Nick Dexter , Sebastian Moraga

In this paper we investigate the problem of learning an unknown bounded function. We be emphasize special cases where it is possible to provide very simple (in terms of computation) estimates enjoying in addition the property of being…

Statistics Theory · Mathematics 2007-06-13 Gerard Kerkyacharian , Dominique Picard

In this paper we obtain quantitative weighted $L^p$-inequalities for some operators involving Bessel convolutions. We consider maximal operators, Littlewood-Paley functions and variational operators. We obtain $L^p(w)$-operator norms in…

Classical Analysis and ODEs · Mathematics 2021-10-06 Víctor Almeida , Jorge J. Betancor , Juan C. Fariña , Lourdes Rodríguez-Mesa

We analyze the oracle complexity of the stochastic Halpern iteration with minibatch, where we aim to approximate fixed-points of nonexpansive and contractive operators in a normed finite-dimensional space. We show that if the underlying…

Optimization and Control · Mathematics 2025-05-13 Mario Bravo , Juan Pablo Contreras

By a theorem of Gordon and Hedenmalm, $\varphi$ generates a bounded composition operator on the Hilbert space $\mathscr{H}^2$ of Dirichlet series $\sum_n b_n n^{-s}$ with square-summable coefficients $b_n$ if and only if $\varphi(s)=c_0…

Functional Analysis · Mathematics 2015-02-23 Hervé Queffélec , Kristian Seip

Compressed sensing is a technique to sample compressible signals below the Nyquist rate, whilst still allowing near optimal reconstruction of the signal. In this paper we present a theoretical analysis of the iterative hard thresholding…

Information Theory · Computer Science 2008-05-06 Thomas Blumensath , Mike E. Davies

This paper addresses a learning problem for nonlinear dynamical systems with incorporating any specified dissipativity property. The nonlinear systems are described by the Koopman operator, which is a linear operator defined on the…

Systems and Control · Electrical Eng. & Systems 2019-11-12 Keita Hara , Masaki Inoue , Noboru Sebe

We consider the problem of reconstructing an unknown function $f$ on a domain $X$ from samples of $f$ at $n$ randomly chosen points with respect to a given measure $\rho_X$. Given a sequence of linear spaces $(V_m)_{m>0}$ with ${\rm…

Numerical Analysis · Mathematics 2018-06-19 Albert Cohen , Mark A. Davenport , Dany Leviatan

Operator learning problems arise in many key areas of scientific computing where Partial Differential Equations (PDEs) are used to model physical systems. In such scenarios, the operators map between Banach or Hilbert spaces. In this work,…

Machine Learning · Computer Science 2024-10-31 Ben Adcock , Nick Dexter , Sebastian Moraga

We study estimation of a multivariate function $f:\mathbf{R}^d\to\mathbf{R}$ when the observations are available from the function $Af$, where $A$ is a known linear operator. Both the Gaussian white noise model and density estimation are…

Statistics Theory · Mathematics 2010-01-14 Jussi Klemelä , Enno Mammen

We provide performance guarantees for a variant of simulation-based policy iteration for controlling Markov decision processes that involves the use of stochastic approximation algorithms along with state-of-the-art techniques that are…

Machine Learning · Computer Science 2022-10-17 Anna Winnicki , R. Srikant

In this paper, we propose new learning algorithms for approximating high-dimensional functions using tree tensor networks in a least-squares setting. Given a dimension tree or architecture of the tensor network, we provide an algorithm that…

Numerical Analysis · Mathematics 2021-04-29 Cécile Haberstich , Anthony Nouy , Guillaume Perrin

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

We present an algorithm for learning operators between Banach spaces, based on the use of Leray-Schauder mappings to learn a finite-dimensional approximation of compact subspaces. We show that the resulting method is a universal…

Machine Learning · Computer Science 2026-03-03 Emanuele Zappala

The $k$-nearest neighbor algorithm ($k$-NN) is a widely used non-parametric method for classification and regression. We study the mean squared error of the $k$-NN estimator when $k$ is chosen by leave-one-out cross-validation (LOOCV).…

Statistics Theory · Mathematics 2020-02-18 Mona Azadkia