English
Related papers

Related papers: An Optimal Weighted Least-Squares Method for Opera…

200 papers

We study the approximation numbers of weighted composition operators $f\mapsto w\cdot(f\circ\varphi)$ on the Hardy space $H^2$ on the unit disc. For general classes of such operators, upper and lower bounds on their approximation numbers…

Functional Analysis · Mathematics 2017-12-27 Gandalf Lechner , Daniel Li , Hervé Queffélec , Luis Rodríguez-Piazza

This paper investigates system identification problems with Gaussian inputs and quantized observations under fixed thresholds. By reinterpreting the nonlinear effects induced by quantization as the product of the unknown parameter and an…

Optimization and Control · Mathematics 2025-10-20 Xingrui Liu , Ying Wang , Yanlong Zhao

We investigate the theoretical foundations of a recently introduced entropy-based formulation of weighted least squares for the approximation of overdetermined linear systems, motivated by robust data fitting in the presence of sparse gross…

Numerical Analysis · Mathematics 2026-03-17 Felice Iavernaro , Monica Lazzo , Lorenzo Pisani

We consider the fundamental learning problem of estimating properties of distributions over large domains. Using a novel piecewise-polynomial approximation technique, we derive the first unified methodology for constructing sample- and…

Machine Learning · Computer Science 2020-03-18 Yi Hao , Alon Orlitsky

We derive minimax adaptive rates for a new, broad class of Tikhonov-regularized learning problems in Hilbert scales under general source conditions. Our analysis does not require the regression function to be contained in the hypothesis…

Statistics Theory · Mathematics 2023-09-19 Prem Talwai , David Simchi-Levi

Learning a robust classifier from a few samples remains a key challenge in machine learning. A major thrust of research has been focused on developing $k$-nearest neighbor ($k$-NN) based algorithms combined with metric learning that…

Machine Learning · Statistics 2022-02-17 Shixiang Zhu , Liyan Xie , Minghe Zhang , Rui Gao , Yao Xie

The paper presents analytic expressions of minimax (worst-case) estimates for solutions of linear abstract Neumann problems in Hilbert space with uncertain (not necessarily bounded!) inputs and boundary conditions given incomplete…

Optimization and Control · Mathematics 2017-12-27 Alexander Nakonechnyi , Sergiy Zhuk

We consider the problem of approximating an analytic function on a compact interval from its values at $M+1$ distinct points. When the points are equispaced, a recent result (the so-called impossibility theorem) has shown that the best…

Numerical Analysis · Mathematics 2018-04-09 Ben Adcock , Rodrigo Platte , Alexei Shadrin

We consider the problem of heteroscedastic linear regression, where, given $n$ samples $(\mathbf{x}_i, y_i)$ from $y_i = \langle \mathbf{w}^{*}, \mathbf{x}_i \rangle + \epsilon_i \cdot \langle \mathbf{f}^{*}, \mathbf{x}_i \rangle$ with…

Machine Learning · Statistics 2023-07-04 Dheeraj Baby , Aniket Das , Dheeraj Nagaraj , Praneeth Netrapalli

We consider an incremental approximation method for solving variational problems in infinite-dimensional Hilbert spaces, where in each step a randomly and independently selected subproblem from an infinite collection of subproblems is…

Numerical Analysis · Mathematics 2018-03-06 Michael Griebel , Peter Oswald

Operator learning is a data-driven approximation of mappings between infinite-dimensional function spaces, such as the solution operators of partial differential equations. Kernel-based operator learning can offer accurate, theoretically…

Machine Learning · Computer Science 2025-12-22 Xinyue Yu , Hayden Schaeffer

This paper develops an interpretable, non-intrusive reduced-order modeling technique using regularized kernel interpolation. Existing non-intrusive approaches approximate the dynamics of a reduced-order model (ROM) by solving a data-driven…

Computational Engineering, Finance, and Science · Computer Science 2026-01-26 Alejandro N Diaz , Shane A McQuarrie , John T Tencer , Patrick J Blonigan

Traditional machine learning models, particularly neural networks, are rooted in finite-dimensional parameter spaces and nonlinear function approximations. This report explores an alternative formulation where learning tasks are expressed…

Machine Learning · Computer Science 2025-07-30 Andrew Kiruluta , Andreas Lemos , Priscilla Burity

We consider $\mathbb{L}_2$-approximation of elements of a Hermite space of analytic functions over $\mathbb{R}^s$. The Hermite space is a weighted reproducing kernel Hilbert space of real valued functions for which the Hermite coefficients…

Numerical Analysis · Mathematics 2015-10-09 Christian Irrgeher , Peter Kritzer , Friedrich Pillichshammer , Henryk Wozniakowski

This paper studies sparse covariance operator estimation for nonstationary processes with sharply varying marginal variance and small correlation lengthscale. We introduce a covariance operator estimator that adaptively thresholds the…

Statistics Theory · Mathematics 2025-06-23 Omar Al-Ghattas , Daniel Sanz-Alonso

We present Basis-to-Basis (B2B) operator learning, a novel approach for learning operators on Hilbert spaces of functions based on the foundational ideas of function encoders. We decompose the task of learning operators into two parts:…

Machine Learning · Computer Science 2024-11-13 Tyler Ingebrand , Adam J. Thorpe , Somdatta Goswami , Krishna Kumar , Ufuk Topcu

Operator learning offers a robust framework for approximating mappings between infinite-dimensional function spaces. It has also become a powerful tool for solving inverse problems in the computational sciences. This chapter surveys…

Numerical Analysis · Mathematics 2025-12-08 Nicholas H. Nelsen , Yunan Yang

We consider a high-probability non-asymptotic confidence estimation in the $\ell^2$-regularized non-linear least-squares setting with fixed design. In particular, we study confidence estimation for local minimizers of the regularized…

Machine Learning · Computer Science 2025-06-12 Ilja Kuzborskij , Yasin Abbasi Yadkori

This short study reformulates the statistical Bayesian learning problem using a quantum mechanics framework. Density operators representing ensembles of pure states of sample wave functions are used in place probability densities. We show…

Statistics Theory · Mathematics 2023-01-18 Yann Berquin

We study a non-linear statistical inverse learning problem, where we observe the noisy image of a quantity through a non-linear operator at some random design points. We consider the widely used Tikhonov regularization (or method of…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi , Gilles Blanchard , Peter Mathé
‹ Prev 1 4 5 6 7 8 10 Next ›