English
Related papers

Related papers: Optimal sampling and Christoffel functions on gene…

200 papers

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

When the nonconvex problem is complicated by stochasticity, the sample complexity of stochastic first-order methods may depend linearly on the problem dimension, which is undesirable for large-scale problems. In this work, we propose…

Optimization and Control · Mathematics 2024-10-01 Yue Xie , Jiawen Bi , Hongcheng Liu

We consider the problem of random sampling for band-limited functions. When can a band-limited function $f$ be recovered from randomly chosen samples $f(x_j), j\in \mathbb{N}$? We estimate the probability that a sampling inequality of the…

Probability · Mathematics 2011-04-27 Karlheinz Gröchenig , Richard F. Bass

We consider the problem of learning an $\varepsilon$-optimal policy in a general class of continuous-space Markov decision processes (MDPs) having smooth Bellman operators. Given access to a generative model, we achieve rate-optimal sample…

Machine Learning · Computer Science 2024-05-13 Davide Maran , Alberto Maria Metelli , Matteo Papini , Marcello Restelli

State estimation is a critical task in scientific, engineering and control applications. Since the reliability of reconstructions depends on the number and position of sensors, optimal sensor placement (OSP) is essential in scenarios where…

Machine Learning · Computer Science 2026-05-11 James Rowbottom , Nick Huang , Carola-Bibiane Schönlieb , Ben Adcock

Vandermonde matrices are usually exponentially ill-conditioned and often result in unstable approximations. In this paper, we introduce and analyze the \textit{multivariate Vandermonde with Arnoldi (V+A) method}, which is based on…

Numerical Analysis · Mathematics 2025-05-20 Wenqi Zhu , Yuji Nakatsukasa

We propose novel methods for approximate sampling recovery and integration of functions in the Freud-weighted Sobolev space $W^r_{p,w}(\mathbb{R})$. The approximation error of sampling recovery is measured in the norm of the Freud-weighted…

Numerical Analysis · Mathematics 2026-01-06 Dinh Dũng

We consider the problem of recovering a compactly-supported function from a finite collection of pointwise samples of its Fourier transform taking nonuniformly. First, we show that under suitable conditions on the sampling frequencies -…

Numerical Analysis · Mathematics 2014-04-08 Ben Adcock , Milana Gataric , Anders C. Hansen

We consider a design problem where experimental conditions (design points $X_i$) are presented in the form of a sequence of i.i.d.\ random variables, generated with an unknown probability measure $\mu$, and only a given proportion…

Methodology · Statistics 2020-08-05 Luc Pronzato , HaiYing Wang

We propose a novel method for sampling and optimization tasks based on a stochastic interacting particle system. We explain how this method can be used for the following two goals: (i) generating approximate samples from a given target…

Dynamical Systems · Mathematics 2021-11-05 J. A. Carrillo , F. Hoffmann , A. M. Stuart , U. Vaes

We consider the problem of approximating an analytic function on a compact interval from its values at $M+1$ distinct points. When the points are equispaced, a recent result (the so-called impossibility theorem) has shown that the best…

Numerical Analysis · Mathematics 2018-04-09 Ben Adcock , Rodrigo Platte , Alexei Shadrin

Statistical inverse learning aims at recovering an unknown function $f$ from randomly scattered and possibly noisy point evaluations of another function $g$, connected to $f$ via an ill-posed mathematical model. In this paper we blend…

Statistics Theory · Mathematics 2024-01-22 Tapio Helin

We consider the problem of optimal recovery of an element $u$ of a Hilbert space $\mathcal{H}$ from $m$ measurements obtained through known linear functionals on $\mathcal{H}$. Problems of this type are well studied \cite{MRW} under an…

Numerical Analysis · Mathematics 2015-06-17 Peter Binev , Albert Cohen , Wolfgang Dahmen , Ronald DeVore , Guergana Petrova , Przemyslaw Wojtaszczyk

We construct a least squares approximation method for the recovery of complex-valued functions from a reproducing kernel Hilbert space on $D \subset \mathbb{R}^d$. The nodes are drawn at random for the whole class of functions and the error…

Numerical Analysis · Mathematics 2021-04-05 Lutz Kämmerer , Tino Ullrich , Toni Volkmer

The reconstruction of unknown functions from a finite number of samples is a fundamental challenge in pure and applied mathematics. This survey provides a comprehensive overview of recent developments in sampling recovery, focusing on the…

Numerical Analysis · Mathematics 2026-01-14 F. Dai , V. Temlyakov

In linear regression we wish to estimate the optimum linear least squares predictor for a distribution over $d$-dimensional input points and real-valued responses, based on a small sample. Under standard random design analysis, where the…

Machine Learning · Statistics 2022-06-08 Michał Dereziński , Manfred K. Warmuth , Daniel Hsu

In this paper, we introduce a method known as polynomial frame approximation for approximating smooth, multivariate functions defined on irregular domains in $d$ dimensions, where $d$ can be arbitrary. This method is simple, and relies only…

Numerical Analysis · Mathematics 2020-05-27 Ben Adcock , Daan Huybrechs

Computing averages over a target probability density by statistical re-weighting of a set of samples with a different distribution is a strategy which is commonly adopted in fields as diverse as atomistic simulation and finance. Here we…

Chemical Physics · Physics 2012-02-21 Michele Ceriotti , Guy A. R. Brain , Oliver Riordan , David E. Manolopoulos

We construct Monte Carlo methods for the $L^2$-approximation in Hilbert spaces of multivariate functions sampling no more than $n$ function values of the target function. Their errors catch up with the rate of convergence and the…

Numerical Analysis · Mathematics 2018-03-16 David Krieg

Functions with discontinuities appear in many applications such as image reconstruction, signal processing, optimal control problems, interface problems, engineering applications and so on. Accurate approximation and interpolation of these…

Numerical Analysis · Mathematics 2023-02-07 Mohammad Karimnejad Esfahani , Stefano De Marchi , Francesco Marchetti