English
Related papers

Related papers: Approximation by Neural Network operators in $L^p$…

200 papers

We study approximation by arbitrary linear combinations of $n$ translates of a single function of periodic functions. We construct some methods of this approximation for functions in a class induced by the convolution with a given function,…

Numerical Analysis · Mathematics 2017-03-01 Dinh Dũng , Charles A. Micchelli , Vu Nhat Huy

This paper studies the universal approximation property of deep neural networks for representing probability distributions. Given a target distribution $\pi$ and a source distribution $p_z$ both defined on $\mathbb{R}^d$, we prove under…

Machine Learning · Computer Science 2020-11-17 Yulong Lu , Jianfeng Lu

We explore the approximation capabilities of Transformer networks for H\"older and Sobolev functions, and apply these results to address nonparametric regression estimation with dependent observations. First, we establish novel upper bounds…

Machine Learning · Statistics 2025-04-17 Yuling Jiao , Yanming Lai , Defeng Sun , Yang Wang , Bokai Yan

We examine the necessary and sufficient complexity of neural networks to approximate functions from different smoothness spaces under the restriction of encodable network weights. Based on an entropy argument, we start by proving lower…

Functional Analysis · Mathematics 2020-09-21 Ingo Gühring , Mones Raslan

We demonstrate that a very deep ResNet with stacked modules with one neuron per hidden layer and ReLU activation functions can uniformly approximate any Lebesgue integrable function in $d$ dimensions, i.e. $\ell_1(\mathbb{R}^d)$. Because of…

Machine Learning · Computer Science 2018-07-05 Hongzhou Lin , Stefanie Jegelka

In this paper, we study the persistence approximation property for quantitative $K$-theory of filtered $L^p$ operator algebras. Moreover, we define quantitative assembly maps for $L^p$ operator algebras when $p\in [1,\infty)$. Finally, in…

Operator Algebras · Mathematics 2024-12-04 Hang Wang , Yanru Wang , Jianguo Zhang , Dapeng Zhou

The universal approximation property (UAP) of neural networks is fundamental for deep learning, and it is well known that wide neural networks are universal approximators of continuous functions within both the $L^p$ norm and the…

Machine Learning · Computer Science 2023-02-07 Yongqiang Cai

We prove a theorem, which generalises C. Franchetti's estimate for the norm of a projection onto a rich subspace of $L^p([0, 1])$ and the authors' related estimate for compact operators on $L^p([0, 1])$, $1 \le p < \infty$.

Functional Analysis · Mathematics 2020-08-18 Eugene Shargorodsky , Teo Sharia

This article concerns the expressive power of depth in neural nets with ReLU activations and bounded width. We are particularly interested in the following questions: what is the minimal width $w_{\text{min}}(d)$ so that ReLU nets of width…

Machine Learning · Statistics 2019-10-22 Boris Hanin

We consider a class of operator-induced norms, acting as finite-dimensional surrogates to the L2 norm, and study their approximation properties over Hilbert subspaces of L2 . The class includes, as a special case, the usual empirical norm…

Statistics Theory · Mathematics 2011-06-01 Arash A. Amini , Martin J. Wainwright

Here we research the univariate quantitative approximation of real and complex valued continuous functions on a compact interval or all the real line by quasi-interpolation, Baskakov type and quadrature type neural network operators. We…

Classical Analysis and ODEs · Mathematics 2014-04-28 George Anastassiou

The purpose of this article is to develop a technique to estimate certain bounds for entropy numbers of diagonal operator on spaces of p-summable sequences for finite p greater than 1. The approximation method we develop in this direction…

Functional Analysis · Mathematics 2022-07-08 K. P. Deepesh , V. B. Kiran Kumar

Approximation properties of multivariate quasi-projection operators are studied in the paper. Wide classes of such operators are considered, including the sampling and the Kantorovich-Kotelnikov type operators generated by different…

Classical Analysis and ODEs · Mathematics 2020-03-26 Yurii Kolomoitsev , Maria Skopina

We prove sharp uniform $L^p$-bounds for low-lying eigenfunctions of non-self-adjoint semiclassical pseudodifferential operators $P$ on $\mathbb{R}^{n}$ whose principal symbols are doubly-characteristic at the origin of $\mathbb{R}^{2n}$.…

Analysis of PDEs · Mathematics 2021-10-20 Francis White

We investigate properties of neural networks that use both ReLU and $x^2$ as activation functions and build upon previous results to show that both analytic functions and functions in Sobolev spaces can be approximated by such networks of…

Machine Learning · Computer Science 2023-01-31 Vincent P. H. Goverse , Jad Hamdan , Jared Tanner

The classical Universal Approximation Theorem holds for neural networks of arbitrary width and bounded depth. Here we consider the natural `dual' scenario for networks of bounded width and arbitrary depth. Precisely, let $n$ be the number…

Machine Learning · Computer Science 2020-06-09 Patrick Kidger , Terry Lyons

In this work, we address the question whether a sufficiently deep quantum neural network can approximate a target function as accurate as possible. We start with simple but typical physical situations that the target functions are physical…

Disordered Systems and Neural Networks · Physics 2021-09-01 Yadong Wu , Juan Yao , Pengfei Zhang , Hui Zhai

The classical development of neural networks has primarily focused on learning mappings between finite dimensional Euclidean spaces or finite sets. We propose a generalization of neural networks to learn operators, termed neural operators,…

We consider positive, integral-preserving linear operators acting on $L^1$ space, known as stochastic operators or Markov operators. We show that, on finite-dimensional spaces, any stochastic operator can be approximated by a sequence of…

Functional Analysis · Mathematics 2019-06-13 Shirin Moein , Rajesh Pereira , Sarah Plosker

In this note we prove that if a sublinear operator T satisfies a certain weighted estimate in the $L^{p}(w)$ space for all $w\in A_{p}$, $1<p<+\infty$, then the operator norm of T on $L^{p}(w)$ is a continuous function of the weight $w$,…

Classical Analysis and ODEs · Mathematics 2019-07-12 Michael Papadimitrakis , Nikolaos Pattakos
‹ Prev 1 3 4 5 6 7 10 Next ›