English
Related papers

Related papers: Simultaneous approximation by neural network opera…

200 papers

The motivation of this paper is the development of an optimisation method for solving optimisation problems appearing in Chebyshev rational and generalised rational approximation problems, where the approximations are constructed as ratios…

Optimization and Control · Mathematics 2020-11-06 R. Díaz Millán , Nadezda Sukhorukova , Julien Ugon

Universal approximation theorems are the foundations of classical neural networks, providing theoretical guarantees that the latter are able to approximate maps of interest. Recent results have shown that this can also be achieved in a…

Quantum Physics · Physics 2025-04-14 Lukas Gonon , Antoine Jacquier

We prove maximum and comparison principles for fractional discrete derivatives in the integers. Regularity results when the space is a mesh of length $h$, and approximation theorems to the continuous fractional derivatives are shown. When…

Analysis of PDEs · Mathematics 2016-05-24 Luciano Abadías , Marta de León-Contreras , José L. Torrea

We give some Korovkin-type theorems on convergence and estimates of rates of approximations of nets of functions, satisfying suitable axioms, whose particular cases are filter/ideal convergence, almost convergence and triangular…

Functional Analysis · Mathematics 2021-01-15 Antonio Boccuto , Xenofon Dimitriou

In this paper, we explain the universal approximation capabilities of deep residual neural networks through geometric nonlinear control. Inspired by recent work establishing links between residual networks and control systems, we provide a…

Machine Learning · Computer Science 2024-02-12 Paulo Tabuada , Bahman Gharesifard

We consider the problem of approximating flow functions of continuous-time dynamical systems with inputs. It is well-known that continuous-time recurrent neural networks are universal approximators of this type of system. In this paper, we…

Systems and Control · Electrical Eng. & Systems 2023-09-20 Miguel Aguiar , Amritam Das , Karl H. Johansson

In the present article, we propose the new class positive linear operators, which discrete type depending on a real parameters. These operators are similar to Jain operators but its approximation properties are different then Jain…

Classical Analysis and ODEs · Mathematics 2019-04-19 Prashantkumar Patel

Deep Neural Networks (DNNs) are universal function approximators providing state-of- the-art solutions on wide range of applications. Common perceptual tasks such as speech recognition, image classification, and object tracking are now…

Machine Learning · Statistics 2017-11-08 Randall Balestriero , Richard Baraniuk

We discuss how to evaluate the proximal operator of a convex and increasing function of a nuclear norm, which forms the key computational step in several first-order optimization algorithms such as (accelerated) proximal gradient descent…

Optimization and Control · Mathematics 2020-11-16 Zhengyuan Zhou , Yi Ma

We provide a general theorem on the asymptotic behavior of stochastic processes that conform to a relaxed supermartingale condition. The distinguishing feature of our result is that it provides quantitative convergence guarantees at a much…

Optimization and Control · Mathematics 2026-05-11 Morenikeji Neri , Nicholas Pischke , Thomas Powell

In this paper, we approximate a nonautonomous neural network with infinite delay and a Heaviside signal function by neural networks with sigmoidal signal functions. We show that the solutions of the sigmoidal models converge to those of the…

Dynamical Systems · Mathematics 2024-02-01 Peter E. Kloeden , V. M. Villarragut

This paper introduces the Simultaneous assignment problem. Let us given a graph with a weight and a capacity function on its edges, and a set of its subgraphs along with a degree upper bound function for each of them. We are also given a…

Data Structures and Algorithms · Computer Science 2023-01-24 Péter Madarasi

Density functional theory is one of the most efficient and widely used computational methods of quantum mechanics, especially in fields such as solid state physics and quantum chemistry. From the theoretical perspecive, its central object…

Chemical Physics · Physics 2025-11-25 Mihály A. Csirik , Andre Laestadius , Mathias Oster

We describe generalizations of the universal approximation theorem for neural networks to maps invariant or equivariant with respect to linear representations of groups. Our goal is to establish network-like computational models that are…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Dmitry Yarotsky

We define a neural network in infinite dimensional spaces for which we can show the universal approximation property. Indeed, we derive approximation results for continuous functions from a Fr\'echet space $\X$ into a Banach space $\Y$. The…

Functional Analysis · Mathematics 2022-05-18 Fred Espen Benth , Nils Detering , Luca Galimberti

We propose a two-phase systematical framework for approximation algorithm design and analysis via Lyapunov function. The first phase consists of using Lyapunov function as an input and outputs a continuous-time approximation algorithm with…

Optimization and Control · Mathematics 2022-09-08 Donglei Du

In this paper, we study a strong inverse approximation theorem and saturation order for the family of Kantorovich exponential sampling operators. The class of log-uniformly continuous and bounded functions, and class of log-H\"{o}lderian…

Functional Analysis · Mathematics 2023-10-11 Shivam Bajpeyi , A. Sathish Kumar , P. Devaraj

We consider neural network approximation spaces that classify functions according to the rate at which they can be approximated (with error measured in $L^p$) by ReLU neural networks with an increasing number of coefficients, subject to…

Functional Analysis · Mathematics 2021-10-29 Philipp Grohs , Felix Voigtlaender

Motivated by the rapidly growing field of mathematics for operator approximation with neural networks, we present a novel universal operator approximation theorem for a broad class of encoder-decoder architectures. In this study, we focus…

Functional Analysis · Mathematics 2025-04-01 Janek Gödeke , Pascal Fernsel

We describe a model element able to perform universal stochastic approximations of continuous multivariable functions in both neuron-like and quantum form. The implementation of this model in the form of a multi-barrier, multiple-slit…

Quantum Physics · Physics 2007-05-23 A. A. Ezhov , A. G. Khromov , G. P. Berman