English
Related papers

Related papers: Univariate error function based neural network app…

200 papers

Approximating functions by a linear span of truncated basis sets is a standard procedure for the numerical solution of differential and integral equations. Commonly used concepts of approximation methods are well-posed and convergent, by…

Numerical Analysis · Mathematics 2022-12-14 Yahya Saleh , Armin Iske , Andrey Yachmenev , Jochen Küpper

Graph-based approximation methods are of growing interest in many areas, including transportation, biological and chemical networks, financial models, image processing, network flows, and more. In these applications, often a basis for the…

Numerical Analysis · Mathematics 2024-03-18 Edward J. Fuselier , John Paul Ward

Until recently, applications of neural networks in machine learning have almost exclusively relied on real-valued networks. It was recently observed, however, that complex-valued neural networks (CVNNs) exhibit superior performance in…

Functional Analysis · Mathematics 2021-12-06 A. Caragea , D. G. Lee , J. Maly , G. Pfander , F. Voigtlaender

Motivated by the abundance of functional data such as time series and images, there has been a growing interest in integrating such data into neural networks and learning maps from function spaces to R (i.e., functionals). In this paper, we…

Machine Learning · Statistics 2024-03-20 Tian-Yi Zhou , Namjoon Suh , Guang Cheng , Xiaoming Huo

The universal approximation theorem establishes that neural networks can approximate any continuous function on a compact set. Later works in approximation theory provide quantitative approximation rates for ReLU networks on the class of…

Machine Learning · Computer Science 2026-04-17 Jonathan W. Siegel , Snir Hordan , Hannah Lawrence , Ali Syed , Nadav Dym

Ratios of quadratic forms in correlated normal variables which introduce noncentrality into the quadratic forms are considered. The denominator is assumed to be positive (with probability 1). Various serial correlation estimates such as…

Statistics Theory · Mathematics 2008-12-18 Ronald W. Butler , Marc S. Paolella

We present a generalized version of the discretization-invariant neural operator and prove that the network is a universal approximation in the operator sense. Moreover, by incorporating additional terms in the architecture, we establish a…

Numerical Analysis · Mathematics 2023-07-20 Zecheng Zhang , Wing Tat Leung , Hayden Schaeffer

In approximation theory classical discrete operators, like generalized sampling, Sz\'{a}sz-Mirak'jan, Baskakov and Bernstein operators, have been extensively studied for scalar functions. In this paper, we look at the approximation of…

Functional Analysis · Mathematics 2024-05-14 Rosario Corso , Gabriele Gucciardi

In the desire to quantify the success of neural networks in deep learning and other applications, there is a great interest in understanding which functions are efficiently approximated by the outputs of neural networks. By now, there…

We study feedforward neural networks with inputs from a topological space (TFNNs). We prove a universal approximation theorem for shallow TFNNs, which demonstrates their capacity to approximate any continuous function defined on this…

Machine Learning · Computer Science 2026-01-23 Vugar Ismailov

In this work, we introduce a new class of neural network operators designed to handle problems where memory effects and randomness play a central role. In this work, we introduce a new class of neural network operators designed to handle…

Machine Learning · Computer Science 2025-05-22 Rômulo Damasclin Chaves dos Santos , Jorge Henrique de Oliveira Sales

Convolutional neural networks are the most widely used type of neural networks in applications. In mathematical analysis, however, mostly fully-connected networks are studied. In this paper, we establish a connection between both network…

Functional Analysis · Mathematics 2021-01-29 Philipp Petersen , Felix Voigtlaender

While Bayesian neural networks (BNNs) hold the promise of being flexible, well-calibrated statistical models, inference often requires approximations whose consequences are poorly understood. We study the quality of common variational…

Machine Learning · Statistics 2020-10-26 Andrew Y. K. Foong , David R. Burt , Yingzhen Li , Richard E. Turner

We study the approximation of functions by tensor networks (TNs). We show that Lebesgue $L^p$-spaces in one dimension can be identified with tensor product spaces of arbitrary order through tensorization. We use this tensor product…

Functional Analysis · Mathematics 2024-06-26 Mazen Ali , Anthony Nouy

We present a Fourier neural network (FNN) that can be mapped directly to the Fourier decomposition. The choice of activation and loss function yields results that replicate a Fourier series expansion closely while preserving a…

Machine Learning · Computer Science 2021-04-30 Marieme Ngom , Oana Marin

Most of machine learning approaches have stemmed from the application of minimizing the mean squared distance principle, based on the computationally efficient quadratic optimization methods. However, when faced with high-dimensional and…

Machine Learning · Computer Science 2017-01-24 A. N. Gorban , E. M. Mirkes , A. Zinovyev

We study news neural networks to approximate function of distributions in a probability space. Two classes of neural networks based on quantile and moment approximation are proposed to learn these functions and are theoretically supported…

Machine Learning · Statistics 2023-03-21 Xavier Warin

Motivated by the rapidly growing field of mathematics for operator approximation with neural networks, we present a novel universal operator approximation theorem for a broad class of encoder-decoder architectures. In this study, we focus…

Functional Analysis · Mathematics 2025-04-01 Janek Gödeke , Pascal Fernsel

In this paper, we develop a theory about the relationship between $G$-invariant/equivariant functions and deep neural networks for finite group $G$. Especially, for a given $G$-invariant/equivariant function, we construct its universal…

Machine Learning · Computer Science 2019-09-27 Akiyoshi Sannai , Yuuki Takai , Matthieu Cordonnier

In this paper, we firstly introduce nonlinear truncated Baskakov operators on compact intervals and obtain some direct theorems. Also, we give the approximation of fuzzy numbers by truncated nonlinear Baskakov operators.

General Mathematics · Mathematics 2023-12-04 Ecem Acar , Sevilay Kirci Serenbay , Saleem Yaseen Majeed Al Khalidy