English
Related papers

Related papers: Kantorovich--Kernel Neural Operators: Approximatio…

200 papers

Training large-scale deep neural networks (DNNs) is resource-intensive, making model compression a practical necessity. The widely accepted ''learning as compression'' hypothesis posits that training induces structure in network weights,…

Machine Learning · Computer Science 2026-05-18 Pedram Bakhtiarifard , Sophia N. Wilson , Mahmoud Afifi , Jonathan Wenshøj , Raghavendra Selvan

We study approximation of multivariate periodic functions from Besov and Triebel--Lizorkin spaces of dominating mixed smoothness by the Smolyak algorithm constructed using a special class of quasi-interpolation operators of…

Classical Analysis and ODEs · Mathematics 2021-08-27 Yurii Kolomoitsev

Operator learning is reshaping scientific computing by amortizing inference across infinite families of problems. While neural operators (NOs) are increasingly well understood for regression, far less is known for classification and its…

In this paper, we introduce a method for multivariate function approximation using function evaluations, Chebyshev polynomials, and tensor-based compression techniques via the Tucker format. We develop novel randomized techniques to…

Numerical Analysis · Mathematics 2021-07-29 Arvind K. Saibaba , Rachel Minster , Misha E. Kilmer

This paper advances the study of multivariate function approximation using neural network operators activated by symmetrized and perturbed hyperbolic tangent functions. We propose new non-linear operators that preserve dynamic symmetries…

General Mathematics · Mathematics 2025-01-29 Rômulo Damasclin Chaves dos Santos , Jorge Henrique de Oliveira Sales

We consider factorization problem for differential operators on the commutative algebra of densities (defined either algebraically or in terms of an auxiliary extended manifold) introduced in 2004 by Khudaverdian and Voronov in connection…

Mathematical Physics · Physics 2019-01-08 Ekaterina Shemyakova , Theodore Voronov

We demonstrate that any Euclidean-time quantum mechanical theory may be represented as a neural network, ensured by the Kosambi-Karhunen-Lo\`eve theorem, mean-square path continuity, and finite two-point functions. The additional constraint…

High Energy Physics - Theory · Physics 2025-04-09 Christian Ferko , James Halverson

Sets represent a fundamental abstraction across many types of data. To handle the unordered nature of set-structured data, models such as DeepSets and PointNet rely on fixed, non-learnable pooling operations (e.g., sum or max) -- a design…

Machine Learning · Computer Science 2026-02-06 Tomas Tokar , Scott Sanner

Tensor decomposition of convolutional and fully-connected layers is an effective way to reduce parameters and FLOP in neural networks. Due to memory and power consumption limitations of mobile or embedded devices, the quantization step is…

Machine Learning · Computer Science 2023-08-10 Daria Cherniuk , Stanislav Abukhovich , Anh-Huy Phan , Ivan Oseledets , Andrzej Cichocki , Julia Gusak

Kantorovich operators are non-linear extensions of Markov operators and are omnipresent in several branches of mathematical analysis. The asymptotic behaviour of their iterates plays an important role even in classical ergodic, potential…

Analysis of PDEs · Mathematics 2024-01-02 Nassif Ghoussoub , Malcolm Bowles

We introduce and systematically develop two classes of discrete integrable operators: those with $2\times 2$ matrix kernels and those possessing general differential kernels, thereby generalizing the discrete analogue previously studied. A…

Exactly Solvable and Integrable Systems · Physics 2025-11-10 Huan Liu

The Kolmogorov-Arnold representation is a proven adequate replacement of a continuous multivariate function by an hierarchical structure of multiple functions of one variable. The proven existence of such representation inspired many…

Optimization and Control · Mathematics 2020-06-23 Andrew Polar , Michael Poluektov

In order to study continuous models of disordered topological phases, we construct an unbounded Kasparov module and a semifinite spectral triple for the crossed product of a separable $C^*$-algebra by a twisted $\mathbb{R}^d$-action. The…

Mathematical Physics · Physics 2018-07-02 Chris Bourne , Adam Rennie

While it is widely known that neural networks are universal approximators of continuous functions, a less known and perhaps more powerful result is that a neural network with a single hidden layer can approximate accurately any nonlinear…

Machine Learning · Computer Science 2021-11-03 Lu Lu , Pengzhan Jin , George Em Karniadakis

We present an efficient coresets-based neural network compression algorithm that sparsifies the parameters of a trained fully-connected neural network in a manner that provably approximates the network's output. Our approach is based on an…

Machine Learning · Computer Science 2019-05-21 Cenk Baykal , Lucas Liebenwein , Igor Gilitschenski , Dan Feldman , Daniela Rus

Continuous-variables (CV) quantum optics is a natural formalism for neural networks (NNs) due to its ability to reproduce the information processing of such trainable interconnected systems. In quantum optics, Gaussian operators induce…

Quantum Physics · Physics 2026-01-15 Todor Krasimirov-Ivanov , Alba Cervera-Lierta , Paolo Stornati , Federico Centrone

Neural operators are capable of capturing nonlinear mappings between infinite-dimensional functional spaces, offering a data-driven approach to modeling complex functional relationships in classical density functional theory (cDFT). In this…

Deep kernel learning provides an elegant and principled framework for combining the structural properties of deep learning algorithms with the flexibility of kernel methods. By means of a deep neural network, we learn a parametrized kernel…

Machine Learning · Computer Science 2020-12-14 Prudencio Tossou , Basile Dura , Francois Laviolette , Mario Marchand , Alexandre Lacoste

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of…

Machine Learning · Computer Science 2021-10-13 Sifan Wang , Hanwen Wang , Paris Perdikaris

We propose a novel extension to symmetrized neural network operators by incorporating fractional and mixed activation functions. This study addresses the limitations of existing models in approximating higher-order smooth functions,…

Machine Learning · Statistics 2025-01-22 Rômulo Damasclin Chaves dos Santos , Jorge Henrique de Oliveira Sales