English
Related papers

Related papers: Non-Linear Interactions in Neural Network Operator…

200 papers

This paper discusses the interplay of symmetries and stability in the analysis and control of nonlinear dynamical systems and networks. Specifically, it combines standard results on symmetries and equivariance with recent convergence…

Dynamical Systems · Mathematics 2015-05-20 Giovanni Russo , Jean-Jacques E. Slotine

Deep neural networks are an attractive alternative for simulating complex dynamical systems, as in comparison to traditional scientific computing methods, they offer reduced computational costs during inference and can be trained directly…

Machine Learning · Computer Science 2024-05-01 Katarzyna Michałowska , Somdatta Goswami , George Em Karniadakis , Signe Riemer-Sørensen

We study the expressivity of deep neural networks. Measuring a network's complexity by its number of connections or by its number of neurons, we consider the class of functions for which the error of best approximation with networks of a…

Functional Analysis · Mathematics 2020-07-20 Rémi Gribonval , Gitta Kutyniok , Morten Nielsen , Felix Voigtlaender

We adopt an operator-theoretic perspective to analyze a class of nonlinear fixed-point iterations and discrete-time dynamical systems. Specifically, we study the Krasnoselskij iteration - at the heart of countless algorithmic schemes and…

Systems and Control · Electrical Eng. & Systems 2025-06-24 Diego Deplano , Sergio Grammatico , Mauro Franceschelli

The paper is devoted to hyperbolic (generally speaking, non-Lagrangian and nonlinear) partial differential systems possessing a full set of differential operators that map any function of one independent variable into a symmetry of the…

Exactly Solvable and Integrable Systems · Physics 2017-05-30 Sergey Ya. Startsev

Neural networks hold great potential to act as approximate models of nonlinear dynamical systems, with the resulting neural approximations enabling verification and control of such systems. However, in safety-critical contexts, the use of…

Machine Learning · Computer Science 2025-09-30 Frederik Baymler Mathiesen , Nikolaus Vertovec , Francesco Fabiano , Luca Laurenti , Alessandro Abate

This paper establishes several new inequalities for the $A$-norm and $A$-numerical radius of operator sums in semi-Hilbertian spaces, significantly advancing the existing theory. We present two fundamental refinements of the generalized…

Functional Analysis · Mathematics 2025-07-09 M. H. M. Rashid

We discuss non-commutative field theories in coordinate space. To do so we introduce pseudo-localized operators that represent interesting position dependent (gauge invariant) observables. The formalism may be applied to arbitrary field…

High Energy Physics - Theory · Physics 2007-05-23 David Berenstein , Robert G. Leigh

Integration over curved manifolds with higher codimension and, separately, discrete variants of continuous operators, have been two important, yet separate themes in harmonic analysis, discrete geometry and analytic number theory research.…

Number Theory · Mathematics 2020-06-18 Theresa C. Anderson , Eyvindur Ari Palsson , Angel V. Kumchev

Although very successfully used in conventional machine learning, convolution based neural network architectures -- believed to be inconsistent in function space -- have been largely ignored in the context of learning solution operators of…

To gain insight into the mechanisms behind machine learning methods, it is crucial to establish connections among the features describing data points. However, these correlations often exhibit a high-dimensional and strongly nonlinear…

Machine Learning · Computer Science 2025-03-04 Lorenzo Basile , Santiago Acevedo , Luca Bortolussi , Fabio Anselmi , Alex Rodriguez

Traditional nonparametric estimation methods often lead to a slow convergence rate in large dimensions and require unrealistically enormous sizes of datasets for reliable conclusions. We develop an approach based on partial derivatives,…

Methodology · Statistics 2024-08-20 Xiaowu Dai

In this paper we consider several problems of joint similarity to tuples of bounded linear operators in noncommutative polydomains and varieties associated with sets of noncommutative polynomials. We obtain analogues of classical results…

Functional Analysis · Mathematics 2014-12-05 Gelu Popescu

Koopman operators and transfer operators represent nonlinear dynamics in state space through its induced action on linear spaces of observables and measures, respectively. This framework enables the use of linear operator theory for…

Dynamical Systems · Mathematics 2025-06-06 Claire Valva , Dimitrios Giannakis

We study spectral properties of divergence form elliptic operators $-\textrm{div} [A(z) \nabla f(z)]$ with the Neumann boundary condition in planar domains (including some fractal type domains), that satisfy to the quasihyperbolic boundary…

Analysis of PDEs · Mathematics 2020-04-24 Vladimir Gol'dshtein , Valeryi Pchelintsev , Alexander Ukhlov

Neural networks can emulate nonlinear physical systems with high accuracy, yet they may produce physically-inconsistent results when violating fundamental constraints. Here, we introduce a systematic way of enforcing nonlinear analytic…

Computational Physics · Physics 2021-03-10 Tom Beucler , Michael Pritchard , Stephan Rasp , Jordan Ott , Pierre Baldi , Pierre Gentine

Data representation in non-Euclidean spaces has proven effective for capturing hierarchical and complex relationships in real-world datasets. Hyperbolic spaces, in particular, provide efficient embeddings for hierarchical structures. This…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Jacob Fein-Ashley , Ethan Feng , Minh Pham

Neural operators have emerged as powerful surrogates for the solution of partial differential equations (PDEs), yet their ability to handle general, highly variable boundary conditions (BCs) remains limited. Existing approaches often fail…

Machine Learning · Computer Science 2026-05-14 Sepehr Mousavi , Siddhartha Mishra , Laura De Lorenzis

The superposition operators have been widely studied in nonlinear analysis, which are essential for the well-posedness theory of nonlinear equations. In this paper, we investigate the boundedness estimates of superposition operators with…

Functional Analysis · Mathematics 2026-05-14 Deyu Chen , Guixiang Hong

\citet{farrell2021deep} establish non-asymptotic high-probability bounds for general deep feedforward neural network (with rectified linear unit activation function) estimators, with \citet[Theorem 1]{farrell2021deep} achieving a suboptimal…

Econometrics · Economics 2025-12-11 Zhaoji Tang