English
Related papers

Related papers: Non-Linear Interactions in Neural Network Operator…

200 papers

A large class of hyperbolic and advection-dominated PDEs can have solutions with discontinuities. This paper investigates, both theoretically and empirically, the operator learning of PDEs with discontinuous solutions. We rigorously prove,…

Machine Learning · Computer Science 2022-10-04 Samuel Lanthaler , Roberto Molinaro , Patrik Hadorn , Siddhartha Mishra

In this paper we investigate how standard nonlinear programming algorithms can be used to solve constrained optimization problems in a distributed manner. The optimization setup consists of a set of agents interacting through a…

Optimization and Control · Mathematics 2017-07-18 Ion Matei , John S. Baras

Multiplication layers are a key component in various influential neural network modules, including self-attention and hypernetwork layers. In this paper, we investigate the approximation capabilities of deep neural networks with…

Machine Learning · Computer Science 2023-01-12 Ido Ben-Shaul , Tomer Galanti , Shai Dekel

Neural-network-based controllers (NNCs) can represent complex, highly nonlinear control laws, but verifying the closed-loop stability of dynamical systems using them remains challenging. This work presents contributions to a…

Systems and Control · Electrical Eng. & Systems 2025-10-29 Alvaro Detailleur , Dalim Wahby , Guillaume Ducard , Christopher Onder

This paper explores the use of deep neural networks for semiparametric estimation of economic models of maximizing behavior in production or discrete choice. We argue that certain deep networks are particularly well suited as a…

Econometrics · Economics 2022-04-06 Konrad Menzel

The ability to construct a realistic simulator of financial exchanges, including reproducing the dynamics of the limit order book, can give insight into many counterfactual scenarios, such as a flash crash, a margin call, or changes in…

Machine Learning · Computer Science 2023-11-28 Namid R. Stillman , Rory Baggott , Justin Lyon , Jianfei Zhang , Dingqiu Zhu , Tao Chen , Perukrishnen Vytelingum

Classical nonlinear theories are highly successful in describing far-from-equilibrium dynamics of magnets, encompassing phenomena such as parametric resonance, ultrafast switching, and even chaos. However, at ultrashort length and time…

Mesoscale and Nanoscale Physics · Physics 2025-12-15 Lukas Körber , Pim Coenders , Johan H. Mentink

We address the approximation of entropy solutions to initial-boundary value problems for nonlinear strictly hyperbolic conservation laws using neural networks. A general and systematic framework is introduced for the design of efficient and…

Analysis of PDEs · Mathematics 2025-09-16 Igor Ciril , Khalil Haddaoui , Yohann Tendero

We construct $\Delta$-operators $F[\Delta]$ on the space of almost symmetric functions $\mathscr{P}_{as}^{+}$. These operators extend the usual $\Delta$-operators on the space of symmetric functions $\Lambda \subset \mathscr{P}_{as}^{+}$…

Representation Theory · Mathematics 2024-09-24 Milo Bechtloff Weising

This paper addresses inverse problems (in a broad sense) for two classes of multivariate neural network (NN) operators, with particular emphasis on saturation results, and both analytical and semi-analytical inverse theorems. One of the key…

Functional Analysis · Mathematics 2025-05-13 Danilo Costarelli

Permutation-invariant, -equivariant, and -covariant functions and anti-symmetric functions are important in quantum physics, computer vision, and other disciplines. Applications often require most or all of the following properties: (a) a…

Neural and Evolutionary Computing · Computer Science 2020-07-31 Marcus Hutter

Multivariate functions emerge naturally in a wide variety of data-driven models. Popular choices are expressions in the form of basis expansions or neural networks. While highly effective, the resulting functions tend to be hard to…

Machine Learning · Statistics 2022-06-15 Jan Decuyper , Koen Tiels , Siep Weiland , Mark C. Runacres , Johan Schoukens

The Koopman operator is a linear operator that describes the evolution of scalar observables (i.e., measurement functions of the states) in an infinitedimensional Hilbert space. This operator theoretic point of view lifts the dynamics of a…

Optimization and Control · Mathematics 2021-10-19 Gregory Snyder , Zhuoyuan Song

In this paper, we prove the rate of approximation for the Neural Network Sampling Operators activated by sigmoidal functions with mixed Lebesgue norm in terms of averaged modulus of smoothness for a bounded measurable functions on bounded…

Functional Analysis · Mathematics 2025-04-15 Arpan Kumar Dey , A. Sathish Kumar , P. Devaraj

In the era of foundation models and Large Language Models (LLMs), Euclidean space is the de facto geometric setting of our machine learning architectures. However, recent literature has demonstrated that this choice comes with fundamental…

Computational Geometry · Computer Science 2025-05-21 Menglin Yang , Yifei Zhang , Jialin Chen , Melanie Weber , Rex Ying

Dynamic nonlinear systems exhibit distortions arising from coupled static and dynamic effects. Their intertwined nature poses major challenges for data-driven modeling. This paper presents a theoretical framework grounded in structured…

Machine Learning · Computer Science 2025-09-23 Sri Satish Krishna Chaitanya Bulusu , Mikko Sillanpää

Neural Operators offer a powerful, data-driven tool for solving parametric PDEs as they can represent maps between infinite-dimensional function spaces. In this work, we employ physics-informed Neural Operators in the context of…

Machine Learning · Statistics 2023-03-08 Sebastian Kaltenbach , Paris Perdikaris , Phaedon-Stelios Koutsourelakis

We focus on semiparametric regression that has played a central role in statistics, and exploit the powerful learning ability of deep neural networks (DNNs) while enabling statistical inference on parameters of interest that offers…

Statistics Theory · Mathematics 2025-04-29 Shunxing Yan , Ziyuan Chen , Fang Yao

Connections between integration along hypersufaces, Radon transforms, and neural networks are exploited to highlight an integral geometric mathematical interpretation of neural networks. By analyzing the properties of neural networks as…

Machine Learning · Statistics 2019-07-05 Soheil Kolouri , Xuwang Yin , Gustavo K. Rohde

We consider active, semi-supervised learning in an offline transductive setting. We show that a previously proposed error bound for active learning on undirected weighted graphs can be generalized by replacing graph cut with an arbitrary…

Machine Learning · Computer Science 2012-02-20 Andrew Guillory , Jeff A. Bilmes
‹ Prev 1 4 5 6 7 8 10 Next ›