中文
相关论文

相关论文: Size Lowerbounds for Deep Operator Networks

200 篇论文

DeepONet has recently been proposed as a representative framework for learning nonlinear mappings between function spaces. However, when it comes to approximating solution operators of partial differential equations (PDEs) with…

数值分析 · 数学 2024-08-09 Yameng Zhu , Jingrun Chen , Weibing Deng

In this paper, we theoretically prove that gradient descent can find a global minimum of non-convex optimization of all layers for nonlinear deep neural networks of sizes commonly encountered in practice. The theory developed in this paper…

机器学习 · 统计学 2020-06-18 Kenji Kawaguchi , Jiaoyang Huang

Deep neural networks (DNNs) have achieved remarkable success in numerous domains, and their application to PDE-related problems has been rapidly advancing. This paper provides an estimate for the generalization error of learning Lipschitz…

机器学习 · 计算机科学 2023-10-04 Ke Chen , Chunmei Wang , Haizhao Yang

The deep operator networks (DeepONet), a class of neural operators that learn mappings between function spaces, have recently been developed as surrogate models for parametric partial differential equations (PDEs). In this work we propose a…

机器学习 · 计算机科学 2024-10-31 Yuan Qiu , Nolan Bridges , Peng Chen

We construct and analyze approximation rates of deep operator networks (ONets) between infinite-dimensional spaces that emulate with an exponential rate of convergence the coefficient-to-solution map of elliptic second-order partial…

数值分析 · 数学 2023-11-27 Carlo Marcati , Christoph Schwab

We propose a very general framework for deriving rigorous bounds on the approximation error for physics-informed neural networks (PINNs) and operator learning architectures such as DeepONets and FNOs as well as for physics-informed operator…

机器学习 · 计算机科学 2022-10-11 Tim De Ryck , Siddhartha Mishra

We study the derivative-informed learning of nonlinear operators between infinite-dimensional separable Hilbert spaces by neural networks. Such operators can arise from the solution of partial differential equations (PDEs), and are used in…

数值分析 · 数学 2025-04-14 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Deep Operator Networks (DeepOnets) have revolutionized the domain of scientific machine learning for the solution of the inverse problem for dynamical systems. However, their implementation necessitates optimizing a high-dimensional space…

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

机器学习 · 计算机科学 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of…

机器学习 · 计算机科学 2021-10-13 Sifan Wang , Hanwen Wang , Paris Perdikaris

Parametric PDEs power modern simulation, design, and digital-twin systems, yet their many-query workloads still hinge on repeatedly solving large finite-element systems. Existing operator-learning approaches accelerate this process but…

机器学习 · 计算机科学 2025-11-25 Yueqi Wang , Guang Lin

Deep Operator Networks are emerging as fundamental tools among various neural network types to learn mappings between function spaces, and have recently gained attention due to their ability to approximate nonlinear operators. In…

机器学习 · 计算机科学 2026-01-15 Beatrice Ceccanti , Mattia Galanti , Ivo Roghair , Martin van Sint Annaland

Deep operator networks (DeepONets) are receiving increased attention thanks to their demonstrated capability to approximate nonlinear operators between infinite-dimensional Banach spaces. However, despite their remarkable early promise,…

机器学习 · 计算机科学 2021-03-23 Sifan Wang , Hanwen Wang , Paris Perdikaris

Deep neural operators can learn nonlinear mappings between infinite-dimensional function spaces via deep neural networks. As promising surrogate solvers of partial differential equations (PDEs) for real-time prediction, deep neural…

机器学习 · 计算机科学 2023-05-17 Min Zhu , Handi Zhang , Anran Jiao , George Em Karniadakis , Lu Lu

Learning operators between infinitely dimensional spaces is an important learning task arising in wide applications in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric…

机器学习 · 统计学 2022-01-04 Hao Liu , Haizhao Yang , Minshuo Chen , Tuo Zhao , Wenjing Liao

In this work, we propose a new training method for finding minimum weight norm solutions in over-parameterized neural networks (NNs). This method seeks to improve training speed and generalization performance by framing NN training as a…

机器学习 · 统计学 2018-06-22 Yamini Bansal , Madhu Advani , David D Cox , Andrew M Saxe

Single-operator learning involves training a deep neural network to learn a specific operator, whereas recent work in multi-operator learning uses an operator embedding structure to train a single neural network on data from multiple…

机器学习 · 计算机科学 2025-06-16 Jingmin Sun , Zecheng Zhang , Hayden Schaeffer

Neural scaling laws play a pivotal role in the performance of deep neural networks and have been observed in a wide range of tasks. However, a complete theoretical framework for understanding these scaling laws remains underdeveloped. In…

机器学习 · 计算机科学 2026-05-27 Hao Liu , Zecheng Zhang , Wenjing Liao , Hayden Schaeffer

The results of training a neural network are heavily dependent on the architecture chosen; and even a modification of only its size, however small, typically involves restarting the training process. In contrast to this, we begin training…

机器学习 · 计算机科学 2024-02-12 Rupert Mitchell , Robin Menzenbach , Kristian Kersting , Martin Mundt

A new data-driven method for operator learning of stochastic differential equations(SDE) is proposed in this paper. The central goal is to solve forward and inverse stochastic problems more effectively using limited data. Deep operator…

机器学习 · 统计学 2022-04-08 Jiahao Zhang , Shiqi Zhang , Guang Lin