English
Related papers

Related papers: A DeepONet joint Neural Tangent Kernel Hybrid Fram…

200 papers

Neural networks have been applied to control problems, typically by combining data, differential equation residuals, and objective costs in the training loss or by incorporating auxiliary architectural components. Instead, we propose a…

Optimization and Control · Mathematics 2026-04-10 Oliver G. S. Lundqvist , Fabricio Oliveira

Neural operators (NOs) employ deep neural networks to learn mappings between infinite-dimensional function spaces. Deep operator network (DeepONet), a popular NO architecture, has demonstrated success in the real-time prediction of complex…

Machine Learning · Computer Science 2025-06-03 Sharmila Karumuri , Lori Graham-Brady , Somdatta Goswami

Magnetic Resonance Imaging can produce detailed images of the anatomy and physiology of the human body that can assist doctors in diagnosing and treating pathologies such as tumours. However, MRI suffers from very long acquisition times…

Image and Video Processing · Electrical Eng. & Systems 2022-03-30 George Yiasemis , Jan-Jakob Sonke , Clarisa Sánchez , Jonas Teuwen

This work studies the neural tangent kernel (NTK) of the deep equilibrium (DEQ) model, a practical ``infinite-depth'' architecture which directly computes the infinite-depth limit of a weight-tied network via root-finding. Even though the…

Machine Learning · Computer Science 2023-10-24 Zhili Feng , J. Zico Kolter

Neural operators have recently become popular tools for designing solution maps between function spaces in the form of neural networks. Differently from classical scientific machine learning approaches that learn parameters of a known…

Machine Learning · Computer Science 2022-09-07 Huaiqian You , Yue Yu , Marta D'Elia , Tian Gao , Stewart Silling

The deep operator network (DeepONet) is a popular neural operator architecture that has shown promise in solving partial differential equations (PDEs) by using deep neural networks to map between infinite-dimensional function spaces. In the…

Machine Learning · Computer Science 2025-02-25 Luis Mandl , Somdatta Goswami , Lena Lambers , Tim Ricken

Deep operator networks (DeepONets) represent a powerful class of data-driven methods for operator learning, demonstrating strong approximation capabilities for a wide range of linear and nonlinear operators. They have shown promising…

Machine Learning · Computer Science 2025-03-04 Zhaoxi Jiang , Fei Wang

The Neural Tangent Kernel (NTK) framework has provided deep insights into the training dynamics of neural networks under gradient flow. However, it relies on the assumption that the network is differentiable with respect to its parameters,…

Machine Learning · Computer Science 2025-09-17 Sriram Nagaraj , Vishakh Hari

Intrinsic image decomposition is the process of separating the reflectance and shading layers of an image, which is a challenging and underdetermined problem. In this paper, we propose to systematically address this problem using a deep…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Sai Bi , Nima Khademi Kalantari , Ravi Ramamoorthi

We consider the Dirichlet-to-Neumann operator and the direct and inverse Calder\'on's mappings appearing in the Inverse Problem of recovering a smooth bounded and positive isotropic conductivity of a material filling a smooth bounded domain…

Analysis of PDEs · Mathematics 2024-04-16 Javier Castro , Claudio Muñoz , Nicolás Valenzuela

The Deep Operator Network (DeepONet) is a powerful neural operator architecture that uses two neural networks to map between infinite-dimensional function spaces. This architecture allows for the evaluation of the solution field at any…

Machine Learning · Computer Science 2026-02-17 Bahador Bahmani , Somdatta Goswami , Ioannis G. Kevrekidis , Michael D. Shields

Deep Operator Networks (DeepONets) have emerged as a powerful surrogate modeling framework for learning solution operators in PDE-governed systems. While their use is expanding across engineering disciplines, applications in geotechnical…

Machine Learning · Computer Science 2026-03-11 Yongjin Choi , Chenying Liu , Jorge Macedo

We present a novel approach for completing and reconstructing 3D shapes from incomplete scanned data by using deep neural networks. Rather than being trained on supervised completion tasks and applied on a testing shape, the network is…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Lei Chu , Hao Pan , Wenping Wang

We introduce a novel deep operator network (DeepONet) framework that incorporates generalised variational inference (GVI) using R\'enyi's $\alpha$-divergence to learn complex operators while quantifying uncertainty. By incorporating…

Machine Learning · Statistics 2025-12-09 Soban Nasir Lone , Subhayan De , Rajdip Nayek

Recent studies have demonstrated the success of deep learning in solving forward and inverse problems in engineering and scientific computing domains, such as physics-informed neural networks (PINNs). Source inversion problems under sparse…

Machine Learning · Statistics 2026-04-10 Brenda Anague , Bamdad Hosseini , Issa Karambal , Jean Medard Ngnotchouye

Neural tangent kernels (NTKs) provide a theoretical regime to analyze the learning and generalization behavior of over-parametrized neural networks. For a supervised learning task, the association between the eigenvectors of the NTK kernel…

Machine Learning · Computer Science 2023-10-18 Shervin Khalafi , Saurabh Sihag , Alejandro Ribeiro

The Neural Tangent Kernel (NTK) offers a powerful tool to study the functional dynamics of neural networks. In the so-called lazy, or kernel regime, the NTK remains static during training and the network function is linear in the static…

Machine Learning · Computer Science 2025-07-28 Yuzhi Liu , Zixuan Chen , Zirui Zhang , Yufei Liu , Giulia Lanzillotta

Nonlinear physical phenomena often show complex multiscale interactions; motivated by the principles of multiscale modeling in scientific computing, we propose PAS-Net, a physics-informed Adaptive-Scale Deep Operator Network for learning…

Computational Physics · Physics 2025-11-20 Changhong Mou , Yeyu Zhang , Xuewen Zhu , Qiao Zhuang

A major factor in the success of deep neural networks is the use of sophisticated architectures rather than the classical multilayer perceptron (MLP). Residual networks (ResNets) stand out among these powerful modern architectures. Previous…

Machine Learning · Computer Science 2021-05-25 Tom Tirer , Joan Bruna , Raja Giryes

Computational advances have fundamentally transformed the landscape of numerical simulations, enabling unprecedented levels of complexity and precision in modeling physical phenomena. While these high-fidelity simulations offer invaluable…

Fluid Dynamics · Physics 2025-09-09 Shinhoo Kang , Emil M. Constantinescu