English
Related papers

Related papers: A DeepONet joint Neural Tangent Kernel Hybrid Fram…

200 papers

Deep operator network (DeepONet) has shown significant promise as surrogate models for systems governed by partial differential equations (PDEs), enabling accurate mappings between infinite-dimensional function spaces. However, when applied…

Machine Learning · Computer Science 2025-10-29 Sharmila Karumuri , Lori Graham-Brady , Somdatta Goswami

Maxwell's equations, a system of linear partial differential equations (PDEs), describe the behavior of electric and magnetic fields in time and space and are essential for many important electromagnetic applications. Although numerical…

Computational Physics · Physics 2026-01-19 Qile Jiang , Marc Salvadori , Dale Ota , Vijaya Shankar , Khemraj Shukla

Accurately modeling and inferring solutions to time-dependent partial differential equations (PDEs) over extended horizons remains a core challenge in scientific machine learning. Traditional full rollout (FR) methods, which predict entire…

Machine Learning · Computer Science 2026-03-18 Luis Mandl , Dibyajyoti Nayak , Tim Ricken , Somdatta Goswami

The remarkable performance of deep neural networks (DNNs) currently makes them the method of choice for solving linear inverse problems. They have been applied to super-resolve and restore images, as well as to reconstruct MR and CT images.…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 Marija Vella , João F. C. Mota

Standard neural networks can approximate general nonlinear operators, represented either explicitly by a combination of mathematical operators, e.g., in an advection-diffusion-reaction partial differential equation, or simply as a black…

Machine Learning · Computer Science 2022-07-19 Somdatta Goswami , Aniruddha Bora , Yue Yu , George Em Karniadakis

Physics-informed neural networks (PINNs) are demonstrating remarkable promise in integrating physical models with gappy and noisy observational data, but they still struggle in cases where the target functions to be approximated exhibit…

Machine Learning · Computer Science 2021-06-16 Sifan Wang , Hanwen Wang , Paris Perdikaris

Model Reprogramming (MR) is a resource-efficient framework that adapts large pre-trained models to new tasks with minimal additional parameters and data, offering a promising solution to the challenges of training large models for diverse…

Machine Learning · Computer Science 2025-06-03 Ming-Yu Chung , Jiashuo Fan , Hancheng Ye , Qinsi Wang , Wei-Chen Shen , Chia-Mu Yu , Pin-Yu Chen , Sy-Yen Kuo

This paper investigates the Neural Tangent Kernel (NTK) to search vision transformers without training. In contrast with the previous observation that NTK-based metrics can effectively predict CNNs performance at initialization, we…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Qiqi Zhou , Yichen Zhu

We extend and analyze the deep neural network multigrid solver (DNN-MG) for the Navier-Stokes equations in three dimensions. The idea of the method is to augment a finite element simulation on coarse grids with fine scale information…

Numerical Analysis · Mathematics 2023-12-22 Nils Margenberg , Robert Jendersie , Christian Lessig , Thomas Richter

This work introduces a neural operator based surrogate modeling framework for neutron transport computation. Two architectures, the Deep Operator Network (DeepONet) and the Fourier Neural Operator (FNO), were trained for fixed source…

Computational Physics · Physics 2026-02-19 Md Hossain Sahadath , Qiyun Cheng , Shaowu Pan , Wei Ji

Inverse problems exist in many domains such as phase imaging, image processing, and computer vision. These problems are often solved with application-specific algorithms, even though their nature remains the same: mapping input image(s) to…

Computational Physics · Physics 2021-10-22 Feng Wang , Alberto Eljarrat , Johannes Müller , Trond Henninen , Erni Rolf , Christoph Koch

Neural Operator Networks (ONets) represent a novel advancement in machine learning algorithms, offering a robust and generalizable alternative for approximating partial differential equations (PDEs) solutions. Unlike traditional Neural…

Machine Learning · Computer Science 2024-04-30 Kazuma Kobayashi , James Daniell , Syed Bahauddin Alam

Operator learning has emerged as a promising tool for accelerating the solution of partial differential equations (PDEs). The Deep Operator Networks (DeepONets) represent a pioneering framework in this area: the "vanilla" DeepONet is valued…

Machine Learning · Computer Science 2025-09-03 Zhi-Feng Wei , Wenqian Chen , Panos Stinis

Ideally, 360{\deg} imagery could inherit the deep convolutional neural networks (CNNs) already trained with great success on perspective projection images. However, existing methods to transfer CNNs from perspective to spherical images…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Yu-Chuan Su , Kristen Grauman

This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied…

Optimization and Control · Mathematics 2023-12-25 Andreas Habring , Martin Holler

We introduce the neural tangent kernel (NTK) regime for two-layer neural operators and analyze their generalization properties. For early-stopped gradient descent (GD), we derive fast convergence rates that are known to be minimax optimal…

Machine Learning · Statistics 2024-12-24 Mike Nguyen , Nicole Mücke

As the electromagnetic environment becomes increasingly complex, Global Navigation Satellite Systems (GNSS) face growing threats from sophisticated jamming interference. Although Deep Learning (DL) effectively identifies basic interference,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Zhihan Zeng , Yang Zhao , Kaihe Wang , Dusit Niyato , Hongyuan Shu , Junchu Zhao , Yanjun Huang , Yue Xiu , Zhongpei Zhang , Ning Wei

Deep neural networks (DNN) have achieved great success in image restoration. However, most DNN methods are designed as a black box, lacking transparency and interpretability. Although some methods are proposed to combine traditional…

Computer Vision and Pattern Recognition · Computer Science 2022-04-29 Chong Mou , Qian Wang , Jian Zhang

Neural network verification aims at providing formal guarantees on the output of trained neural networks, to ensure their robustness against adversarial examples and enable their deployment in safety-critical applications. This paper…

Optimization and Control · Mathematics 2024-04-02 Haoruo Zhao , Hassan Hijazi , Haydn Jones , Juston Moore , Mathieu Tanneau , Pascal Van Hentenryck

The accurate estimation of the state of complex uncertain physical systems requires reconciling theoretical models, with inherent imperfections, with noisy experimental data. In this work, we propose an effective hybrid approach that…

Machine Learning · Computer Science 2025-12-16 Stiven Briand Massala , Ludovic Chamoin , Massimo Picca Ciamarra