English
Related papers

Related papers: Data-Efficient Operator Learning via Unsupervised …

200 papers

In this work, we describe a novel approach to building a neural PDE solver leveraging recent advances in transformer based neural network architectures. Our model can provide solutions for different values of PDE parameters without any need…

Machine Learning · Computer Science 2024-07-10 Varun Madhavan , Amal S Sebastian , Bharath Ramsundar , Venkatasubramanian Viswanathan

Recent advances in scientific machine learning (SciML) have enabled neural operators (NOs) to serve as powerful surrogates for modeling the dynamic evolution of physical systems governed by partial differential equations (PDEs). While…

Machine Learning · Computer Science 2026-02-18 Siying Ma , Mehrdad M. Zadeh , Mauricio Soroco , Wuyang Chen , Jiguo Cao , Vijay Ganesh

Partial Differential Equations (PDEs) are central to science and engineering. Since solving them is computationally expensive, a lot of effort has been put into approximating their solution operator via both traditional and recently…

Machine Learning · Computer Science 2025-02-14 Alessandro Longhi , Danny Lathouwers , Zoltán Perkó

Scientific machine learning is an emerging field that broadly describes the combination of scientific computing and machine learning to address challenges in science and engineering. Within the context of differential equations, this has…

Machine Learning · Computer Science 2026-04-03 Laurens R. Lueg , Victor Alves , Daniel Schicksnus , John R. Kitchin , Carl D. Laird , Lorenz T. Biegler

Single-operator learning involves training a deep neural network to learn a specific operator, whereas recent work in multi-operator learning uses an operator embedding structure to train a single neural network on data from multiple…

Machine Learning · Computer Science 2025-06-16 Jingmin Sun , Zecheng Zhang , Hayden Schaeffer

Numerical approximations of partial differential equations (PDEs) are routinely employed to formulate the solution of physics, engineering, and mathematical problems involving functions of several variables, such as the propagation of heat…

We consider a general class of nonsmooth optimal control problems with partial differential equation (PDE) constraints, which are very challenging due to its nonsmooth objective functionals and the resulting high-dimensional and…

Optimization and Control · Mathematics 2023-07-26 Yongcun Song , Xiaoming Yuan , Hangrui Yue

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be…

Optimization and Control · Mathematics 2023-06-01 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

We present a data-driven control framework for partial differential equations (PDEs). Our approach integrates Time-Integrated Deep Operator Networks (TI-DeepONets) as differentiable PDE surrogate models within the Differentiable Predictive…

Computational Engineering, Finance, and Science · Computer Science 2026-04-16 Dibakar Roy Sarkar , Ján Drgoňa , Somdatta Goswami

Partial differential equations (PDEs) are central to scientific modeling. Modern workflows increasingly rely on learning-based components to support model reuse, inference, and integration across large computational processes. Despite the…

Machine Learning · Computer Science 2026-02-20 Yilong Dai , Shengyu Chen , Ziyi Wang , Xiaowei Jia , Yiqun Xie , Vipin Kumar , Runlong Yu

Solving partial differential equations (PDEs) can be prohibitively expensive using traditional numerical methods. Deep learning-based surrogate models typically specialize in a single PDE with fixed parameters. We present a framework for…

Machine Learning · Computer Science 2025-11-14 Qian-Ze Zhu , Paul Raccuglia , Michael P. Brenner

We propose a neural network-based meta-learning method to efficiently solve partial differential equation (PDE) problems. The proposed method is designed to meta-learn how to solve a wide variety of PDE problems, and uses the knowledge for…

Machine Learning · Statistics 2023-10-23 Tomoharu Iwata , Yusuke Tanaka , Naonori Ueda

We develop a new and general encode-approximate-reconstruct operator learning model that leverages learned neural representations of bases for input and output function distributions. We introduce the concepts of \textit{numerical operator…

Machine Learning · Computer Science 2025-07-11 Jacob Hauck , Yanzhi Zhang

In this paper, we investigate the behavior of gradient descent algorithms in physics-informed machine learning methods like PINNs, which minimize residuals connected to partial differential equations (PDEs). Our key result is that the…

Machine Learning · Computer Science 2024-05-06 Tim De Ryck , Florent Bonnet , Siddhartha Mishra , Emmanuel de Bézenac

We present a novel framework combining Deep Operator Networks (DeepONets) with Physics-Informed Neural Networks (PINNs) to solve partial differential equations (PDEs) and estimate their unknown parameters. By integrating data-driven…

Machine Learning · Computer Science 2025-08-05 Amogh Raj , Carol Eunice Gudumotou , Sakol Bun , Keerthana Srinivasa , Arash Sarshar

Existing neural operator architectures face challenges when solving multiphysics problems with coupled partial differential equations (PDEs) due to complex geometries, interactions between physical variables, and the limited amounts of…

Neural operators (NOs) provide a new paradigm for efficiently solving partial differential equations (PDEs), but their training depends on costly high-fidelity data from numerical solvers, limiting applications in complex systems. We…

Computational Physics · Physics 2026-05-18 Wen You , Shaoqian Zhou , Xuhui Meng

Although neural operators are widely used in data-driven physical simulations, their training remains computationally expensive. Recent advances address this issue via downstream learning, where a model pretrained on simpler problems is…

Machine Learning · Computer Science 2025-11-17 Mikhail Masliaev , Dmitry Gusarov , Ilya Markov , Alexander Hvatov

Deep operator networks (DeepONets) represent a powerful class of data-driven methods for operator learning, demonstrating strong approximation capabilities for a wide range of linear and nonlinear operators. They have shown promising…

Machine Learning · Computer Science 2025-03-04 Zhaoxi Jiang , Fei Wang

We introduce a novel grid-independent model for learning partial differential equations (PDEs) from noisy and partial observations on irregular spatiotemporal grids. We propose a space-time continuous latent neural PDE model with an…

Machine Learning · Computer Science 2023-10-27 Valerii Iakovlev , Markus Heinonen , Harri Lähdesmäki