English
Related papers

Related papers: Fast PDE-constrained optimization via self-supervi…

200 papers

Deep operator networks (DeepONets) are trained to predict the linear amplification of instability waves in high-speed boundary layers and to perform data assimilation. In contrast to traditional networks that approximate functions,…

Fluid Dynamics · Physics 2021-05-19 P. Clark Di Leoni , L. Lu , C. Meneveau , G. Karniadakis , T. A. Zaki

In recent years, data-driven methods have been developed to learn dynamical systems and partial differential equations (PDE). The goal of such work is discovering unknown physics and the corresponding equations. However, prior to achieving…

Machine Learning · Statistics 2021-02-17 Hao Xu , Haibin Chang , Dongxiao Zhang

Many physics and engineering applications demand Partial Differential Equations (PDE) property evaluations that are traditionally computed with resource-intensive high-fidelity numerical solvers. Data-driven surrogate models provide an…

Machine Learning · Computer Science 2023-12-18 Raphaël Pestourie , Youssef Mroueh , Chris Rackauckas , Payel Das , Steven G. Johnson

Coupled multiphysics simulations for high-dimensional, large-scale problems can be prohibitively expensive due to their computational demands. This article presents a novel framework integrating a deep operator network (DeepONet) with the…

Computational Engineering, Finance, and Science · Computer Science 2025-09-03 Fouad M. Amin , Diab W. Abueidda , Panos Pantidis , Mostafa E. Mobasher

Partial differential equations (PDEs) underlie our understanding and prediction of natural phenomena across numerous fields, including physics, engineering, and finance. However, solving parametric PDEs is a complex task that necessitates…

Numerical Analysis · Mathematics 2025-02-20 Jae Yong Lee , Seungchan Ko , Youngjoon Hong

Simulating the time evolution of Partial Differential Equations (PDEs) of large-scale systems is crucial in many scientific and engineering domains such as fluid dynamics, weather forecasting and their inverse optimization problems.…

Machine Learning · Computer Science 2022-10-13 Tailin Wu , Takashi Maruyama , Jure Leskovec

The fundamental computational issues in Bayesian inverse problems (BIP) governed by partial differential equations (PDEs) stem from the requirement of repeated forward model evaluations. A popular strategy to reduce such costs is to replace…

Numerical Analysis · Mathematics 2024-09-05 Zhiwei Gao , Liang Yan , Tao Zhou

The computational overhead of traditional numerical solvers for partial differential equations (PDEs) remains a critical bottleneck for large-scale parametric studies and design optimization. We introduce a Minimal-Data Parametric Neural…

Machine Learning · Computer Science 2026-05-15 Qiyun Cheng , Md Hossain Sahadath , Huihua Yang , Shaowu Pan , Wei Ji

The Deep Operator Networks~(DeepONet) is a fundamentally different class of neural networks that we train to approximate nonlinear operators, including the solution operator of parametric partial differential equations (PDE). DeepONets have…

Numerical Analysis · Mathematics 2021-11-05 Guang Lin , Christian Moya , Zecheng Zhang

Solving partial differential equations (PDEs) with machine learning typically requires training a new neural network for every new equation. This optimization is slow. We introduce MetaColloc. It is an optimization-free and data-free…

Machine Learning · Computer Science 2026-05-13 Zichuan Yang

The least squares method with deep neural networks as function parametrization has been applied to solve certain high-dimensional partial differential equations (PDEs) successfully; however, its convergence is slow and might not be…

Numerical Analysis · Mathematics 2021-12-30 Yiqi Gu , Haizhao Yang , Chao Zhou

Parametric optimal control problems governed by partial differential equations (PDEs) are widely found in scientific and engineering applications. Traditional grid-based numerical methods for such problems generally require repeated…

Optimization and Control · Mathematics 2023-02-07 Pengfei Yin , Guangqiang Xiao , Kejun Tang , Chao Yang

Simulation and optimization are crucial for advancing the engineering design of complex systems and processes. Traditional optimization methods require substantial computational time and effort due to their reliance on resource-intensive…

Machine Learning · Computer Science 2025-08-28 Janak M. Patel , Milad Ramezankhani , Anirudh Deodhar , Dagnachew Birru

This study focuses on addressing the challenges of solving analytically intractable differential equations that arise in scientific and engineering fields such as Hamilton-Jacobi-Bellman. Traditional numerical methods and neural network…

Numerical Analysis · Mathematics 2023-08-23 Daniel Sevcovic , Cyril Izuchukwu Udeani

Operator eigenvalue problems play a critical role in various scientific fields and engineering applications, yet numerical methods are hindered by the curse of dimensionality. Recent deep learning methods provide an efficient approach to…

Machine Learning · Computer Science 2025-10-29 Hong Wang , Jiang Yixuan , Jie Wang , Xinyi Li , Jian Luo , Huanshuo Dong

Partial differential equations (PDEs) are central to describing complex physical system simulations. Their expensive solution techniques have led to an increased interest in deep neural network based surrogates. However, the practical…

Machine Learning · Computer Science 2022-11-17 Jayesh K. Gupta , Johannes Brandstetter

Complex design problems are common in the scientific and industrial fields. In practice, objective functions or constraints of these problems often do not have explicit formulas, and can be estimated only at a set of sampling points through…

Optimization and Control · Mathematics 2022-10-12 Lulu Zhang , Zhi-Qin John Xu , Yaoyu Zhang

Deep sequence models have achieved notable success in time-series analysis, such as interpolation and forecasting. Recent advances move beyond discrete-time architectures like Recurrent Neural Networks (RNNs) toward continuous-time…

Machine Learning · Computer Science 2025-08-05 Haoran Li , Muhao Guo , Yang Weng , Hanghang Tong

Deep neural networks (DNNs), especially physics-informed neural networks (PINNs), have recently become a new popular method for solving forward and inverse problems governed by partial differential equations (PDEs). However, these methods…

Machine Learning · Computer Science 2023-10-26 Wenbo Cao , Weiwei Zhang

Accurately modeling and inferring solutions to time-dependent partial differential equations (PDEs) over extended horizons remains a core challenge in scientific machine learning. Traditional full rollout (FR) methods, which predict entire…

Machine Learning · Computer Science 2026-03-18 Luis Mandl , Dibyajyoti Nayak , Tim Ricken , Somdatta Goswami