English
Related papers

Related papers: Fast PDE-constrained optimization via self-supervi…

200 papers

Neural operator learning models have emerged as very effective surrogates in data-driven methods for partial differential equations (PDEs) across different applications from computational science and engineering. Such operator learning…

Machine Learning · Computer Science 2024-05-30 Benjamin Shih , Ahmad Peyvan , Zhongqiang Zhang , George Em Karniadakis

Neural Ordinary Differential Equations (Neural ODEs) represent continuous-time dynamics with neural networks, offering advancements for modeling and control tasks. However, training Neural ODEs requires solving differential equations at…

Machine Learning · Computer Science 2025-02-24 Mariia Shapovalova , Calvin Tsay

PDE-constrained optimization aims at finding optimal setups for partial differential equations so that relevant quantities are minimized. Including sparsity promoting terms in the formulation of such problems results in more practically…

Numerical Analysis · Mathematics 2016-11-23 Margherita Porcelli , Valeria Simoncini , Martin Stoll

Neural networks have shown promising potential in accelerating the numerical simulation of systems governed by partial differential equations (PDEs). Different from many existing neural network surrogates operating on high-dimensional…

Machine Learning · Computer Science 2025-01-09 Zijie Li , Saurabh Patil , Francis Ogoke , Dule Shu , Wilson Zhen , Michael Schneier , John R. Buchanan, , Amir Barati Farimani

Deep Operator Networks (DeepOnets) have revolutionized the domain of scientific machine learning for the solution of the inverse problem for dynamical systems. However, their implementation necessitates optimizing a high-dimensional space…

Machine Learning · Computer Science 2024-11-05 Gianluca Fabiani , Ioannis G. Kevrekidis , Constantinos Siettos , Athanasios N. Yannacopoulos

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

Machine Learning · Computer Science 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

Modern digital engineering design process commonly involves expensive repeated simulations on varying three-dimensional (3D) geometries. The efficient prediction capability of neural networks (NNs) makes them a suitable surrogate to provide…

Computational Engineering, Finance, and Science · Computer Science 2024-06-17 Junyan He , Seid Koric , Diab Abueidda , Ali Najafi , Iwona Jasiuk

This work formulates a new approach to reduced modeling of parameterized, time-dependent partial differential equations (PDEs). The method employs Operator Inference, a scientific machine learning framework combining data-driven learning…

Computational Engineering, Finance, and Science · Computer Science 2025-06-16 Shane A McQuarrie , Parisa Khodabakhshi , Karen E Willcox

This focused review explores a range of neural operator architectures for approximating solutions to parametric partial differential equations (PDEs), emphasizing high-level concepts and practical implementation strategies. The study covers…

Computational Engineering, Finance, and Science · Computer Science 2025-03-10 Prashant K. Jha

Machine learning methods for solving nonlinear partial differential equations (PDEs) are hot topical issues, and different algorithms proposed in the literature show efficient numerical approximation in high dimension. In this paper, we…

Optimization and Control · Mathematics 2022-01-05 Maximilien Germain , Mathieu Laurière , Huyên Pham , Xavier Warin

Optimal experimental design is a well studied field in applied science and engineering. Techniques for estimating such a design are commonly used within the framework of parameter estimation. Nonetheless, in recent years parameter…

Machine Learning · Statistics 2025-01-13 Md Shahriar Rahim Siddiqui , Arman Rahmim , Eldad Haber

We present a new data-driven reduced-order modeling approach to efficiently solve parametrized partial differential equations (PDEs) for many-query problems. This work is inspired by the concept of implicit neural representation (INR),…

Numerical Analysis · Mathematics 2023-11-30 Tianshu Wen , Kookjin Lee , Youngsoo Choi

Partial differential equations (PDEs) are commonly derived based on empirical observations. However, recent advances of technology enable us to collect and store massive amount of data, which offers new opportunities for data-driven…

Machine Learning · Computer Science 2019-10-23 Zichao Long , Yiping Lu , Bin Dong

Spatiotemporal partial differential equations (PDEs) underpin a wide range of scientific and engineering applications. Neural PDE solvers offer a promising alternative to classical numerical methods. However, existing approaches typically…

Machine Learning · Computer Science 2026-03-03 Yingjie Tan , Quanming Yao , Yaqing Wang

Physics-informed neural networks (PINNs) have recently become a popular method for solving forward and inverse problems governed by partial differential equations (PDEs). By incorporating the residual of the PDE into the loss function of a…

Optimization and Control · Mathematics 2022-11-07 Saviz Mowlavi , Saleh Nabi

The spatiotemporal resolution of Partial Differential Equations (PDEs) plays important roles in the mathematical description of the world's physical phenomena. In general, scientists and engineers solve PDEs numerically by the use of…

Artificial Intelligence · Computer Science 2023-06-29 Lucas Meyer , Marc Schouler , Robert Alexander Caulk , Alejandro Ribés , Bruno Raffin

Deep Operator Networks are an increasingly popular paradigm for solving regression in infinite dimensions and hence solve families of PDEs in one shot. In this work, we aim to establish a first-of-its-kind data-dependent lowerbound on the…

Machine Learning · Computer Science 2024-02-26 Anirbit Mukherjee , Amartya Roy

Operator learning has become a powerful tool for accelerating the solution of parameterized partial differential equations (PDEs), enabling rapid prediction of full spatiotemporal fields for new initial conditions or forcing functions.…

Machine Learning · Computer Science 2025-12-18 Hongjin Mi , Huiqiang Lun , Changhong Mou , Yeyu Zhang

Deep learning based approaches like Physics-informed neural networks (PINNs) and DeepONets have shown promise on solving PDE constrained optimization (PDECO) problems. However, existing methods are insufficient to handle those PDE…

Machine Learning · Computer Science 2023-04-12 Zhongkai Hao , Chengyang Ying , Hang Su , Jun Zhu , Jian Song , Ze Cheng

Scientific computing has been an indispensable tool in applied sciences and engineering, where traditional numerical methods are often employed due to their superior accuracy guarantees. However, these methods often encounter challenges…

Numerical Analysis · Mathematics 2024-07-23 Ran Bi , Jingrun Chen , Weibing Deng