English
Related papers

Related papers: Breakeven complexity: A new perspective on neural …

200 papers

Pretraining for partial differential equation (PDE) modeling has recently shown promise in scaling neural operators across datasets to improve generalizability and performance. Despite these advances, our understanding of how pretraining…

Machine Learning · Computer Science 2024-10-03 Anthony Zhou , Cooper Lorsung , AmirPouya Hemmasian , Amir Barati Farimani

In scenarios with limited available data, training the function-to-function neural PDE solver in an unsupervised manner is essential. However, the efficiency and accuracy of existing methods are constrained by the properties of numerical…

Machine Learning · Computer Science 2025-03-12 Rui Zhang , Qi Meng , Rongchan Zhu , Yue Wang , Wenlei Shi , Shihua Zhang , Zhi-Ming Ma , Tie-Yan Liu

Partial Differential Equations (PDEs) describe phenomena ranging from turbulence and epidemics to quantum mechanics and financial markets. Despite recent advances in computational science, solving such PDEs for real-world applications…

Machine Learning · Computer Science 2025-05-19 Lothar Heimbach , Sebastian Kaltenbach , Petr Karnakov , Francis J. Alexander , Petros Koumoutsakos

We present Unified PDE Solvers (UPS), a data- and compute-efficient approach to developing unified neural operators for diverse families of spatiotemporal PDEs from various domains, dimensions, and resolutions. UPS embeds different PDEs…

Machine Learning · Computer Science 2024-11-26 Junhong Shen , Tanya Marwah , Ameet Talwalkar

In this work, we study physics-informed neural networks (PINNs) constrained by partial differential equations (PDEs) and their application in approximating PDEs with two characteristic scales. From a continuous perspective, our formulation…

Optimization and Control · Mathematics 2024-09-06 Michael Hintermüller , Denis Korolev

Entity Resolution (ER) is typically implemented as a batch task that processes all available data before identifying duplicate records. However, applications with time or computational constraints, e.g., those running in the cloud, require…

Databases · Computer Science 2025-03-12 Jakub Maciejewski , Konstantinos Nikoletos , George Papadakis , Yannis Velegrakis

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

A key appeal of the recently proposed Neural Ordinary Differential Equation (ODE) framework is that it seems to provide a continuous-time extension of discrete residual neural networks. As we show herein, though, trained Neural ODE models…

Machine Learning · Computer Science 2023-09-12 Katharina Ott , Prateek Katiyar , Philipp Hennig , Michael Tiemann

Solvers for partial differential equations (PDE) are one of the cornerstones of computational science. For large problems, they involve huge amounts of data that needs to be stored and transmitted on all levels of the memory hierarchy.…

Numerical Analysis · Mathematics 2019-09-19 Sebastian Götschel , Martin Weiser

Solving partial differential equations (PDEs) using an annealing-based approach involves solving generalized eigenvalue problems. Discretizing a PDE yields a system of linear equations (SLE). Solving an SLE can be formulated as a general…

Numerical Analysis · Mathematics 2026-05-11 Kazue Kudo

Deep neural networks (DNNs), especially physics-informed neural networks (PINNs), have recently become a new popular method for solving forward and inverse problems governed by partial differential equations (PDEs). However, these methods…

Machine Learning · Computer Science 2023-10-26 Wenbo Cao , Weiwei Zhang

Neural networks are increasingly being used to solve partial differential equations (PDEs), replacing slower numerical solvers. However, a critical issue is that neural PDE solvers require high-quality ground truth data, which usually must…

Machine Learning · Computer Science 2022-05-31 Johannes Brandstetter , Max Welling , Daniel E. Worrall

Recent advances in the literature show promising potential of deep learning methods, particularly neural operators, in obtaining numerical solutions to partial differential equations (PDEs) beyond the reach of current numerical solvers.…

Machine Learning · Computer Science 2025-05-05 Erisa Hasani , Rachel A. Ward

The large-scale simulation of dynamical systems is critical in numerous scientific and engineering disciplines. However, traditional numerical solvers are limited by the choice of step sizes when estimating integration, resulting in a…

Computational Engineering, Finance, and Science · Computer Science 2023-09-21 Zhongzhan Huang , Senwei Liang , Hong Zhang , Haizhao Yang , Liang Lin

The combination of machine learning and physical laws has shown immense potential for solving scientific problems driven by partial differential equations (PDEs) with the promise of fast inference, zero-shot generalisation, and the ability…

Machine Learning · Computer Science 2024-09-11 Nacime Bouziani , David A. Ham , Ado Farsi

Recent works have shown that deep neural networks can be employed to solve partial differential equations, giving rise to the framework of physics informed neural networks. We introduce a generalization for these methods that manifests as a…

Numerical Analysis · Mathematics 2021-03-25 Remco van der Meer , Cornelis Oosterlee , Anastasia Borovykh

Solving partial differential equations (PDEs) is the canonical approach for understanding the behavior of physical systems. However, large scale solutions of PDEs using state of the art discretization techniques remains an expensive…

Computational Engineering, Finance, and Science · Computer Science 2021-01-14 Xiaoxuan Zhang , Krishna Garikipati

At present, deep learning based methods are being employed to resolve the computational challenges of high-dimensional partial differential equations (PDEs). But the computation of the high order derivatives of neural networks is costly,…

Numerical Analysis · Mathematics 2021-03-17 Quanhui Zhu , Jiang Yang

Partial differential equations (PDEs) are central to describing complex physical system simulations. Their expensive solution techniques have led to an increased interest in deep neural network based surrogates. However, the practical…

Machine Learning · Computer Science 2022-11-17 Jayesh K. Gupta , Johannes Brandstetter

Neural networks are one tool for approximating non-linear differential equations used in scientific computing tasks such as surrogate modeling, real-time predictions, and optimal control. PDE foundation models utilize neural networks to…

Machine Learning · Computer Science 2025-02-11 Elisa Negrini , Yuxuan Liu , Liu Yang , Stanley J. Osher , Hayden Schaeffer