English
Related papers

Related papers: NeuralStagger: Accelerating Physics-constrained Ne…

200 papers

Predictive models can be used on high-dimensional brain images for diagnosis of a clinical condition. Spatial regularization through structured sparsity offers new perspectives in this context and reduces the risk of overfitting the model…

Recent research has used deep learning to develop partial differential equation (PDE) models in science and engineering. The functional form of the PDE is determined by a neural network, and the neural network parameters are calibrated to…

Machine Learning · Computer Science 2023-10-17 Justin Sirignano , Jonathan MacArt , Konstantinos Spiliopoulos

This work presents a deep learning-based framework for the solution of partial differential equations on complex computational domains described with computer-aided design tools. To account for the underlying distribution of the training…

Computational Engineering, Finance, and Science · Computer Science 2022-03-18 Moritz von Tresckow , Stefan Kurz , Herbert De Gersem , Dimitrios Loukrezis

Scientific machine learning is an emerging field that broadly describes the combination of scientific computing and machine learning to address challenges in science and engineering. Within the context of differential equations, this has…

Machine Learning · Computer Science 2026-04-03 Laurens R. Lueg , Victor Alves , Daniel Schicksnus , John R. Kitchin , Carl D. Laird , Lorenz T. Biegler

This work proposes an autoencoder neural network as a non-linear generalization of projection-based methods for solving Partial Differential Equations (PDEs). The proposed deep learning architecture presented is capable of generating the…

Computational Physics · Physics 2020-06-25 Jaime Lopez Garcia , Angel Rivero Jimenez

Physics-Informed Neural Networks (PINNs) have emerged as a promising paradigm for solving partial differential equations (PDEs) by embedding physical laws into neural network training objectives. However, their deployment on…

Machine Learning · Computer Science 2025-12-11 Jinming Lu , Jiayi Tian , Yequan Zhao , Hai Li , Zheng Zhang

To date, the simulation of organ deformations for applications like therapy planning or image-guided interventions is calculated by solving the elastodynamics equations. While efficient solvers have been proposed for fast simulations,…

Quantitative Methods · Quantitative Biology 2018-12-18 Felix Meister , Tiziano Passerini , Viorel Mihalef , Ahmet Tuysuzoglu , Andreas Maier , Tommaso Mansi

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

When solving partial differential equations (PDEs), classical numerical methods often require fine mesh grids and small time stepping to meet stability, consistency, and convergence conditions, leading to high computational cost. Recently,…

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

Machine Learning · Computer Science 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

Deep learning has emerged as a transformative tool for the neural surrogate modeling of partial differential equations (PDEs), known as neural PDE solvers. However, scaling these solvers to industrial-scale geometries with over $10^8$ cells…

Machine Learning · Computer Science 2026-02-06 Hang Zhou , Haixu Wu , Haonan Shangguan , Yuezhou Ma , Huikun Weng , Jianmin Wang , Mingsheng Long

We propose a novel approach for training Physics-enhanced Neural ODEs (PeN-ODEs) by expressing the training process as a dynamic optimization problem. The full model, including neural components, is discretized using a high-order implicit…

Machine Learning · Computer Science 2025-08-07 Linus Langenkamp , Philip Hannebohm , Bernhard Bachmann

Partial differential equation (PDE)-constrained optimization arises in many scientific and engineering domains, such as energy systems, fluid dynamics and material design. In these problems, the decision variables (e.g., control inputs or…

Machine Learning · Computer Science 2026-01-21 Yusuf Guven , Vincenzo Di Vito , Ferdinando Fioretto

Despite the notable success of deep neural networks (DNNs) in solving complex tasks, the training process still remains considerable challenges. A primary obstacle is the substantial time required for training, particularly as high…

Machine Learning · Computer Science 2025-09-09 Viet Hoang Pham , Hyo-Sung Ahn

Neural surrogate solvers of partial differential equations (PDEs) promise dramatic speedups over numerical methods, especially in scenarios requiring many solves. However, current accuracy-based evaluations do not fully consider two central…

Machine Learning · Computer Science 2026-05-18 Yijing Zhang , Nicholas Roberts , Tanya Marwah , Mikhail Khodak

In this work, we study physics-informed neural networks (PINNs) constrained by partial differential equations (PDEs) and their application in approximating PDEs with two characteristic scales. From a continuous perspective, our formulation…

Optimization and Control · Mathematics 2024-09-06 Michael Hintermüller , Denis Korolev

Nonlinear PDE solvers require fine space-time discretizations and local linearizations, leading to high memory cost and slow runtimes. Neural operators such as FNOs and DeepONets offer fast single-shot inference by learning…

Machine Learning · Computer Science 2025-10-23 Yifei Sun

The high computational cost associated with solving for detailed chemistry poses a significant challenge for predictive computational fluid dynamics (CFD) simulations of turbulent reacting flows. These models often require solving a system…

Computational Physics · Physics 2024-03-05 Tadbhagya Kumar , Anuj Kumar , Pinaki Pal

This paper presents an efficient module named spatial bottleneck for accelerating the convolutional layers in deep neural networks. The core idea is to decompose convolution into two stages, which first reduce the spatial resolution of the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-10 Junran Peng , Lingxi Xie , Zhaoxiang Zhang , Tieniu Tan , Jingdong Wang

Solving partial differential equations (PDEs) using neural networks has become a central focus in scientific machine learning. Training neural networks for singularly perturbed problems is particularly challenging due to certain parameters…

Machine Learning · Computer Science 2025-05-30 Chuqi Chen , Yahong Yang , Yang Xiang , Wenrui Hao