English
Related papers

Related papers: Latent Neural PDE Solver: a reduced-order modellin…

200 papers

The learning rate schedule is one of the most impactful aspects of neural network optimization, yet most schedules either follow simple parametric functions or react only to short-term training signals. None of them are supported by a…

Machine Learning · Computer Science 2025-09-30 Matt L. Sampson , Peter Melchior

Partial differential equations (PDEs) are central to modeling physical and engineering systems, but repeatedly solving parametric PDEs remains computationally expensive. Operator learning enables fast surrogate inference, yet typically…

Quantum Physics · Physics 2026-05-28 Chanyoung Kim , Myeonghwan Seong , Yujin Kim , Daniel K. Park , Youngjoon Hong

Despite prior advances in PINNs, significant challenges remain in localized solid mechanics problems because of the limitations of single network formulations in simultaneous resolution of smooth global responses and near-tip singularities,…

Computational Physics · Physics 2025-10-22 Zhihong Lai , Luyang Zhao , Qian Shao

We propose machine learning methods for solving fully nonlinear partial differential equations (PDEs) with convex Hamiltonian. Our algorithms are conducted in two steps. First the PDE is rewritten in its dual stochastic control…

Computational Finance · Quantitative Finance 2022-05-23 William Lefebvre , Grégoire Loeper , Huyên Pham

Solving partial differential equations (PDEs) with neural networks (NNs) has shown great potential in various scientific and engineering fields. However, most existing NN solvers mainly focus on satisfying the given PDE formulas in the…

Machine Learning · Computer Science 2025-08-08 Gaohang Chen , Lili Ju , Zhonghua Qiao

Latent representation learned from multi-layered neural networks via hierarchical feature abstraction enables recent success of deep learning. Under the deep learning framework, generalization performance highly depends on the learned…

Machine Learning · Computer Science 2016-11-07 Hyo-Eun Kim , Sangheum Hwang , Kyunghyun Cho

Solving high-dimensional partial differential equations (PDEs) is a major challenge in scientific computing. We develop a new numerical method for solving elliptic-type PDEs by adapting the Q-learning algorithm in reinforcement learning.…

Numerical Analysis · Mathematics 2023-06-27 Samuel N. Cohen , Deqing Jiang , Justin Sirignano

Designing neural networks within a Hamiltonian framework offers a principled way to ensure that conservation laws are respected in physical systems. While promising, these capabilities have been largely limited to discrete, analytically…

Machine Learning · Computer Science 2025-09-30 Anthony Zhou , Amir Barati Farimani

Partial differential equations (PDEs) are central to scientific modeling. Modern workflows increasingly rely on learning-based components to support model reuse, inference, and integration across large computational processes. Despite the…

Machine Learning · Computer Science 2026-02-20 Yilong Dai , Shengyu Chen , Ziyi Wang , Xiaowei Jia , Yiqun Xie , Vipin Kumar , Runlong Yu

Neural networks are discrete entities: subdivided into discrete layers and parametrized by weights which are iteratively optimized via difference equations. Recent work proposes networks with layer outputs which are no longer quantized but…

Neural and Evolutionary Computing · Computer Science 2019-09-09 Stefano Massaroli , Michael Poli , Federico Califano , Angela Faragasso , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

We present a novel method for using Neural Networks (NNs) for finding solutions to a class of Partial Differential Equations (PDEs). Our method builds on recent advances in Neural Radiance Field research (NeRFs) and allows for a NN to…

Machine Learning · Computer Science 2022-05-31 Jaroslaw Rzepecki , Daniel Bates , Chris Doran

Machine learning based partial differential equations (PDEs) solvers have received great attention in recent years. Most progress in this area has been driven by deep neural networks such as physics-informed neural networks (PINNs) and…

Numerical Analysis · Mathematics 2025-09-23 Chunyang Liao

We present a computational technique for modeling the evolution of dynamical systems in a reduced basis, with a focus on the challenging problem of modeling partially-observed partial differential equations (PDEs) on high-dimensional…

Machine Learning · Statistics 2024-12-25 Victor Churchill

Implicit layer deep learning techniques, like Neural Differential Equations, have become an important modeling framework due to their ability to adapt to new problems automatically. Training a neural differential equation is effectively a…

Machine Learning · Computer Science 2023-06-05 Avik Pal , Alan Edelman , Chris Rackauckas

This study presents the conditional neural fields for reduced-order modeling (CNF-ROM) framework to approximate solutions of parametrized partial differential equations (PDEs). The approach combines a parametric neural ODE (PNODE) for…

Numerical Analysis · Mathematics 2024-12-09 Minji Kim , Tianshu Wen , Kookjin Lee , Youngsoo Choi

Traditional, numerical discretization-based solvers of partial differential equations (PDEs) are fundamentally agnostic to domains, boundary conditions and coefficients. In contrast, machine learnt solvers have a limited generalizability…

Numerical Analysis · Mathematics 2023-02-01 Xiaoxuan Zhang , Krishna Garikipati

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

Machine Learning · Computer Science 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

In this paper, we propose neural networks that tackle the problems of stability and field-of-view of a Convolutional Neural Network (CNN). As an alternative to increasing the network's depth or width to improve performance, we propose…

Machine Learning · Computer Science 2021-11-03 Bastian Bohn , Michael Griebel , Dinesh Kannan

In this paper, we address the issue of modeling and estimating changes in the state of the spatio-temporal dynamical systems based on a sequence of observations like video frames. Traditional numerical simulation systems depend largely on…

Machine Learning · Computer Science 2024-02-12 Kun Wang , Hao Wu , Guibin Zhang , Junfeng Fang , Yuxuan Liang , Yuankai Wu , Roger Zimmermann , Yang Wang

Physics-informed neural networks solve partial differential equations by training neural networks. Since this method approximates infinite-dimensional PDE solutions with finite collocation points, minimizing discretization errors by…

Machine Learning · Computer Science 2024-12-11 Takashi Matsubara , Takaharu Yaguchi