English
Related papers

Related papers: Self-supervised Pretraining for Partial Differenti…

200 papers

Microstructural evolution is a key aspect of understanding and exploiting the structure-property-performance relation of materials. Modeling microstructure evolution usually relies on coarse-grained simulations with evolution principles…

Materials Science · Physics 2020-09-01 Kaiqi Yang , Yifan Cao , Youtian Zhang , Ming Tang , Daniel Aberg , Babak Sadigh , Fei Zhou

Classical sequential models employed in time-series prediction rely on learning the mappings from the past to the future instances by way of a hidden state. The Hidden states characterise the historical information and encode the required…

Machine Learning · Computer Science 2023-02-14 Vignesh Gopakumar , Stanislas Pamela , Lorenzo Zanisi

A key appeal of the recently proposed Neural Ordinary Differential Equation (ODE) framework is that it seems to provide a continuous-time extension of discrete residual neural networks. As we show herein, though, trained Neural ODE models…

Machine Learning · Computer Science 2023-09-12 Katharina Ott , Prateek Katiyar , Philipp Hennig , Michael Tiemann

Solving partial differential equations remains a central challenge in scientific machine learning. Neural operators offer a promising route by learning mappings between function spaces and enabling resolution-independent inference, yet they…

Machine Learning · Computer Science 2026-02-03 Paolo Marcandelli , Natansh Mathur , Stefano Markidis , Martina Siena , Stefano Mariani

Unlike ODEs, whose models involve system matrices and whose controllers involve vector or matrix gains, PDE models involve functions in those roles functional coefficients, dependent on the spatial variables, and gain functions dependent on…

Systems and Control · Electrical Eng. & Systems 2023-03-21 Miroslav Krstic , Luke Bhan , Yuanyuan Shi

Deep learning methods are emerging as popular computational tools for solving forward and inverse problems in traffic flow. In this paper, we study a neural operator framework for learning solutions to nonlinear hyperbolic partial…

Machine Learning · Computer Science 2024-06-26 Bilal Thonnam Thodi , Sai Venkata Ramana Ambadipudi , Saif Eddin Jabari

Foundation models for partial differential equations (PDEs) have emerged as powerful surrogates pre-trained on diverse physical systems, but adapting them to new downstream tasks remains challenging due to limited task-specific data and…

Machine Learning · Computer Science 2026-03-17 Vlad Medvedev , Leon Armbruster , Christopher Straub , Georg Kruse , Andreas Rosskopf

Design and optimal control problems are among the fundamental, ubiquitous tasks we face in science and engineering. In both cases, we aim to represent and optimize an unknown (black-box) function that associates a performance/outcome to a…

Machine Learning · Computer Science 2021-10-27 Sifan Wang , Mohamed Aziz Bhouri , Paris Perdikaris

One of the most popular recent areas of machine learning predicates the use of neural networks augmented by information about the underlying process in the form of Partial Differential Equations (PDEs). These physics-informed neural…

Fluid Dynamics · Physics 2025-06-17 Luca Menicali , David H. Richter , Stefano Castruccio

Partial differential equations often contain unknown functions that are difficult or impossible to measure directly, hampering our ability to derive predictions from the model. Workflows for recovering scalar PDE parameters from data are…

Machine Learning · Computer Science 2026-02-16 Torkel E. Loman , Yurij Salmaniw , Antonio Leon Villares , Jose A. Carrillo , Ruth E. Baker

Neural operators have emerged as fast surrogate solvers for parametric partial differential equations (PDEs). However, purely data-driven models often require extensive training data and can generalize poorly, especially in small-data…

Machine Learning · Computer Science 2026-02-16 Heechang Kim , Qianying Cao , Hyomin Shin , Seungchul Lee , George Em Karniadakis , Minseok Choi

We present a method for computing the inverse parameters and the solution field to inverse parametric PDEs based on randomized neural networks. This extends the local extreme learning machine technique originally developed for forward PDEs…

Numerical Analysis · Mathematics 2023-06-28 Suchuan Dong , Yiran Wang

Neural operators improve conventional neural networks by expanding their capabilities of functional mappings between different function spaces to solve partial differential equations (PDEs). One of the most notable methods is the Fourier…

Machine Learning · Computer Science 2024-07-29 Xuanle Zhao , Yue Sun , Tielin Zhang , Bo Xu

Predicting the microstructural and morphological evolution of materials through phase-field modelling is computationally intensive, particularly for high-throughput parametric studies. While neural operators such as the Fourier neural…

Machine Learning · Computer Science 2026-03-11 Nanxi Chen , Airong Chen , Rujin Ma

Mixed-dimensional partial differential equations (PDEs) are characterized by coupled operators defined on domains of varying dimensions and pose significant computational challenges due to their inherent ill-conditioning. Moreover, the…

Numerical Analysis · Mathematics 2025-05-14 Nunzio Dimola , Nicola Rares Franco , Paolo Zunino

Predicting outcomes and planning interactions with the physical world are long-standing goals for machine learning. A variety of such tasks involves continuous physical systems, which can be described by partial differential equations…

Machine Learning · Computer Science 2020-01-22 Philipp Holl , Vladlen Koltun , Nils Thuerey

Under certain statistical assumptions of noise, recent self-supervised approaches for denoising have been introduced to learn network parameters without true clean images, and these methods can restore an image by exploiting information…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Seunghwan Lee , Donghyeon Cho , Jiwon Kim , Tae Hyun Kim

We propose a novel fine-tuning method to achieve multi-operator learning through training a distributed neural operator with diverse function data and then zero-shot fine-tuning the neural network using physics-informed losses for…

Machine Learning · Computer Science 2024-11-12 Zecheng Zhang , Christian Moya , Lu Lu , Guang Lin , Hayden Schaeffer

Partial differential equation (PDE) is an important math tool in science and engineering. This paper experimentally demonstrates an optical neural PDE solver by leveraging the back-propagation-free on-photonic-chip training of…

Neural operators have become increasingly popular in solving \textit{partial differential equations} (PDEs) due to their superior capability to capture intricate mappings between function spaces over complex domains. However, the…

Machine Learning · Computer Science 2026-03-02 Jianing Huang , Kaixuan Zhang , Youjia Wu , Ze Cheng