English
Related papers

Related papers: Spectral-inspired Operator Learning with Limited D…

200 papers

Existing neural operator architectures face challenges when solving multiphysics problems with coupled partial differential equations (PDEs) due to complex geometries, interactions between physical variables, and the limited amounts of…

Identifying from observation data the governing differential equations of a physical dynamics is a key challenge in machine learning. Although approaches based on SINDy have shown great promise in this area, they still fail to address a…

Machine Learning · Computer Science 2025-10-22 Fayad Ali Banna , Antoine Caradot , Eduardo Brandao , Jean-Philippe Colombier , Rémi Emonet , Marc Sebban

Neural Operators (NOs) provide a powerful framework for computations involving physical laws that can be modelled by (integro-) partial differential equations (PDEs), directly learning maps between infinite-dimensional function spaces that…

Machine Learning · Computer Science 2025-09-18 Gianluca Fabiani , Hannes Vandecasteele , Somdatta Goswami , Constantinos Siettos , Ioannis G. Kevrekidis

Self-supervised learning (SSL) models have recently demonstrated remarkable performance across various tasks, including image segmentation. This study delves into the emergent characteristics of the Self-Distillation with No Labels (DINO)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Joseph A. Gallego-Mejia , Anna Jungbluth , Laura Martínez-Ferrer , Matt Allen , Francisco Dorr , Freddie Kalaitzis , Raúl Ramos-Pollán

Parametric differential equations of the form du/dt = f(u, x, t, p) are fundamental in science and engineering. While deep learning frameworks such as the Fourier Neural Operator (FNO) can efficiently approximate solutions, they struggle…

Machine Learning · Computer Science 2025-06-03 Abdolmehdi Behroozi , Chaopeng Shen and , Daniel Kifer

Accurate characterization of temperature-dependent thermoelectric properties (TEPs), such as thermal conductivity and the Seebeck coefficient, is essential for reliable modeling and efficient design of thermoelectric devices. However, their…

Materials Science · Physics 2025-06-11 Hyeonbin Moon , Songho Lee , Wabi Demeke , Byungki Ryu , Seunghwa Ryu

Self-supervised learning (SSL) is a powerful paradigm for learning from unlabeled time-series data. However, popular methods such as masked autoencoders (MAEs) rely on reconstructing inputs from a fixed, predetermined masking ratio. Instead…

Machine Learning · Computer Science 2026-03-03 Duy Nguyen , Jiachen Yao , Jiayun Wang , Julius Berner , Animashree Anandkumar

Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling spatiotemporal PDE-dynamics under the influence of randomness. Based on the notion of mild solution of an SPDE, we introduce a novel neural…

Machine Learning · Computer Science 2022-09-27 Cristopher Salvi , Maud Lemercier , Andris Gerasimovics

Fourier Neural Operators (FNOs) have proven to be an efficient and effective method for resolution-independent operator learning in a broad variety of application areas across scientific machine learning. A key reason for their success is…

Fourier Neural Operators (FNOs) have emerged as promising surrogates for partial differential equation solvers. In this work, we extensively tested FNOs on a variety of systems with non-linear and non-stationary properties, using a wide…

Computational Engineering, Finance, and Science · Computer Science 2025-11-13 Rad Haghi , Bipin Gaikwad , Abani Patra

Solving high-frequency oscillatory partial differential equations (PDEs) is a critical challenge in scientific computing, with applications in fluid mechanics, quantum mechanics, and electromagnetic wave propagation. Traditional…

Machine Learning · Computer Science 2025-08-04 Xiong Xiong , Zhuo Zhang , Rongchun Hu , Chen Gao , Zichen Deng

We introduce a novel Multimodal Neural Operator (MNO) architecture designed to learn solution operators for multi-parameter nonlinear boundary value problems (BVPs). Traditional neural operators primarily map either the PDE coefficients or…

Computational Engineering, Finance, and Science · Computer Science 2025-07-17 Vamshi C. Madala , Nithin Govindarajan , Shivkumar Chandrasekaran

The Physics-Informed Neural Network (PINN) framework introduced recently incorporates physics into deep learning, and offers a promising avenue for the solution of partial differential equations (PDEs) as well as identification of the…

Machine Learning · Computer Science 2021-08-04 Ehsan Haghighat , Ali Can Bekar , Erdogan Madenci , Ruben Juanes

We introduce Structure Informed Neural Networks (SINNs), a novel method for solving boundary observation problems involving PDEs. The SINN methodology is a data-driven framework for creating approximate solutions to internal variables on…

Fluid Dynamics · Physics 2023-10-31 Jakub Horsky , Andrew Wynn

A physics-informed neural network (PINN) uses physics-augmented loss functions, e.g., incorporating the residual term from governing partial differential equations (PDEs), to ensure its output is consistent with fundamental physics laws.…

Machine Learning · Computer Science 2022-12-16 Jian Cheng Wong , Chinchun Ooi , Abhishek Gupta , Yew-Soon Ong

Stochastic differential equations (SDEs) and stochastic partial differential equations (SPDEs) are fundamental for modeling stochastic dynamics across the natural sciences and modern machine learning. Learning their solution operators with…

Machine Learning · Computer Science 2026-01-30 Dai Shi , Lequan Lin , Andi Han , Luke Thompson , José Miguel Hernández-Lobato , Zhiyong Wang , Junbin Gao

Deep learning has an increasing impact to assist research, allowing, for example, the discovery of novel materials. Until now, however, these artificial intelligence techniques have fallen short of discovering the full differential equation…

Elliptic partial differential equations (PDEs) are a major class of time-independent PDEs that play a key role in many scientific and engineering domains such as fluid dynamics, plasma physics, and solid mechanics. Recently, neural…

Machine Learning · Computer Science 2024-01-18 Haixin Wang , Jiaxin Li , Anubhav Dwivedi , Kentaro Hara , Tailin Wu

Spatio-temporal process models are often used for modeling dynamic physical and biological phenomena that evolve across space and time. These phenomena may exhibit environmental heterogeneity and complex interactions that are difficult to…

Methodology · Statistics 2026-01-06 Pratik Nag , Andrew Zammit-Mangion , Sumeetpal Singh , Noel Cressie

Physics-Informed Neural Networks (PINNs) have emerged as a powerful tool for solving partial differential equations~(PDEs) in various scientific and engineering domains. However, traditional PINN architectures typically rely on large, fully…

Computational Engineering, Finance, and Science · Computer Science 2024-04-22 Stefano Markidis