English
Related papers

Related papers: FB-HyDON: Parameter-Efficient Physics-Informed Ope…

200 papers

This paper presents a proper generalized decomposition (PGD) based reduced-order model of hierarchical deep-learning neural networks (HiDeNN). The proposed HiDeNN-PGD method keeps both advantages of HiDeNN and PGD methods. The automatic…

Numerical Analysis · Mathematics 2022-01-12 Lei Zhang , Ye Lu , Shaoqiang Tang , Wing Kam Liu

Deep neural operators (DNOs) have been utilized to approximate nonlinear mappings between function spaces. However, DNOs face the challenge of increased dimensionality and computational cost associated with unaligned observation data. In…

Machine Learning · Computer Science 2023-08-21 Bo Chen , Chenyu Wang , Weipeng Li , Haiyang Fu

Deep Operator Network (DeepONet) is a neural network framework for learning nonlinear operators such as those from ordinary differential equations (ODEs) describing complex systems. Multiple-input deep neural operators (MIONet) extended…

Machine Learning · Computer Science 2023-11-30 Zhihao Kong , Amirhossein Mollaali , Christian Moya , Na Lu , Guang Lin

Neural operators have emerged as powerful surrogates for the solution of partial differential equations (PDEs), yet their ability to handle general, highly variable boundary conditions (BCs) remains limited. Existing approaches often fail…

Machine Learning · Computer Science 2026-05-14 Sepehr Mousavi , Siddhartha Mishra , Laura De Lorenzis

Operator learning trains a neural network to map functions to functions. An ideal operator learning framework should be mesh-free in the sense that the training does not require a particular choice of discretization for the input functions,…

Numerical Analysis · Mathematics 2022-12-15 Zecheng Zhang , Wing Tat Leung , Hayden Schaeffer

Kolmogorov-Arnold networks (KANs) have attracted attention recently as an alternative to multilayer perceptrons (MLPs) for scientific machine learning. However, KANs can be expensive to train, even for relatively small networks. Inspired by…

Machine Learning · Computer Science 2025-11-18 Amanda A. Howard , Bruno Jacob , Sarah Helfert , Alexander Heinlein , Panos Stinis

In this paper, we evaluate the effectiveness of deep operator networks (DeepONets) in solving both forward and inverse problems of partial differential equations (PDEs) on unknown manifolds. By unknown manifolds, we identify the manifold by…

Numerical Analysis · Mathematics 2024-07-09 Anran Jiao , Qile Yan , Jhn Harlim , Lu Lu

Physics informed neural networks (PINNs) have emerged as a powerful tool to provide robust and accurate approximations of solutions to partial differential equations (PDEs). However, PINNs face serious difficulties and challenges when…

Machine Learning · Computer Science 2023-07-11 Rajat Arora

Recent advances in modeling large-scale complex physical systems have shifted research focuses towards data-driven techniques. However, generating datasets by simulating complex systems can require significant computational resources.…

Machine Learning · Statistics 2022-08-22 Subhayan De , Matthew Reynolds , Malik Hassanaly , Ryan N. King , Alireza Doostan

The traditional limitations of neural networks in reliably generalizing beyond the convex hulls of their training data present a significant problem for computational physics, in which one often wishes to solve PDEs in regimes far beyond…

Machine Learning · Computer Science 2026-02-17 Jonathan Gorard , Ammar Hakim , James Juno

For four decades statistical physics has been providing a framework to analyse neural networks. A long-standing question remained on its capacity to tackle deep learning models capturing rich feature learning effects, thus going beyond the…

Machine Learning · Statistics 2025-12-15 Jean Barbier , Francesco Camilli , Minh-Toan Nguyen , Mauro Pastore , Rudy Skerk

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of…

Machine Learning · Computer Science 2021-10-13 Sifan Wang , Hanwen Wang , Paris Perdikaris

Physics-informed neural networks (PINNs) effectively embed physical principles into machine learning, but often struggle with complex or alternating geometries. We propose a novel method for integrating geometric transformations within…

Machine Learning · Computer Science 2023-11-30 Samuel Burbulla

Learning high-performance deep neural networks for dynamic modeling of high Degree-Of-Freedom (DOF) robots remains challenging due to the sampling complexity. Typical unknown system disturbance caused by unmodeled dynamics (such as internal…

Robotics · Computer Science 2022-10-05 Hongbin Lin , Qian Gao , Xiangyu Chu , Qi Dou , Anton Deguet , Peter Kazanzides , K. W. Samuel Au

Despite their widespread success, the application of deep neural networks to functional data remains scarce today. The infinite dimensionality of functional data means standard learning algorithms can be applied only after appropriate…

Machine Learning · Statistics 2021-06-22 Junwen Yao , Jonas Mueller , Jane-Ling Wang

In recent years, deep learning for modeling physical phenomena which can be described by partial differential equations (PDEs) have received significant attention. For example, for learning Hamiltonian mechanics, methods based on deep…

Machine Learning · Computer Science 2025-02-28 Baige Xu , Yusuke Tanaka , Takashi Matsubara , Takaharu Yaguchi

We introduce a novel deep operator network (DeepONet) framework that incorporates generalised variational inference (GVI) using R\'enyi's $\alpha$-divergence to learn complex operators while quantifying uncertainty. By incorporating…

Machine Learning · Statistics 2025-12-09 Soban Nasir Lone , Subhayan De , Rajdip Nayek

Scientific computing has been an indispensable tool in applied sciences and engineering, where traditional numerical methods are often employed due to their superior accuracy guarantees. However, these methods often encounter challenges…

Numerical Analysis · Mathematics 2024-07-23 Ran Bi , Jingrun Chen , Weibing Deng

Federated Learning (FL) faces significant challenges with domain shifts in heterogeneous data, degrading performance. Traditional domain generalization aims to learn domain-invariant features, but the federated nature of model averaging…

Machine Learning · Computer Science 2024-05-29 Marc Bartholet , Taehyeon Kim , Ami Beuret , Se-Young Yun , Joachim M. Buhmann

Deep operator networks (DeepONets) are powerful architectures for fast and accurate emulation of complex dynamics. As their remarkable generalization capabilities are primarily enabled by their projection-based attribute, we investigate…

Machine Learning · Computer Science 2022-11-15 Simone Venturi , Tiernan Casey