English
Related papers

Related papers: When Network Architecture Meets Physics: Deep Oper…

200 papers

Physics-based deep learning frameworks have shown to be effective in accurately modeling the dynamics of complex physical systems with generalization capability across problem inputs. However, time-independent problems pose the challenge of…

Machine Learning · Computer Science 2023-03-29 Rini Jasmine Gladstone , Helia Rahmani , Vishvas Suryakumar , Hadi Meidani , Marta D'Elia , Ahmad Zareei

Modern deep learning models operating on multi-modal visual signals often rely on inductive biases that are poorly aligned with the physical processes governing signal formation, leading to brittle performance under cross-spectral and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Georgios Voulgaris

Developing the proper representations for simulating high-speed flows with strong shock waves, rarefactions, and contact discontinuities has been a long-standing question in numerical analysis. Herein, we employ neural operators to solve…

Machine Learning · Computer Science 2024-04-23 Ahmad Peyvan , Vivek Oommen , Ameya D. Jagtap , George Em Karniadakis

Effective real-time monitoring is a foundation of digital twin technology, crucial for detecting material degradation and maintaining the structural integrity of nuclear systems to ensure both safety and operational efficiency. Traditional…

Machine Learning · Computer Science 2024-12-02 Raisa Bentay Hossain , Farid Ahmed , Kazuma Kobayashi , Seid Koric , Diab Abueidda , Syed Bahauddin Alam

The deep operator networks (DeepONet), a class of neural operators that learn mappings between function spaces, have recently been developed as surrogate models for parametric partial differential equations (PDEs). In this work we propose a…

Machine Learning · Computer Science 2024-10-31 Yuan Qiu , Nolan Bridges , Peng Chen

The solution of partial differential equations (PDEs) plays a central role in numerous applications in science and engineering, particularly those involving multiphase flow in porous media. Complex, nonlinear systems govern these problems…

This focused review explores a range of neural operator architectures for approximating solutions to parametric partial differential equations (PDEs), emphasizing high-level concepts and practical implementation strategies. The study covers…

Computational Engineering, Finance, and Science · Computer Science 2025-03-10 Prashant K. Jha

While modern deep networks have demonstrated remarkable versatility, their training dynamics remain poorly understood--often driven more by empirical tweaks than architectural insight. This paper investigates how internal structural choices…

Machine Learning · Computer Science 2025-08-26 Saleh Nikooroo , Thomas Engel

In recent years, there has been a surge in applying deep learning to various challenging design problems in communication networks. The early attempts adopt neural architectures inherited from applications such as computer vision, which…

Information Theory · Computer Science 2022-03-22 Yifei Shen , Jun Zhang , Khaled B. Letaief

Neural operator learning models have emerged as very effective surrogates in data-driven methods for partial differential equations (PDEs) across different applications from computational science and engineering. Such operator learning…

Machine Learning · Computer Science 2024-05-30 Benjamin Shih , Ahmad Peyvan , Zhongqiang Zhang , George Em Karniadakis

The evaluation of Deep Learning models has traditionally focused on criteria such as accuracy, F1 score, and related measures. The increasing availability of high computational power environments allows the creation of deeper and more…

Machine Learning · Computer Science 2023-02-03 Yinlena Xu , Silverio Martínez-Fernández , Matias Martinez , Xavier Franch

The order/dimension of models derived on the basis of data is commonly restricted by the number of observations, or in the context of monitored systems, sensing nodes. This is particularly true for structural systems (e.g., civil or…

Machine Learning · Computer Science 2022-12-01 Zhilu Lai , Wei Liu , Xudong Jian , Kiran Bacsa , Limin Sun , Eleni Chatzi

A popular testbed for deep learning has been multimodal recognition of human activity or gesture involving diverse inputs such as video, audio, skeletal pose and depth images. Deep learning architectures have excelled on such problems due…

Neural and Evolutionary Computing · Computer Science 2017-07-05 Dhanesh Ramachandram , Michal Lisicki , Timothy J. Shields , Mohamed R. Amer , Graham W. Taylor

Operator learning provides methods to approximate mappings between infinite-dimensional function spaces. Deep operator networks (DeepONets) are a notable architecture in this field. Recently, an extension of DeepONet based on model…

Machine Learning · Computer Science 2024-03-28 Hamidreza Eivazi , Stefan Wittek , Andreas Rausch

This paper integrates deep neural networks (DNNs) into structural economic models to increase flexibility and capture rich heterogeneity while preserving interpretability. Economic structure and machine learning are complements in empirical…

Econometrics · Economics 2025-04-28 Max H. Farrell , Tengyuan Liang , Sanjog Misra

Deep learning (DL) workflows demand an ever-increasing budget of compute and energy in order to achieve outsized gains. Neural architecture searches, hyperparameter sweeps, and rapid prototyping consume immense resources that can prevent…

Physics-informed neural networks and Physics-informed DeepONet excel in solving partial differential equations; however, they often fail to converge for singularly perturbed problems. To address this, we propose two novel frameworks,…

Machine Learning · Computer Science 2026-04-06 Tiantian Sun , Jian Zu

In this paper, we introduce a physics and geometry informed neural operator network with application to the forward simulation of acoustic scattering. The development of geometry informed deep learning models capable of learning a solution…

Machine Learning · Computer Science 2024-06-06 Siddharth Nair , Timothy F. Walsh , Greg Pickrell , Fabio Semperlotti

While much of the work in the design of convolutional networks over the last five years has revolved around the empirical investigation of the importance of depth, filter sizes, and number of feature channels, recent studies have shown that…

Machine Learning · Computer Science 2017-12-08 Karim Ahmed , Lorenzo Torresani

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey