English
Related papers

Related papers: Learning Operators through Coefficient Mappings in…

200 papers

Recent developments in mechanical, aerospace, and structural engineering have driven a growing need for efficient ways to model and analyse structures at much larger and more complex scales than before. While established numerical methods…

Machine Learning · Computer Science 2025-07-29 Rui Wu , Nikola Kovachki , Burigede Liu

Masked autoencoders (MAEs) have recently shown promise for self-supervised representation learning of resting-state brain functional connectivity (FC). However, a fundamental question remains unresolved: how should FC matrices be tokenized…

Artificial Intelligence · Computer Science 2026-05-20 Leo Milecki , Qingyu Hu , Bahram Jafrasteh , Mert R. Sabuncu , Qingyu Zhao

We introduce Discontinuous Galerkin Finite Element Operator Network (DG--FEONet), a data-free operator learning framework that combines the strengths of the discontinuous Galerkin (DG) method with neural networks to solve parametric partial…

Numerical Analysis · Mathematics 2026-01-08 Kapil Chawla , Youngjoon Hong , Jae Yong Lee , Sanghyun Lee

Machine learning, especially deep learning is gaining much attention due to the breakthrough performance in various cognitive applications. Recently, neural networks (NN) have been intensively explored to model partial differential…

Machine Learning · Computer Science 2022-02-28 Lesley Tan , Liang Chen

Breast ultrasound (BUS) image segmentation plays a crucial role in a computer-aided diagnosis system, which is regarded as a useful tool to help increase the accuracy of breast cancer diagnosis. Recently, many deep learning methods have…

Image and Video Processing · Electrical Eng. & Systems 2020-03-24 Zhenyuan Ning , Ke Wang , Shengzhou Zhong , Qianjin Feng , Yu Zhang

Standard neural networks can approximate general nonlinear operators, represented either explicitly by a combination of mathematical operators, e.g., in an advection-diffusion-reaction partial differential equation, or simply as a black…

Machine Learning · Computer Science 2022-07-19 Somdatta Goswami , Aniruddha Bora , Yue Yu , George Em Karniadakis

Regression with non-Euclidean responses -- e.g., probability distributions, networks, symmetric positive-definite matrices, and compositions -- has become increasingly important in modern applications. In this paper, we propose deep…

Machine Learning · Statistics 2025-10-21 Kyum Kim , Yaqing Chen , Paromita Dubey

In recent years increasingly complex architectures for deep convolution networks (DCNs) have been proposed to boost the performance on image recognition tasks. However, the gains in performance have come at a cost of substantial increase in…

Machine Learning · Computer Science 2016-06-03 Darryl D. Lin , Sachin S. Talathi , V. Sreekanth Annapureddy

Neural operators, such as Fourier Neural Operators (FNO), form a principled approach for learning solution operators for PDEs and other mappings between function spaces. However, many real-world problems require high-resolution training…

When fine-tuning Deep Neural Networks (DNNs) to new data, DNNs are prone to overwriting network parameters required for task-specific functionality on previously learned tasks, resulting in a loss of performance on those tasks. We propose…

Machine Learning · Computer Science 2025-01-22 Christopher Angelini , Nidhal Bouaynaya

Neural operators have been applied in various scientific fields, such as solving parametric partial differential equations, dynamical systems with control, and inverse problems. However, challenges arise when dealing with input functions…

Numerical Analysis · Mathematics 2023-10-31 Zecheng Zhang , Christian Moya , Lu Lu , Guang Lin , Hayden Schaeffer

The increase of available large clinical and experimental datasets has contributed to a substantial amount of important contributions in the area of biomedical image analysis. Image segmentation, which is crucial for any quantitative…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Nikhil Kumar Tomar , Debesh Jha , Michael A. Riegler , Håvard D. Johansen , Dag Johansen , Jens Rittscher , Pål Halvorsen , Sharib Ali

Training with larger number of parameters while keeping fast iterations is an increasingly adopted strategy and trend for developing better performing Deep Neural Network (DNN) models. This necessitates increased memory footprint and…

Machine Learning · Computer Science 2020-01-17 Léopold Cambier , Anahita Bhiwandiwalla , Ting Gong , Mehran Nekuii , Oguz H Elibol , Hanlin Tang

Neural operator learning has emerged as a powerful approach for solving partial differential equations (PDEs) in a data-driven manner. However, applying principal component analysis (PCA) to high-dimensional solution fields incurs…

Machine Learning · Computer Science 2025-09-24 Mrigank Dhingra , Romit Maulik , Adil Rasheed , Omer San

Continual learning can incrementally absorb new concepts without interfering with previously learned knowledge. Motivated by the characteristics of neural networks, in which information is stored in weights on connections, we investigated…

Machine Learning · Computer Science 2023-06-21 Depeng Li , Tianqi Wang , Bingrong Xu , Kenji Kawaguchi , Zhigang Zeng , Ponnuthurai Nagaratnam Suganthan

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

Current physics-informed (standard or deep operator) neural networks still rely on accurately learning the initial and/or boundary conditions of the system of differential equations they are solving. In contrast, standard numerical methods…

Machine Learning · Computer Science 2024-06-25 Rüdiger Brecht , Dmytro R. Popovych , Alex Bihlo , Roman O. Popovych

Neural operators (NOs) struggle with high-contrast multiscale partial differential equations (PDEs), where fine-scale heterogeneities cause large errors. To address this, we use the Generalized Multiscale Finite Element Method (GMsFEM) that…

Deep Operator Networks (DeepONets) have emerged as a powerful surrogate modeling framework for learning solution operators in PDE-governed systems. While their use is expanding across engineering disciplines, applications in geotechnical…

Machine Learning · Computer Science 2026-03-11 Yongjin Choi , Chenying Liu , Jorge Macedo

Deep neural networks (DNNs) have achieved remarkable success in numerous domains, and their application to PDE-related problems has been rapidly advancing. This paper provides an estimate for the generalization error of learning Lipschitz…

Machine Learning · Computer Science 2023-10-04 Ke Chen , Chunmei Wang , Haizhao Yang