English
Related papers

Related papers: Sparse FEONet: A Low-Cost, Memory-Efficient Operat…

200 papers

In this paper, we develop a physics-informed deep operator learning framework for solving multi-term time-fractional mixed diffusion-wave equations (TFMDWEs). We begin by deriving an $L_2$ approximation, which achieves first-order accuracy…

Numerical Analysis · Mathematics 2026-05-19 Binghang Lu , Zhaopeng Hao , Christian Moya , Guang Lin

Historically, the pursuit of efficient inference has been one of the driving forces behind research into new deep learning architectures and building blocks. Some recent examples include: the squeeze-and-excitation module, depthwise…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Erich Elsen , Marat Dukhan , Trevor Gale , Karen Simonyan

This work presents a finite element-guided physics-informed operator learning framework for multiphysics problems with coupled partial differential equations (PDEs) on arbitrary domains. The proposed framework learns an operator from the…

Machine Learning · Computer Science 2026-04-22 Yusuke Yamazaki , Reza Najian Asl , Markus Apel , Mayu Muramatsu , Shahed Rezaei

In this work, we present a study combining two approaches in the context of solving PDEs: the continuous finite element method (FEM) and more recent techniques based on neural networks. In recent years, physics-informed neural networks…

Contemporary Deep Neural Network (DNN) contains millions of synaptic connections with tens to hundreds of layers. The large computation and memory requirements pose a challenge to the hardware design. In this work, we leverage the intrinsic…

Machine Learning · Computer Science 2017-11-07 Jingyang Zhu , Jingbo Jiang , Xizi Chen , Chi-Ying Tsui

The deep operator network (DeepONet) is a popular neural operator architecture that has shown promise in solving partial differential equations (PDEs) by using deep neural networks to map between infinite-dimensional function spaces. In the…

Machine Learning · Computer Science 2025-02-25 Luis Mandl , Somdatta Goswami , Lena Lambers , Tim Ricken

Scientific computing has been an indispensable tool in applied sciences and engineering, where traditional numerical methods are often employed due to their superior accuracy guarantees. However, these methods often encounter challenges…

Numerical Analysis · Mathematics 2024-07-23 Ran Bi , Jingrun Chen , Weibing Deng

In this work, we introduce a novel neural operator, the Solute Transport Operator Network (STONet), to efficiently model contaminant transport in micro-cracked porous media. STONet's model architecture is specifically designed for this…

Machine Learning · Computer Science 2025-07-02 Ehsan Haghighat , Mohammad Hesan Adeli , S Mohammad Mousavi , Ruben Juanes

To obtain fast solutions for governing physical equations in solid mechanics, we introduce a method that integrates the core ideas of the finite element method with physics-informed neural networks and concept of neural operators. This…

In stress field analysis, the finite element analysis is a crucial approach, in which the mesh-density has a significant impact on the results. High mesh density usually contributes authentic to simulation results but costs more computing…

Computational Engineering, Finance, and Science · Computer Science 2021-04-20 Qingfeng Xu , Zhenguo Nie , Handing Xu , Haosu Zhou , Xinjun Liu

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

We introduce a new concept of sparsity for the stochastic elliptic operator $-{\rm div}\left(a(x,\omega)\nabla(\cdot)\right)$, which reflects the compactness of its inverse operator in the stochastic direction and allows for spatially…

Numerical Analysis · Mathematics 2015-06-22 Thomas Y. Hou , Pengfei Liu

Deep neural networks have evolved as the leading approach in 3D medical image segmentation due to their outstanding performance. However, the ever-increasing model size and computation cost of deep neural networks have become the primary…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Boqian Wu , Qiao Xiao , Shiwei Liu , Lu Yin , Mykola Pechenizkiy , Decebal Constantin Mocanu , Maurice Van Keulen , Elena Mocanu

We propose a novel finite element-based physics-informed operator learning framework that allows for predicting spatiotemporal dynamics governed by partial differential equations (PDEs). The proposed framework employs a loss function…

Machine Learning · Computer Science 2024-08-07 Yusuke Yamazaki , Ali Harandi , Mayu Muramatsu , Alexandre Viardin , Markus Apel , Tim Brepols , Stefanie Reese , Shahed Rezaei

Inspired by human driving focus, this research pioneers networks augmented with Focusing Sampling, Partial Field of View Evaluation, Enhanced FPN architecture and Directional IoU Loss - targeted innovations addressing obstacles to precise…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Liman Wang , Hanyang Zhong

Federated Learning (FL) has attracted much interest due to the significant advantages it brings to training deep neural network (DNN) models. However, since communications and computation resources are limited, training DNN models in FL…

Machine Learning · Computer Science 2026-03-17 Ran Greidi , Kobi Cohen

Deep operator networks (DeepONets) are receiving increased attention thanks to their demonstrated capability to approximate nonlinear operators between infinite-dimensional Banach spaces. However, despite their remarkable early promise,…

Machine Learning · Computer Science 2021-03-23 Sifan Wang , Hanwen Wang , Paris Perdikaris

In the pursuit of accurate experimental and computational data while minimizing effort, there is a constant need for high-fidelity results. However, achieving such results often requires significant computational resources. To address this…

Machine Learning · Computer Science 2023-11-08 Amirhossein Mollaali , Izzet Sahin , Iqrar Raza , Christian Moya , Guillermo Paniagua , Guang Lin

Considering the spectral properties of images, we propose a new self-attention mechanism with highly reduced computational complexity, up to a linear rate. To better preserve edges while promoting similarity within objects, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Fengyu Zhang , Ashkan Panahi , Guangjun Gao

Federated Learning (FL) enables multiple resource-constrained edge devices with varying levels of heterogeneity to collaboratively train a global model. However, devices with limited capacity can create bottlenecks and slow down model…

Machine Learning · Computer Science 2025-04-08 Afsaneh Mahanipour , Hana Khamfroush