English
Related papers

Related papers: SPUS: A Lightweight and Parameter-Efficient Founda…

200 papers

In this work, we introduce implicit Finite Operator Learning (iFOL) for the continuous and parametric solution of partial differential equations (PDEs) on arbitrary geometries. We propose a physics-informed encoder-decoder network to…

Machine Learning · Computer Science 2025-12-09 Reza Najian Asl , Yusuke Yamazaki , Kianoosh Taghikhani , Mayu Muramatsu , Markus Apel , Shahed Rezaei

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

We propose Stochastic Neural Architecture Search (SNAS), an economical end-to-end solution to Neural Architecture Search (NAS) that trains neural operation parameters and architecture distribution parameters in same round of…

Machine Learning · Computer Science 2020-04-02 Sirui Xie , Hehui Zheng , Chunxiao Liu , Liang Lin

Fluid antenna systems (FAS) signify a pivotal advancement in 6G communication by enhancing spectral efficiency and robustness. However, obtaining accurate channel state information (CSI) in FAS poses challenges due to its complex physical…

Signal Processing · Electrical Eng. & Systems 2026-02-02 Yuan Gao , Yiming Liu , Runze Yu , Shengli Liu , Yanliang Jin , Shunqing Zhang , Shugong Xu , Xiaoli Chu

Speech foundation models (SFMs) are designed to serve as general-purpose representations for a wide range of speech-processing tasks. The last five years have seen an influx of increasingly successful self-supervised and supervised…

Computation and Language · Computer Science 2025-08-19 Ankita Pasad

Minimizing PDE-residual losses is a common strategy to promote physical consistency in neural operators. However, standard formulations often lack variational correctness, meaning that small residuals do not guarantee small solution errors…

Numerical Analysis · Mathematics 2025-12-25 Yuan Qiu , Wolfgang Dahmen , Peng Chen

Solving parametric Partial Differential Equations (PDEs) for a broad range of parameters is a critical challenge in scientific computing. To this end, neural operators, which \textcolor{black}{predicts the PDE solution with variable PDE…

Numerical Analysis · Mathematics 2024-11-14 Weiheng Zhong , Hadi Meidani

A computed approximation of the solution operator to a system of partial differential equations (PDEs) is needed in various areas of science and engineering. Neural operators have been shown to be quite effective at predicting these…

Machine Learning · Computer Science 2024-12-02 Zan Ahmad , Shiyi Chen , Minglang Yin , Avisha Kumar , Nicolas Charon , Natalia Trayanova , Mauro Maggioni

We introduce the Sumudu Neural Operator (SNO), a neural operator rooted in the properties of the Sumudu Transform. We leverage the relationship between the polynomial expansions of transform pairs to decompose the input space as…

Machine Learning · Computer Science 2025-11-18 Ben Zelenskiy , Saibilila Abudukelimu , George Flint , Kevin Zhu , Sunishchal Dev

Physics-informed neural networks (PINNs) often struggle with multi-scale PDEs featuring sharp gradients and nontrivial boundary conditions, as the physics residual and boundary enforcement compete during optimization. We present a…

Numerical Analysis · Mathematics 2025-12-01 Naseem Abbas , Vittorio Colao , Davide Macri , William Spataro

The Poisson-Nernst-Planck (PNP) equations are one of the most effective model for describing electrostatic interactions and diffusion processes in ion solution systems, and have been widely used in the numerical simulations of biological…

Numerical Analysis · Mathematics 2023-12-19 Yang Liu , Shi Shu , Ying Yang

Recently, physics-informed neural networks (PINNs) have offered a powerful new paradigm for solving problems relating to differential equations. Compared to classical numerical methods PINNs have several advantages, for example their…

Computational Physics · Physics 2024-06-21 Ben Moseley , Andrew Markham , Tarje Nissen-Meyer

Industrial design evaluation often relies on high-fidelity simulations of governing partial differential equations (PDEs). While accurate, these simulations are computationally expensive, making dense exploration of design spaces…

Machine Learning · Computer Science 2025-10-01 Zhizhou Zhang , Youjia Wu , Kaixuan Zhang , Yanjia Wang

We are interested in the approximation of partial differential equations with a data-driven approach based on the reduced basis method and machine learning. We suppose that the phenomenon of interest can be modeled by a parametrized partial…

Numerical Analysis · Computer Science 2020-06-24 Niccolò Dal Santo , Simone Deparis , Luca Pegolotti

Segmenting and recognizing diverse object parts is crucial in computer vision and robotics. Despite significant progress in object segmentation, part-level segmentation remains underexplored due to complex boundaries and scarce annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinjian Wu , Ruisong Zhang , Jie Qin , Shijie Ma , Cheng-Lin Liu

Physics-Informed Neural Networks (PINNs) have emerged as a powerful tool for solving partial differential equations~(PDEs) in various scientific and engineering domains. However, traditional PINN architectures typically rely on large, fully…

Computational Engineering, Finance, and Science · Computer Science 2024-04-22 Stefano Markidis

We present a novel framework combining Deep Operator Networks (DeepONets) with Physics-Informed Neural Networks (PINNs) to solve partial differential equations (PDEs) and estimate their unknown parameters. By integrating data-driven…

Machine Learning · Computer Science 2025-08-05 Amogh Raj , Carol Eunice Gudumotou , Sakol Bun , Keerthana Srinivasa , Arash Sarshar

Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed…

Numerical Analysis · Mathematics 2023-05-08 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino

This work presents MicroNAS, an automated neural architecture search tool specifically designed to create models optimized for microcontrollers with small memory resources. The ESP32 microcontroller, with 320 KB of memory, is used as the…

Major efforts in data-driven image super-resolution (SR) primarily focus on expanding the receptive field of the model to better capture contextual information. However, these methods are typically implemented by stacking deeper networks or…

Image and Video Processing · Electrical Eng. & Systems 2025-06-16 Zhangkai Ni , Yang Zhang , Wenhan Yang , Hanli Wang , Shiqi Wang , Sam Kwong