English
Related papers

Related papers: Multi-Grid Tensorized Fourier Neural Operator for …

200 papers

Data-driven machine learning approaches are being increasingly used to solve partial differential equations (PDEs). They have shown particularly striking successes when training an operator, which takes as input a PDE in some family, and…

Machine Learning · Computer Science 2023-12-04 Tanya Marwah , Ashwini Pokle , J. Zico Kolter , Zachary C. Lipton , Jianfeng Lu , Andrej Risteski

High-fidelity direct numerical simulation of turbulent flows for most real-world applications remains an outstanding computational challenge. Several machine learning approaches have recently been proposed to alleviate the computational…

Fractional Gradient Descent (FGD) offers a novel and promising way to accelerate optimization by incorporating fractional calculus into machine learning. Although FGD has shown encouraging initial results across various optimization tasks,…

Machine Learning · Computer Science 2025-10-22 Jan Sobotka , Petr Šimánek , Pavel Kordík

Machine learning solvers for partial differential equations (PDEs) have attracted growing interest. However, most existing approaches, such as neural network solvers, rely on stochastic training, which is inefficient and typically requires…

Machine Learning · Computer Science 2026-03-27 Qiwei Yuan , Zhitong Xu , Yinghao Chen , Yiming Xu , Houman Owhadi , Shandian Zhe

This paper studies numerical solutions for parameterized partial differential equations (P-PDEs) with deep learning (DL). P-PDEs arise in many important application areas and the computational cost using traditional numerical schemes can be…

Numerical Analysis · Mathematics 2020-11-03 Yuyan Chen , Bin Dong , Jinchao Xu

In this paper, we propose Neumann Series Neural Operator (NSNO) to learn the solution operator of Helmholtz equation from inhomogeneity coefficients and source terms to solutions. Helmholtz equation is a crucial partial differential…

Numerical Analysis · Mathematics 2024-01-25 Fukai Chen , Ziyang Liu , Guochang Lin , Junqing Chen , Zuoqiang Shi

The neural operator (NO) framework has emerged as a powerful tool for solving partial differential equations (PDEs). Recent NOs are dominated by the Transformer architecture, which offers NOs the capability to capture long-range…

Machine Learning · Computer Science 2025-05-20 Xi Han , Jingwei Zhang , Dimitris Samaras , Fei Hou , Hong Qin

Neural PDE solvers are increasingly used as learned surrogates for families of partial differential equations, where the key machine learning challenge is not only interpolation on a fixed benchmark distribution but generalization under…

Machine Learning · Computer Science 2026-05-26 Lennon Shikhman

For partial differential equations on domains of arbitrary shapes, existing works of neural operators attempt to learn a mapping from geometries to solutions. It often requires a large dataset of geometry-solution pairs in order to obtain a…

Machine Learning · Computer Science 2024-05-29 Ze Cheng , Zhongkai Hao , Xiaoqiang Wang , Jianing Huang , Youjia Wu , Xudan Liu , Yiru Zhao , Songming Liu , Hang Su

Neural operators provide fast surrogate models for time-dependent partial differential equations, but their standard autoregressive use usually assumes that the instantaneous field $u(t,\cdot)$ is a complete state. This assumption fails for…

Machine Learning · Computer Science 2026-05-13 Lennon J. Shikhman

Neural operators learn mappings from function-dependent inputs to solutions, providing an effective framework for solving partial differential equations (PDEs). For time-dependent PDEs, existing methods typically perform long-horizon…

Machine Learning · Computer Science 2026-05-29 Jiaquan Zhang , Caiyan Qin , Haoyu Bian , Libin Cai , Yi Lu , Chaoning Zhang , Wei Dong , Yuanfang Guo , Yang Yang , Hen Tao Shen

An increasing number of emerging applications in data science and engineering are based on multidimensional and structurally rich data. The irregularities, however, of high-dimensional data often compromise the effectiveness of standard…

This paper introduces the Kernel Neural Operator (KNO), a provably convergent operator-learning architecture that utilizes compositions of deep kernel-based integral operators for function-space approximation of operators (maps from…

Machine Learning · Computer Science 2026-05-06 Matthew Lowery , John Turnage , Zachary Morrow , John D. Jakeman , Akil Narayan , Shandian Zhe , Varun Shankar

Numerical simulations are essential tools to evaluate the solution of the wave equation in complex settings, such as three-dimensional (3D) domains with heterogeneous properties. However, their application is limited by high computational…

Machine Learning · Computer Science 2025-04-09 Fanny Lehmann , Filippo Gatti , Didier Clouteau

It is challenging to reduce the complexity of neural networks while maintaining their generalization ability and robustness, especially for practical applications. Conventional solutions for this problem incorporate quantum-inspired neural…

Machine Learning · Computer Science 2025-11-13 Andi Chen

In this paper, we investigate neural networks applied to multiscale simulations and discuss a design of a novel deep neural network model reduction approach for multiscale problems. Due to the multiscale nature of the medium, the fine-grid…

Numerical Analysis · Mathematics 2024-12-20 Min Wang , Siu Wun Cheung , Wing Tat Leung , Eric T. Chung , Yalchin Efendiev , Mary Wheeler

High-fidelity simulations of laser welding capture complex thermo-fluid phenomena, including phase change, free-surface deformation, and keyhole dynamics, however their computational cost limits large-scale process exploration and real-time…

Machine Learning · Computer Science 2026-04-01 Alix Benoit , Toni Ivas , Mateusz Papierz , Asel Sagingalieva , Alexey Melnikov , Elia Iseli

Real-time monitoring of induced seismicity is critical to mitigate operational risks, relying on the rapid and accurate classification of triggered data from continuous data streams. Deep learning models are effective for this purpose but…

Geophysics · Physics 2026-04-14 Ayrat Abdullin , Umair bin Waheed , Leo Eisner , Abdullatif Al-Shuhail

Tensor decomposition has been widely used in machine learning and high-volume data analysis. However, large-scale tensor factorization often consumes huge memory and computing cost. Meanwhile, modernized computing hardware such as tensor…

Optimization and Control · Mathematics 2022-09-12 Zi Yang , Junnan Shan , Zheng Zhang

Conventional numerical solvers for the radiative transfer equation (RTE) exhibit severe sensitivity to medium parameters. To address this, we propose an operator learning framework that approximates the RTE solution map as a function of…

Numerical Analysis · Mathematics 2026-04-28 Qinchen Song , Xinliang Liu , Lei Zhang