English
Related papers

Related papers: Guaranteed Approximation Bounds for Mixed-Precisio…

200 papers

Traditionally, classical numerical schemes have been employed to solve partial differential equations (PDEs) using computational methods. Recently, neural network-based methods have emerged. Despite these advancements, neural network-based…

Numerical Analysis · Mathematics 2024-05-14 Taeyoung Kim , Myungjoo Kang

Memory complexity and data scarcity have so far prohibited learning solution operators of partial differential equations (PDEs) at high resolutions. We address these limitations by introducing a new data efficient and highly parallelizable…

Machine Learning · Computer Science 2023-10-03 Jean Kossaifi , Nikola Kovachki , Kamyar Azizzadenesheli , Anima Anandkumar

Fourier Neural Operators (FNOs) have emerged as promising surrogates for partial differential equation solvers. In this work, we extensively tested FNOs on a variety of systems with non-linear and non-stationary properties, using a wide…

Computational Engineering, Finance, and Science · Computer Science 2025-11-13 Rad Haghi , Bipin Gaikwad , Abani Patra

Fourier Neural Operators (FNOs) have been promoted as fast, mesh-invariant surrogates for partial-differential equation solvers, with seismic studies reporting orders-of-magnitude speedup over classical methods. We revisit those claims by…

Geophysics · Physics 2025-08-18 Dimitri Voytan , Litan Li

Deep neural networks (DNNs) are becoming increasingly deeper, wider, and non-linear due to the growing demands on prediction accuracy and analysis quality. When training a DNN model, the intermediate activation data must be saved in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-24 Sian Jin , Guanpeng Li , Shuaiwen Leon Song , Dingwen Tao

We propose the geometry-informed neural operator (GINO), a highly efficient approach to learning the solution operator of large-scale partial differential equations with varying geometries. GINO uses a signed distance function and…

Microstructural evolution, particularly grain growth, plays a critical role in shaping the physical, optical, and electronic properties of materials. Traditional phase-field modeling accurately simulates these phenomena but is…

Materials Science · Physics 2026-04-15 Iman Peivaste , Ahmed Makradi , Salim Belouettar

Deep learning-based surrogate models have been widely applied in geological carbon storage (GCS) problems to accelerate the prediction of reservoir pressure and CO2 plume migration. Large amounts of data from physics-based numerical…

Machine Learning · Statistics 2024-01-11 Hewei Tang , Qingkai Kong , Joseph P. Morris

Meta-optics promises compact, high-performance imaging and color routing. However, designing high-performance structures is a high-dimensional optimization problem: mapping a desired optical output back to a physical 3D structure requires…

Machine Learning · Computer Science 2026-04-21 Chanik Kang , Hyewon Suk , Haejun Chung

Reduced precision computation for deep neural networks is one of the key areas addressing the widening compute gap driven by an exponential growth in model size. In recent years, deep learning training has largely migrated to 16-bit…

Machine Learning · Computer Science 2019-05-30 Naveen Mellempudi , Sudarshan Srinivasan , Dipankar Das , Bharat Kaul

Neural operators (NO) are discretization invariant deep learning methods with functional output and can approximate any continuous operator. NO have demonstrated the superiority of solving partial differential equations (PDEs) over other…

Numerical Analysis · Mathematics 2024-02-02 Jianguo Huang , Yue Qiu

Predicting the microstructural and morphological evolution of materials through phase-field modelling is computationally intensive, particularly for high-throughput parametric studies. While neural operators such as the Fourier neural…

Machine Learning · Computer Science 2026-03-11 Nanxi Chen , Airong Chen , Rujin Ma

We formulate mold filling in metal casting as a 2D neural operator learning problem that maps geometry and boundary data on an unstructured mesh to time resolved flow quantities, replacing expensive transient CFD. In the proposed method, a…

Computational Engineering, Finance, and Science · Computer Science 2025-10-31 Edgard Moreira Minete , Mathis Immertreu , Fabian Teichmann , Sebastian Müller

Solving Singularly Perturbed Differential Equations (SPDEs) poses computational challenges arising from the rapid transitions in their solutions within thin regions. The effectiveness of deep learning in addressing differential equations…

Machine Learning · Computer Science 2024-09-10 Ye Li , Ting Du , Yiwen Pang , Zhongyi Huang

We present FNOpt, a self-supervised cloth simulation framework that formulates time integration as an optimization problem and trains a resolution-agnostic neural optimizer parameterized by a Fourier neural operator (FNO). Prior neural…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Ruochen Chen , Thuy Tran , Shaifali Parashar

Neural operators have emerged as powerful surrogates for dynamical systems due to their grid-invariant properties and computational efficiency. However, the Fourier-based neural operator framework inherently truncates high-frequency…

Machine Learning · Computer Science 2026-04-09 Tianyue Yang , Xiao Xue

Solving partial differential equations remains a central challenge in scientific machine learning. Neural operators offer a promising route by learning mappings between function spaces and enabling resolution-independent inference, yet they…

Machine Learning · Computer Science 2026-02-03 Paolo Marcandelli , Natansh Mathur , Stefano Markidis , Martina Siena , Stefano Mariani

Fourier neural operators (FNOs) can learn highly nonlinear mappings between function spaces, and have recently become a popular tool for learning responses of complex physical systems. However, to achieve good accuracy and efficiency, FNOs…

Machine Learning · Computer Science 2023-10-31 Ning Liu , Siavash Jafarzadeh , Yue Yu

A standard practice in developing image recognition models is to train a model on a specific image resolution and then deploy it. However, in real-world inference, models often encounter images different from the training sets in resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Jinsung Jeon , Hyundong Jin , Jonghyun Choi , Sanghyun Hong , Dongeun Lee , Kookjin Lee , Noseong Park

Physics-Informed Neural Operators provide efficient, high-fidelity simulations for systems governed by partial differential equations (PDEs). However, most existing studies focus only on multi-scale, multi-physics systems within a single…

Machine Learning · Computer Science 2025-07-08 Weidong Wu , Yong Zhang , Lili Hao , Yang Chen , Xiaoyan Sun , Dunwei Gong