English
Related papers

Related papers: Fourier Neural Solver for large sparse linear alge…

200 papers

Time-series prediction has drawn considerable attention during the past decades fueled by the emerging advances of deep learning methods. However, most neural network based methods lack interpretability and fail in extracting the hidden…

Machine Learning · Computer Science 2023-03-03 Xiaoyi Liu , Duxin Chen , Wenjia Wei , Xia Zhu , Wenwu Yu

Neural networks have proven to be extremely powerful tools for modern artificial intelligence applications, but computational and storage complexity remain limiting factors. This paper presents two compatible contributions towards reducing…

Machine Learning · Computer Science 2024-10-30 Sourya Dey , Kuan-Wen Huang , Peter A. Beerel , Keith M. Chugg

The computational efficiency of many neural operators, widely used for learning solutions of PDEs, relies on the fast Fourier transform (FFT) for performing spectral computations. As the FFT is limited to equispaced (rectangular) grids,…

In this work we propose a unified Fourier Spectral Transformer network that integrates the strengths of classical spectral methods and attention based neural architectures. By transforming the original PDEs into spectral ordinary…

Machine Learning · Computer Science 2025-07-09 Beibei Li

Recently, physics-informed neural networks (PINNs) have offered a powerful new paradigm for solving problems relating to differential equations. Compared to classical numerical methods PINNs have several advantages, for example their…

Computational Physics · Physics 2024-06-21 Ben Moseley , Andrew Markham , Tarje Nissen-Meyer

With rapid progress in deep learning, neural networks have been widely used in scientific research and engineering applications as surrogate models. Despite the great success of neural networks in fitting complex systems, two major…

Machine Learning · Computer Science 2023-06-13 Yuwen Deng , Wang Kang , Wei W. Xing

A neural network is essentially a high-dimensional complex mapping model by adjusting network weights for feature fitting. However, the spectral bias in network training leads to unbearable training epochs for fitting the high-frequency…

Signal Processing · Electrical Eng. & Systems 2021-06-22 Zhi Zeng , Pengpeng Shi , Fulei Ma , Peihan Qi

We propose a general framework for solving forward and inverse problems constrained by partial differential equations, where we interpolate neural networks onto finite element spaces to represent the (partial) unknowns. The framework…

Numerical Analysis · Mathematics 2023-10-11 Santiago Badia , Wei Li , Alberto F. Martín

Neural Implicit Representation (NIR) has recently gained significant attention due to its remarkable ability to encode complex and high-dimensional data into representation space and easily reconstruct it through a trainable mapping…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Haeyong Kang , Jaehong Yoon , DaHyun Kim , Sung Ju Hwang , Chang D Yoo

Ultrasound (US) image segmentation is an active research area that requires real-time and highly accurate analysis in many scenarios. The detect-to-segment (DTS) frameworks have been recently proposed to balance accuracy and efficiency.…

Image and Video Processing · Electrical Eng. & Systems 2023-08-29 Chaoyu Chen , Xin Yang , Rusi Chen , Junxuan Yu , Liwei Du , Jian Wang , Xindi Hu , Yan Cao , Yingying Liu , Dong Ni

Deep learning methods are emerging as popular computational tools for solving forward and inverse problems in traffic flow. In this paper, we study a neural operator framework for learning solutions to nonlinear hyperbolic partial…

Machine Learning · Computer Science 2024-06-26 Bilal Thonnam Thodi , Sai Venkata Ramana Ambadipudi , Saif Eddin Jabari

During the last decade, Neural Networks (NNs) have proved to be extremely effective tools in many fields of engineering, including autonomous vehicles, medical diagnosis and search engines, and even in art creation. Indeed, NNs often…

Machine Learning · Computer Science 2022-07-26 Dmitry Kuznichov

Efficiently modeling spatio-temporal (ST) physical processes and observations presents a challenging problem for the deep learning community. Many recent studies have concentrated on meticulously reconciling various advantages, leading to…

Artificial Intelligence · Computer Science 2024-06-04 Hao Wu , Yuxuan Liang , Wei Xiong , Zhengyang Zhou , Wei Huang , Shilong Wang , Kun Wang

In this paper, we propose a way to solve partial differential equations (PDEs) by combining machine learning techniques and the finite element method called Phi-FEM. For that, we use the Fourier Neural Operator (FNO), a learning mapping…

Numerical Analysis · Mathematics 2025-03-05 Michel Duprez , Vanessa Lleras , Alexei Lozinski , Vincent Vigon , Killian Vuillemot

We introduce the Laplace neural operator (LNO), which leverages the Laplace transform to decompose the input space. Unlike the Fourier Neural Operator (FNO), LNO can handle non-periodic signals, account for transient responses, and exhibit…

Machine Learning · Computer Science 2023-05-31 Qianying Cao , Somdatta Goswami , George Em Karniadakis

Over the past decade, Interferometric Synthetic Aperture Radar (InSAR) has become a successful remote sensing technique. However, during the acquisition step, microwave reflections received at satellite are usually disturbed by strong…

Image and Video Processing · Electrical Eng. & Systems 2020-05-28 Xinyao Sun , Aaron Zimmer , Subhayan Mukherjee , Navaneeth Kamballur Kottayil , Parwant Ghuman , Irene Cheng

Deep neural networks (NNs) are known to lack uncertainty estimates and struggle to incorporate new data. We present a method that mitigates these issues by converting NNs from weight space to function space, via a dual parameterization.…

Machine Learning · Statistics 2023-09-06 Aidan Scannell , Riccardo Mereu , Paul Chang , Ella Tamir , Joni Pajarinen , Arno Solin

We present an efficient solver for massively-parallel direct numerical simulations of incompressible turbulent flows. The method uses a second-order, finite-volume pressure-correction scheme, where the pressure Poisson equation is solved…

Fluid Dynamics · Physics 2019-09-13 Pedro Costa

The remarkable performance of deep neural networks (DNNs) currently makes them the method of choice for solving linear inverse problems. They have been applied to super-resolve and restore images, as well as to reconstruct MR and CT images.…

Image and Video Processing · Electrical Eng. & Systems 2021-06-01 Marija Vella , João F. C. Mota

Fourier ptychography is a recently developed imaging approach for large field-of-view and high-resolution microscopy. Here we model the Fourier ptychographic forward imaging process using a convolution neural network (CNN) and recover the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Shaowei Jiang , Kaikai Guo , Jun Liao , Guoan Zheng