English
Related papers

Related papers: Light-Weight Diffusion Multiplier and Uncertainty …

200 papers

In solving partial differential equations (PDEs), Fourier Neural Operators (FNOs) have exhibited notable effectiveness. However, FNO is observed to be ineffective with large Fourier kernels that parameterize more frequencies. Current…

Machine Learning · Computer Science 2024-10-10 Shaoxiang Qin , Fuyuan Lyu , Wenhui Peng , Dingyang Geng , Ju Wang , Xing Tang , Sylvie Leroyer , Naiping Gao , Xue Liu , Liangzhu Leon Wang

Fourier Neural Operators are deep learning models that learn mappings between function spaces and can be used to learn and solve partial differential equations (PDEs), in some cases significantly faster than traditional PDE solvers. Within…

Machine Learning · Computer Science 2026-05-05 Michael F. Staddon

The proliferation of deep learning accelerators calls for efficient and cost-effective hardware design solutions, where parameterized modular hardware generator and electronic design automation (EDA) tools play crucial roles in improving…

Hardware Architecture · Computer Science 2025-04-01 Yi Ren , Chenhao Xue , Jiaxing Zhang , Chen Zhang , Qiang Xu , Yibo Lin , Lining Zhang , Guangyu Sun

Fourier neural operators (FNOs) can learn highly nonlinear mappings between function spaces, and have recently become a popular tool for learning responses of complex physical systems. However, to achieve good accuracy and efficiency, FNOs…

Machine Learning · Computer Science 2023-10-31 Ning Liu , Siavash Jafarzadeh , Yue Yu

Existing work in scientific machine learning (SciML) has shown that data-driven learning of solution operators can provide a fast approximate alternative to classical numerical partial differential equation (PDE) solvers. Of these, Neural…

Machine Learning · Computer Science 2024-06-13 S. Chandra Mouli , Danielle C. Maddix , Shima Alizadeh , Gaurav Gupta , Andrew Stuart , Michael W. Mahoney , Yuyang Wang

Time-periodic quantum systems exhibit a rich variety of far-from-equilibrium phenomena and serve as ideal platforms for quantum engineering and control. However, simulating their dynamics with conventional numerical methods remains…

Quantum Physics · Physics 2025-09-10 Zihao Qi , Yang Peng , Christopher Earls

Extrapolation remains a grand challenge in deep neural networks across all application domains. We propose an operator learning method to solve time-dependent partial differential equations (PDEs) continuously and with extrapolation in time…

Machine Learning · Computer Science 2023-12-12 Oded Ovadia , Vivek Oommen , Adar Kahana , Ahmad Peyvan , Eli Turkel , George Em Karniadakis

Density functional theory (DFT) is a cornerstone of computational chemistry and materials science, but its computational cost limits its use in large-scale and high-throughput applications. While machine learning has accelerated energy…

Chemical Physics · Physics 2026-03-18 Yingdi Jin , Xinming Qin , Ruichen Liu , Jie Liu , Zhenyu Li , Jinlong Yang

Diffusion models have achieved cutting-edge performance in image generation. However, their lengthy denoising process and computationally intensive score estimation network impede their scalability in low-latency and resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Qian Zeng , Jie Song , Han Zheng , Hao Jiang , Mingli Song

High-fidelity direct numerical simulation of turbulent flows for most real-world applications remains an outstanding computational challenge. Several machine learning approaches have recently been proposed to alleviate the computational…

This paper introduces a data-driven operator learning method for multiscale partial differential equations, with a particular emphasis on preserving high-frequency information. Drawing inspiration from the representation of multiscale…

Machine Learning · Computer Science 2024-08-05 Bo Xu , Xinliang Liu , Lei Zhang

The hybrid neural differentiable models mark a significant advancement in the field of scientific machine learning. These models, integrating numerical representations of known physics into deep neural networks, offer enhanced predictive…

Machine Learning · Computer Science 2024-01-02 Deepak Akhare , Tengfei Luo , Jian-Xun Wang

Operator learning is a variant of machine learning that is designed to approximate maps between function spaces from data. The Fourier Neural Operator (FNO) is one of the main model architectures used for operator learning. The FNO combines…

Numerical Analysis · Mathematics 2025-09-29 Samuel Lanthaler , Andrew M. Stuart , Margaret Trautner

The removal of multiplicative Gamma noise is a critical research area in the application of synthetic aperture radar (SAR) imaging, where neural networks serve as a potent tool. However, real-world data often diverges from theoretical…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yi Ran , Zhichang Guo , Jia Li , Yao Li , Martin Burger , Boying Wu

Diffusion models have found widespread adoption in various areas. However, their sampling process is slow because it requires hundreds to thousands of network evaluations to emulate a continuous process defined by differential equations. In…

Machine Learning · Computer Science 2023-07-25 Hongkai Zheng , Weili Nie , Arash Vahdat , Kamyar Azizzadenesheli , Anima Anandkumar

In this paper we investigate the use of Fourier Neural Operators (FNOs) for image classification in comparison to standard Convolutional Neural Networks (CNNs). Neural operators are a discretization-invariant generalization of neural…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Samira Kabri , Tim Roith , Daniel Tenbrinck , Martin Burger

Neural operators aim to approximate the solution operator of a system of differential equations purely from data. They have shown immense success in modeling complex dynamical systems across various domains. However, the occurrence of…

Machine Learning · Computer Science 2025-04-01 Christopher Bülte , Philipp Scholl , Gitta Kutyniok

Fourier Neural Operators (FNOs) have proven to be an efficient and effective method for resolution-independent operator learning in a broad variety of application areas across scientific machine learning. A key reason for their success is…

This paper introduces an operator-based neural network, the mirror-padded Fourier neural operator (MFNO), designed to learn the dynamics of stochastic systems. MFNO extends the standard Fourier neural operator (FNO) by incorporating mirror…

Machine Learning · Computer Science 2025-07-25 Wonjae Lee , Taeyoung Kim , Hyungbin Park

Diffusion tensor imaging (DTI) holds significant importance in clinical diagnosis and neuroscience research. However, conventional model-based fitting methods often suffer from sensitivity to noise, leading to decreased accuracy in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Jialong Li , Zhicheng Zhang , Yunwei Chen , Qiqi Lu , Ye Wu , Xiaoming Liu , QianJin Feng , Yanqiu Feng , Xinyuan Zhang