English
Related papers

Related papers: Equivariant U-Shaped Neural Operators for the Cahn…

200 papers

Recurrent neural networks (RNNs) sequentially process data by updating their state with each new data point, and have long been the de facto choice for sequence modeling tasks. However, their inherently sequential computation makes them…

Computation and Language · Computer Science 2019-03-06 Mostafa Dehghani , Stephan Gouws , Oriol Vinyals , Jakob Uszkoreit , Łukasz Kaiser

Unrolled neural networks have enabled state-of-the-art reconstruction performance and fast inference times for the accelerated magnetic resonance imaging (MRI) reconstruction task. However, these approaches depend on fully-sampled scans as…

Image and Video Processing · Electrical Eng. & Systems 2022-04-25 Beliz Gunel , Arda Sahiner , Arjun D. Desai , Akshay S. Chaudhari , Shreyas Vasanawala , Mert Pilanci , John Pauly

Convolutional Neural Networks (CNNs) are the current de-facto models used for many imaging tasks due to their high learning capacity as well as their architectural qualities. The ubiquitous UNet architecture provides an efficient and…

Image and Video Processing · Electrical Eng. & Systems 2020-09-30 Demetris Marnerides , Thomas Bashford-Rogers , Kurt Debattista

This paper introduces a generative model equivariant to Euclidean symmetries: E(n) Equivariant Normalizing Flows (E-NFs). To construct E-NFs, we take the discriminative E(n) graph neural networks and integrate them as a differential…

Machine Learning · Computer Science 2022-01-17 Victor Garcia Satorras , Emiel Hoogeboom , Fabian B. Fuchs , Ingmar Posner , Max Welling

It is desirable for statistical models to detect signals of interest independently of their position. If the data is generated by some smooth process, this additional structure should be taken into account. We introduce a new class of…

Machine Learning · Computer Science 2023-08-11 Florian Heinrichs , Mavin Heim , Corinna Weber

Neural operators have been explored as surrogate models for simulating physical systems to overcome the limitations of traditional partial differential equation (PDE) solvers. However, most existing operator learning methods assume that the…

Machine Learning · Computer Science 2024-02-13 Rui Zhang , Qi Meng , Zhi-Ming Ma

Magnetohydrodynamics (MHD) plays a pivotal role in describing the dynamics of plasma and conductive fluids, essential for understanding phenomena such as the structure and evolution of stars and galaxies, and in nuclear fusion for plasma…

Computational Physics · Physics 2024-10-11 Taeyoung Kim , Youngsoo Ha , Myungjoo Kang

Neural operators learn mappings between function spaces, which is practical for learning solution operators of PDEs and other scientific modeling applications. Among them, the Fourier neural operator (FNO) is a popular architecture that…

Machine Learning · Computer Science 2024-06-11 Miguel Liu-Schiaffini , Julius Berner , Boris Bonev , Thorsten Kurth , Kamyar Azizzadenesheli , Anima Anandkumar

Equivariant Graph Neural Networks (eGNNs) trained on density-functional theory (DFT) data can potentially perform electronic structure prediction at unprecedented scales, enabling investigation of the electronic properties of materials with…

Machine Learning · Computer Science 2025-07-08 Manasa Kaniselvan , Alexander Maeder , Chen Hao Xia , Alexandros Nikolaos Ziogas , Mathieu Luisier

In recent times, the field of unsupervised representation learning (URL) for time series data has garnered significant interest due to its remarkable adaptability across diverse downstream applications. Unsupervised learning goals differ…

Machine Learning · Computer Science 2025-05-12 Chen Liang , Donghua Yang , Zhiyu Liang , Hongzhi Wang , Zheng Liang , Xiyang Zhang , Jianfeng Huang

Neural networks that are equivariant to rotations, translations, reflections, and permutations on n-dimensional geometric space have shown promise in physical modeling for tasks such as accurately but inexpensively modeling complex…

Machine Learning · Computer Science 2023-01-25 Yuanqing Wang , John D. Chodera

Metasurfaces, typically realized as arrays of nanopillars, transform electromagnetic (EM) fields depending on their geometry and spatial arrangement. For solving the inverse problem of designing new metasurfaces that transform EM fields in…

In this paper, we propose a phase shift deep neural network (PhaseDNN), which provides a uniform wideband convergence in approximating high frequency functions and solutions of wave equations. The PhaseDNN makes use of the fact that common…

Machine Learning · Computer Science 2019-12-17 Wei Cai , Xiaoguang Li , Lizuo Liu

In this paper, we propose physics-informed neural operators (PINO) that combine training data and physics constraints to learn the solution operator of a given family of parametric Partial Differential Equations (PDE). PINO is the first…

Predicting response of materials to external stimuli is a primary objective of computational materials science. However, current methods are limited to small-scale simulations due to the unfavorable scaling of computational costs. Here, we…

Neural operators serve as fast, data-driven surrogates for scientific modeling but typically rely on a monolithic, single-pass inference procedure that struggles to resolve high-frequency details, a limitation known as spectral bias. We…

Machine Learning · Computer Science 2026-05-27 Xiaotian Liu , Shuyuan Shang , Xiaopeng Wang , Pu Ren , Yaoqing Yang

Under spatially-coherent light, a diffractive optical network composed of structured surfaces can be designed to perform any arbitrary complex-valued linear transformation between its input and output fields-of-view (FOVs) if the total…

Optics · Physics 2023-08-17 Md Sadman Sakib Rahman , Xilin Yang , Jingxi Li , Bijie Bai , Aydogan Ozcan

Surrogate modeling of wave propagation and scattering (i.e. the wave speed and source to wave field map) in heterogeneous media has significant potential in applications such as seismic imaging and inversion. High-contrast settings, such as…

Signal Processing · Electrical Eng. & Systems 2026-02-13 Advait Balaji , Trevor Teolis , S. David Mis , Jose Antonio Lara Benitez , Chao Wang , Maarten V. de Hoop

We propose the Factorized Fourier Neural Operator (F-FNO), a learning-based approach for simulating partial differential equations (PDEs). Starting from a recently proposed Fourier representation of flow fields, the F-FNO bridges the…

Machine Learning · Computer Science 2023-03-03 Alasdair Tran , Alexander Mathews , Lexing Xie , Cheng Soon Ong

Neural operators are becoming the default tools to learn solutions to governing partial differential equations (PDEs) in weather and ocean forecasting applications. Despite early promising achievements, significant challenges remain,…

Machine Learning · Computer Science 2025-10-14 Vahidreza Jahanmard , Ali Ramezani-Kebrya , Robinson Hordoir