English
Related papers

Related papers: Generalization Error Guaranteed Auto-Encoder-Based…

200 papers

Neural operators (NOs) employ deep neural networks to learn mappings between infinite-dimensional function spaces. Deep operator network (DeepONet), a popular NO architecture, has demonstrated success in the real-time prediction of complex…

Machine Learning · Computer Science 2025-06-03 Sharmila Karumuri , Lori Graham-Brady , Somdatta Goswami

This study used a multigrid-based convolutional neural network architecture known as MgNet in operator learning to solve numerical partial differential equations (PDEs). Given the property of smoothing iterations in multigrid methods where…

Machine Learning · Computer Science 2023-02-03 Jianqing Zhu , Juncai He , Qiumei Huang

As an alternative to classical numerical solvers for partial differential equations (PDEs) subject to boundary value constraints, there has been a surge of interest in investigating neural networks that can solve such problems efficiently.…

Machine Learning · Computer Science 2023-08-21 Winfried Lötzsch , Simon Ohler , Johannes S. Otterbach

Operator learning aims to discover properties of an underlying dynamical system or partial differential equation (PDE) from data. Here, we present a step-by-step guide to operator learning. We explain the types of problems and PDEs amenable…

Numerical Analysis · Mathematics 2025-04-30 Nicolas Boullé , Alex Townsend

Image classification is a fundamental task in computer vision, and the quest to enhance DNN accuracy without inflating model size or latency remains a pressing concern. We make a couple of advances in this regard, leading to a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Hasanul Mahmud , Kevin Desai , Palden Lama , Sushil K. Prasad

A computed approximation of the solution operator to a system of partial differential equations (PDEs) is needed in various areas of science and engineering. Neural operators have been shown to be quite effective at predicting these…

Machine Learning · Computer Science 2024-12-02 Zan Ahmad , Shiyi Chen , Minglang Yin , Avisha Kumar , Nicolas Charon , Natalia Trayanova , Mauro Maggioni

Noise poses a challenge for learning dynamical-system models because already small variations can distort the dynamics described by trajectory data. This work builds on operator inference from scientific machine learning to infer…

Machine Learning · Computer Science 2021-07-27 Wayne Isaac Tan Uy , Yuepeng Wang , Yuxiao Wen , Benjamin Peherstorfer

Learning operators between infinitely dimensional spaces is an important learning task arising in wide applications in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric…

Machine Learning · Statistics 2022-01-04 Hao Liu , Haizhao Yang , Minshuo Chen , Tuo Zhao , Wenjing Liao

Deep learning (DL) has been applied extensively in many computational imaging problems, often leading to superior performance over traditional iterative approaches. However, two important questions remain largely unanswered: first, how well…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Mo Deng , Shuai Li , Iksung Kang , Nicholas X. Fang , George Barbastathis

Recently, operator learning, or learning mappings between infinite-dimensional function spaces, has garnered significant attention, notably in relation to learning partial differential equations from data. Conceptually clear when outlined…

We present a novel method for learning reduced-order models of dynamical systems using nonlinear manifolds. First, we learn the manifold by identifying nonlinear structure in the data through a general representation learning problem. The…

Numerical Analysis · Mathematics 2026-05-27 Rudy Geelen , Laura Balzano , Stephen Wright , Karen Willcox

Weather prediction is a quintessential problem involving the forecasting of a complex, nonlinear, and chaotic high-dimensional dynamical system. This work introduces an efficient reduced-order modeling (ROM) framework for short-range…

Machine Learning · Computer Science 2025-11-18 Amirpasha Hedayat , Karthik Duraisamy

Modeling 3D dynamics is a fundamental problem in multi-body systems across scientific and engineering domains and has important practical implications in object trajectory prediction and simulation. While recent GNN-based approaches have…

Machine Learning · Computer Science 2026-05-12 Kai Yang , Yuqi Huang , Junheng Tao , Wanyu Wang , Qitian Wu

In order to devise an anomaly detection model using only normal training data, an autoencoder (AE) is typically trained to reconstruct the data. As a result, the AE can extract normal representations in its latent space. During test time,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Marcella Astrid , Muhammad Zaigham Zaheer , Seung-Ik Lee

We propose a novel data-lean operator learning algorithm, the Reduced Basis Neural Operator (ReBaNO), to solve a group of PDEs with multiple distinct inputs. Inspired by the Reduced Basis Method and the recently introduced Generative…

Machine Learning · Computer Science 2025-09-12 Haolan Zheng , Yanlai Chen , Jiequn Han , Yue Yu

Neural Networks play a growing role in many science disciplines, including physics. Variational Autoencoders (VAEs) are neural networks that are able to represent the essential information of a high dimensional data set in a low dimensional…

Machine Learning · Statistics 2021-12-08 Johannes Zacherl , Philipp Frank , Torsten A. Enßlin

Principal component analysis, dictionary learning, and auto-encoders are all unsupervised methods for learning representations from a large amount of training data. In all these methods, the higher the dimensions of the input data, the…

Machine Learning · Computer Science 2019-08-27 Thomas Chang , Bahareh Tolooshams , Demba Ba

Supervised manifold learning methods learn data representations by preserving the geometric structure of data while enhancing the separation between data samples from different classes. In this work, we propose a theoretical study of…

Machine Learning · Computer Science 2018-01-08 Elif Vural , Christine Guillemot

Operator eigenvalue problems play a critical role in various scientific fields and engineering applications, yet numerical methods are hindered by the curse of dimensionality. Recent deep learning methods provide an efficient approach to…

Machine Learning · Computer Science 2025-10-29 Hong Wang , Jiang Yixuan , Jie Wang , Xinyi Li , Jian Luo , Huanshuo Dong

We developed a Nonlinear Level-set Learning (NLL) method for dimensionality reduction in high-dimensional function approximation with small data. This work is motivated by a variety of design tasks in real-world engineering applications,…

Functional Analysis · Mathematics 2019-06-20 Guannan Zhang , Jiaxin Zhang , Jacob Hinkle