English
Related papers

Related papers: LordNet: An Efficient Neural Network for Learning …

200 papers

Deep learning approaches for partial differential equations (PDEs) have received much attention in recent years due to their mesh-freeness and computational efficiency. However, most of the works so far have concentrated on time-dependent…

Machine Learning · Computer Science 2022-09-26 Son N. T. Tu , Thu Nguyen

Neural Networks accomplish amazing things, but they suffer from computational and memory bottlenecks that restrict their usage. Nowhere can this be better seen than in the mobile space, where specialized hardware is being created just to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Jon Hoffman

Deep Operator Networks (DeepOnets) have revolutionized the domain of scientific machine learning for the solution of the inverse problem for dynamical systems. However, their implementation necessitates optimizing a high-dimensional space…

Machine Learning · Computer Science 2024-11-05 Gianluca Fabiani , Ioannis G. Kevrekidis , Constantinos Siettos , Athanasios N. Yannacopoulos

Partial differential equations (PDEs) are often computationally challenging to solve, and in many settings many related PDEs must be be solved either at every timestep or for a variety of candidate boundary conditions, parameters, or…

Machine Learning · Computer Science 2022-11-04 Tian Qin , Alex Beatson , Deniz Oktay , Nick McGreivy , Ryan P. Adams

Deep models have achieved impressive progress in solving partial differential equations (PDEs). A burgeoning paradigm is learning neural operators to approximate the input-output mappings of PDEs. While previous deep models have explored…

Machine Learning · Computer Science 2023-05-30 Haixu Wu , Tengge Hu , Huakun Luo , Jianmin Wang , Mingsheng Long

Constructing fast numerical solvers for partial differential equations (PDEs) is crucial for many scientific disciplines. A leading technique for solving large-scale PDEs is using multigrid methods. At the core of a multigrid solver is the…

Numerical Analysis · Mathematics 2019-08-07 Daniel Greenfeld , Meirav Galun , Ron Kimmel , Irad Yavneh , Ronen Basri

When solving partial differential equations (PDEs), classical numerical methods often require fine mesh grids and small time stepping to meet stability, consistency, and convergence conditions, leading to high computational cost. Recently,…

We present a new data-driven reduced-order modeling approach to efficiently solve parametrized partial differential equations (PDEs) for many-query problems. This work is inspired by the concept of implicit neural representation (INR),…

Numerical Analysis · Mathematics 2023-11-30 Tianshu Wen , Kookjin Lee , Youngsoo Choi

We combine concepts from multilevel solvers for partial differential equations (PDEs) with neural network based deep learning and propose a new methodology for the efficient numerical solution of high-dimensional parametric PDEs. An…

Machine Learning · Computer Science 2023-04-05 Cosmas Heiß , Ingo Gühring , Martin Eigel

Scientific problems require resolving multi-scale phenomena across different resolutions and learning solution operators in infinite-dimensional function spaces. Neural operators provide a powerful framework for this, using…

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

The inverse problem of supervised reconstruction of depth-variable (time-dependent) parameters in a neural ordinary differential equation (NODE) is considered, that means finding the weights of a residual network with time continuous…

Machine Learning · Computer Science 2022-02-14 George Baravdish , Gabriel Eilertsen , Rym Jaroudi , B. Tomas Johansson , Lukáš Malý , Jonas Unger

Deep neural networks tend to underestimate uncertainty and produce overly confident predictions. Recently proposed solutions, such as MC Dropout and SDENet, require complex training and/or auxiliary out-of-distribution data. We propose a…

Machine Learning · Computer Science 2021-10-14 Akib Mashrur , Wei Luo , Nayyar A. Zaidi , Antonio Robles-Kelly

Neural networks have been applied to control problems, typically by combining data, differential equation residuals, and objective costs in the training loss or by incorporating auxiliary architectural components. Instead, we propose a…

Optimization and Control · Mathematics 2026-04-10 Oliver G. S. Lundqvist , Fabricio Oliveira

Stochastic partial differential equations (SPDEs) are ubiquitous in engineering and computational sciences. The stochasticity arises as a consequence of uncertainty in input parameters, constitutive relations, initial/boundary conditions,…

Data Analysis, Statistics and Probability · Physics 2020-01-29 Sharmila Karumuri , Rohit Tripathy , Ilias Bilionis , Jitesh Panchal

The problem of processing very long time-series data (e.g., a length of more than 10,000) is a long-standing research problem in machine learning. Recently, one breakthrough, called neural rough differential equations (NRDEs), has been…

Machine Learning · Computer Science 2022-04-20 Jaehoon Lee , Jinsung Jeon , Sheo yon Jhin , Jihyeon Hyeong , Jayoung Kim , Minju Jo , Kook Seungji , Noseong Park

In numerous contexts, high-resolution solutions to partial differential equations are required to capture faithfully essential dynamics which occur at small spatiotemporal scales, but these solutions can be very difficult and slow to obtain…

Machine Learning · Computer Science 2024-04-09 Valentin Duruisseaux , Amit Chakraborty

We propose a neural network-based meta-learning method to efficiently solve partial differential equation (PDE) problems. The proposed method is designed to meta-learn how to solve a wide variety of PDE problems, and uses the knowledge for…

Machine Learning · Statistics 2023-10-23 Tomoharu Iwata , Yusuke Tanaka , Naonori Ueda

Neural networks can be used to learn the solution of partial differential equations (PDEs) on arbitrary domains without requiring a computational mesh. Common approaches integrate differential operators in training neural networks using a…

Machine Learning · Computer Science 2022-07-07 Shamsulhaq Basir , Inanc Senocak

A novel multi-level method for partial differential equations with uncertain parameters is proposed. The principle behind the method is that the error between grid levels in multi-level methods has a spatial structure that is by good…

Numerical Analysis · Mathematics 2020-04-29 Yous van Halder , Benjamin Sanderse , Barry Koren