English
Related papers

Related papers: LordNet: An Efficient Neural Network for Learning …

200 papers

The multiscale complexity of modern problems in computational science and engineering can prohibit the use of traditional numerical methods in multi-dimensional simulations. Therefore, novel algorithms are required in these situations to…

Numerical Analysis · Mathematics 2021-06-15 Cale Harnish , Luke Dalessandro , Karel Matous , Daniel Livescu

Solving partial differential equations (PDE) is an indispensable part of many branches of science as many processes can be modelled in terms of PDEs. However, recent numerical solvers require manual discretization of the underlying equation…

This paper is concerned with the approximation of the solution of partial differential equations by means of artificial neural networks. Here a feedforward neural network is used to approximate the solution of the partial differential…

Numerical Analysis · Mathematics 2019-04-10 Henri Calandra , Serge Gratton , Elisa Riccietti , Xavier Vasseur

Classical numerical methods for solving partial differential equations suffer from the curse dimensionality mainly due to their reliance on meticulously generated spatio-temporal grids. Inspired by modern deep learning based techniques for…

Machine Learning · Statistics 2018-04-20 Maziar Raissi

In this paper, we introduce a tensor neural network based machine learning method for solving the elliptic partial differential equations with random coefficients in a bounded physical domain. With the help of tensor product structure, we…

Numerical Analysis · Mathematics 2024-02-02 Hongtao Chen , Rui Fu , Yifan Wang , Hehu Xie

The fast adaptation capability of deep neural networks in non-stationary environments is critical for online time series forecasting. Successful solutions require handling changes to new and recurring patterns. However, training deep neural…

Machine Learning · Computer Science 2022-10-18 Quang Pham , Chenghao Liu , Doyen Sahoo , Steven C. H. Hoi

Scaling deep neural networks (NN) of reinforcement learning (RL) algorithms has been shown to enhance performance when feature extraction networks are used but the gained performance comes at the significant expense of increased…

Machine Learning · Computer Science 2025-07-17 Valentin Frank Ingmar Guenter , Athanasios Sideris

Recent advances in geometric deep-learning introduce complex computational challenges for evaluating the distance between meshes. From a mesh model, point clouds are necessary along with a robust distance metric to assess surface quality or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Léo Lebrat , Rodrigo Santa Cruz , Clinton Fookes , Olivier Salvado

Deep learning has emerged as a compelling framework for scientific and engineering computing, motivating growing interest in neural network-based solvers for partial differential equations (PDEs). Within this landscape, network…

Numerical Analysis · Mathematics 2026-04-06 Tao Cheng , Lili Ju , Zhonghua Qiao , Xiaoping Zhang

We consider using deep neural networks to solve time-dependent partial differential equations (PDEs), where multi-scale processing is crucial for modeling complex, time-evolving dynamics. While the U-Net architecture with skip connections…

Machine Learning · Computer Science 2024-03-29 Xuan Zhang , Jacob Helwig , Yuchao Lin , Yaochen Xie , Cong Fu , Stephan Wojtowytsch , Shuiwang Ji

A burgeoning line of research leverages deep neural networks to approximate the solutions to high dimensional PDEs, opening lines of theoretical inquiry focused on explaining how it is that these models appear to evade the curse of…

Machine Learning · Computer Science 2023-03-28 Tanya Marwah , Zachary C. Lipton , Jianfeng Lu , Andrej Risteski

Scientific Machine Learning (ML) is gaining momentum as a cost-effective alternative to physics-based numerical solvers in many engineering applications. In fact, scientific ML is currently being used to build accurate and efficient…

Machine Learning · Computer Science 2024-08-20 Matteo Salvador , Alison L. Marsden

The primary goal of this research is to propose a novel architecture for a deep neural network that can solve fractional differential equations accurately. A Gaussian integration rule and a $L_1$ discretization technique are used in the…

Machine Learning · Computer Science 2023-09-15 Ali Nosrati Firoozsalari , Hassan Dana Mazraeh , Alireza Afzal Aghaei , Kourosh Parand

The deep operator networks (DeepONet), a class of neural operators that learn mappings between function spaces, have recently been developed as surrogate models for parametric partial differential equations (PDEs). In this work we propose a…

Machine Learning · Computer Science 2024-10-31 Yuan Qiu , Nolan Bridges , Peng Chen

Deep operator networks (DeepONets, DONs) offer a distinct advantage over traditional neural networks in their ability to be trained on multi-resolution data. This property becomes especially relevant in real-world scenarios where…

Machine Learning · Computer Science 2023-10-05 Katarzyna Michałowska , Somdatta Goswami , George Em Karniadakis , Signe Riemer-Sørensen

In the past years, the application of neural networks as an alternative to classical numerical methods to solve Partial Differential Equations has emerged as a potential paradigm shift in this century-old mathematical field. However, in…

Machine Learning · Computer Science 2023-08-16 Winfried van den Dool , Tijmen Blankevoort , Max Welling , Yuki M. Asano

Nonlinear regression problem is one of the most popular and important statistical tasks. The first methods like least squares estimation go back to Gauss and Legendre. Recent models and developments in statistics and machine learning like…

Statistics Theory · Mathematics 2025-02-20 Vladimir Spokoiny

Spatiotemporal partial differential equations (PDEs) underpin a wide range of scientific and engineering applications. Neural PDE solvers offer a promising alternative to classical numerical methods. However, existing approaches typically…

Machine Learning · Computer Science 2026-03-03 Yingjie Tan , Quanming Yao , Yaqing Wang

Many physical processes in science and engineering are naturally represented by operators between infinite-dimensional function spaces. The problem of operator learning, in this context, seeks to extract these physical processes from…

Machine Learning · Computer Science 2024-01-22 Hao Liu , Biraj Dahal , Rongjie Lai , Wenjing Liao

Incorporating prior knowledge or specifications of input-output relationships into machine learning models has attracted significant attention, as it enhances generalization from limited data and yields conforming outputs. However, most…

Machine Learning · Computer Science 2025-10-21 Youngjae Min , Navid Azizan