English
Related papers

Related papers: Adaptive Neural Network Subspace Method for Solvin…

200 papers

A new gradient-based adaptive sampling method is proposed for design of experiments applications which balances space filling, local refinement, and error minimization objectives while reducing reliance on delicate tuning parameters. High…

Methodology · Statistics 2024-05-09 Lucas Caparini , Gwynn J. Elfring , Mauricio Ponga

A multilevel adaptive refinement strategy for solving linear elliptic partial differential equations with random data is recalled in this work. The strategy extends the a posteriori error estimation framework introduced by Guignard and…

Numerical Analysis · Mathematics 2022-02-21 Alex Bespalov , David J. Silvester

Designing an optimal deep neural network for a given task is important and challenging in many machine learning applications. To address this issue, we introduce a self-adaptive algorithm: the adaptive network enhancement (ANE) method,…

Numerical Analysis · Mathematics 2022-03-02 Zhiqiang Cai , Jingshuang Chen , Min Liu

We present a method to solve initial and boundary value problems using artificial neural networks. A trial solution of the differential equation is written as a sum of two parts. The first part satisfies the boundary (or initial) conditions…

Computational Physics · Physics 2016-11-15 I. E. Lagaris , A. Likas , D. I. Fotiadis

In this paper, we present a deep learning-based numerical method for approximating high dimensional stochastic partial differential equations (SPDEs). At each time step, our method relies on a predictor-corrector procedure. More precisely,…

Numerical Analysis · Mathematics 2022-09-13 He Zhang , Ran Zhang , Tao Zhou

A novel multi-level method for partial differential equations with uncertain parameters is proposed. The principle behind the method is that the error between grid levels in multi-level methods has a spatial structure that is by good…

Numerical Analysis · Mathematics 2020-04-29 Yous van Halder , Benjamin Sanderse , Barry Koren

The paper is concerned with the adaptive finite element solution of linear elliptic differential equations using equidistributing meshes. A strategy is developed for defining this type of mesh based on residual-based a posteriori error…

Numerical Analysis · Mathematics 2020-04-20 Yinnian He , Weizhang Huang

In this paper, we develop a new optimization framework for the least squares learning problem via fully connected neural networks or physics-informed neural networks. The gradient descent sometimes behaves inefficiently in deep learning…

Machine Learning · Computer Science 2025-05-01 Yaru Liu , Yiqi Gu , Michael K. Ng

Many applications in machine learning or signal processing involve nonsmooth optimization problems. This nonsmoothness brings a low-dimensional structure to the optimal solutions. In this paper, we propose a randomized proximal gradient…

Optimization and Control · Mathematics 2020-04-29 Dmitry Grishchenko , Franck Iutzeler , Jérôme Malick

In this work we propose a deep adaptive sampling (DAS) method for solving partial differential equations (PDEs), where deep neural networks are utilized to approximate the solutions of PDEs and deep generative models are employed to…

Numerical Analysis · Mathematics 2022-07-06 Kejun Tang , Xiaoliang Wan , Chao Yang

At present, deep learning based methods are being employed to resolve the computational challenges of high-dimensional partial differential equations (PDEs). But the computation of the high order derivatives of neural networks is costly,…

Numerical Analysis · Mathematics 2021-03-17 Quanhui Zhu , Jiang Yang

It is one of the most challenging problems in applied mathematics to approximatively solve high-dimensional partial differential equations (PDEs). Recently, several deep learning-based approximation algorithms for attacking this problem…

Numerical Analysis · Mathematics 2023-02-10 Christian Beck , Martin Hutzenthaler , Arnulf Jentzen , Benno Kuckuck

In this paper, we propose a new optimization framework, the layer separation (LySep) model, to improve the deep learning-based methods in solving partial differential equations. Due to the highly non-convex nature of the loss function in…

Machine Learning · Computer Science 2025-07-18 Yaru Liu , Yiqi Gu

The numerical methods for differential equation solution allow obtaining a discrete field that converges towards the solution if the method is applied to the correct problem. Nevertheless, the numerical methods have the restricted class of…

Numerical Analysis · Mathematics 2023-07-03 Alexander Hvatov , Tatiana Tikhonova

We introduce a new numerical method based on machine learning to approximate the solution of elliptic partial differential equations with collocation using a set of sigmoidal functions. We show that a feedforward neural network with a…

Numerical Analysis · Mathematics 2023-03-24 Francesco Calabrò , Gianluca Fabiani , Constantinos Siettos

This paper proposes an Adaptive Basis-inspired Deep Neural Network (ABI-DNN) for solving partial differential equations with localized phenomena such as sharp gradients and singularities. Like the adaptive finite element method, ABI-DNN…

Numerical Analysis · Mathematics 2024-12-03 Ke Li , Yaqin Zhang , Yunqing Huang , Chenyue Xie , Xueshuang Xiang

The accuracy and effectiveness of Hermite spectral methods for the numerical discretization of partial differential equations on unbounded domains, are strongly affected by the amplitude of the Gaussian weight function employed to describe…

Numerical Analysis · Mathematics 2021-04-07 Lorella Fatone , Daniele Funaro , Gianmarco Manzini

We derive aposteriori error estimates for fully discrete approximations to solutions of linear parabolic equations on the space-time domain. The space discretization uses finite element spaces, that are allowed to change in time. Our main…

Numerical Analysis · Mathematics 2024-12-10 Omar Lakkis , Charalambos Makridakis

A new concept is introduced for the adaptive finite element discretization of partial differential equations that have a sparsely representable solution. Motivated by recent work on compressed sensing, a recursive mesh refinement procedure…

Numerical Analysis · Mathematics 2009-02-26 Sadegh Jokar , Volker Mehrmann , Marc Pfetsch , Harry Yserentant

We present a novel method for using Neural Networks (NNs) for finding solutions to a class of Partial Differential Equations (PDEs). Our method builds on recent advances in Neural Radiance Field research (NeRFs) and allows for a NN to…

Machine Learning · Computer Science 2022-05-31 Jaroslaw Rzepecki , Daniel Bates , Chris Doran