English
Related papers

Related papers: Computing Anti-Derivatives using Deep Neural Netwo…

200 papers

This work considers stochastic Galerkin approximations of linear elliptic partial differential equations (PDEs) with stochastic forcing terms and stochastic diffusion coefficients, that cannot be bounded uniformly away from zero and…

Numerical Analysis · Mathematics 2026-01-12 Fabio Musco , Andrea Barth

Recent research works for solving partial differential equations (PDEs) with deep neural networks (DNNs) have demonstrated that spatiotemporal function approximators defined by auto-differentiation are effective for approximating nonlinear…

Numerical Analysis · Mathematics 2021-09-21 Haoxiang Huang , Yingjie Liu , Vigor Yang

We propose derivative-informed neural operators (DINOs), a general family of neural networks to approximate operators as infinite-dimensional mappings from input function spaces to output function spaces or quantities of interest. After…

Numerical Analysis · Mathematics 2023-10-18 Thomas O'Leary-Roseberry , Peng Chen , Umberto Villa , Omar Ghattas

In this paper, authors shall introduce a finite element method by using a weakly defined gradient operator over discontinuous functions with heterogeneous properties. The use of weak gradients and their approximations results in a new…

Numerical Analysis · Mathematics 2012-11-14 Junping Wang , Xiu Ye

Numerically solving high-dimensional partial differential equations (PDEs) is a major challenge. Conventional methods, such as finite difference methods, are unable to solve high-dimensional PDEs due to the curse-of-dimensionality. A…

Numerical Analysis · Mathematics 2023-05-11 Deqing Jiang , Justin Sirignano , Samuel N. Cohen

It is often useful to perform integration over learned functions represented by neural networks. However, this integration is usually performed numerically, as analytical integration over learned functions (especially neural networks) is…

Machine Learning · Computer Science 2023-12-27 Ryan Kortvelesy

The Fourier transform is approximated over a finite domain using a Riemann sum. This Riemann sum is then expressed in terms of the discrete Fourier transform, which allows the sum to be computed with a fast Fourier transform algorithm more…

Numerical Analysis · Mathematics 2015-08-07 Jeremy Axelrod

In this work, we introduce a machine/deep learning methodology to solve parametric integrals. Besides classical machine learning approaches, we consider a differential learning framework that incorporates derivative information during…

Machine Learning · Computer Science 2025-12-15 Álvaro Leitao , Jonatan Ráfales

Inverse problems arise anywhere we have indirect measurement. As, in general they are ill-posed, to obtain satisfactory solutions for them needs prior knowledge. Classically, different regularization methods and Bayesian inference based…

Machine Learning · Statistics 2023-08-31 Ali Mohammad-Djafari , Ning Chu , Li Wang , Liang Yu

This paper introduces a new approach for the computation of electromagnetic field derivatives, up to any order, with respect to the material and geometric parameters of a given geometry, in a single Finite-Difference Time-Domain (FDTD)…

Numerical Analysis · Mathematics 2024-12-20 Kae-An Liu , Hans-Dieter Lang , Costas D. Sarris

In this paper, we propose a novel deep convolutional neural network (CNN)-based algorithm for solving ill-posed inverse problems. Regularized iterative algorithms have emerged as the standard approach to ill-posed inverse problems in the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Kyong Hwan Jin , Michael T. McCann , Emmanuel Froustey , Michael Unser

A new finite element method with discontinuous approximation is introduced for solving second order elliptic problem. Since this method combines the features of both conforming finite element method and discontinuous Galerkin (DG) method,…

Numerical Analysis · Mathematics 2019-04-09 Xiu Ye , Shangyou Zhang

Alternating Direction Method of Multipliers (ADMM) has been used successfully in many conventional machine learning applications and is considered to be a useful alternative to Stochastic Gradient Descent (SGD) as a deep learning optimizer.…

Optimization and Control · Mathematics 2021-07-07 Junxiang Wang , Fuxun Yu , Xiang Chen , Liang Zhao

To enhance solution accuracy and training efficiency in neural network approximation to partial differential equations, partitioned neural networks can be used as a solution surrogate instead of a single large and deep neural network…

Numerical Analysis · Mathematics 2023-08-17 Hee Jun Yang , Hyea Hyun Kim

Classic algorithms and machine learning systems like neural networks are both abundant in everyday life. While classic computer science algorithms are suitable for precise execution of exactly defined tasks such as finding the shortest path…

Machine Learning · Computer Science 2022-09-02 Felix Petersen

Automatic differentiation (AD) in reverse mode (RAD) is a central component of deep learning and other uses of large-scale optimization. Commonly used RAD algorithms such as backpropagation, however, are complex and stateful, hindering deep…

Programming Languages · Computer Science 2018-10-03 Conal Elliott

We focus on nonlinear Function-on-Scalar regression, where the predictors are scalar variables, and the responses are functional data. Most existing studies approximate the hidden nonlinear relationships using linear combinations of basis…

Methodology · Statistics 2025-04-01 Kazunori Takeshita , Yoshikazu Terada

Defect detection is a basic and essential task in automatic parts production, especially for automotive engine precision parts. In this paper, we propose a new idea to construct a deep convolutional network combining related knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Zhenshen Qu , Jianxiong Shen , Ruikun Li , Junyu Liu , Qiuyu Guan

In the desire to quantify the success of neural networks in deep learning and other applications, there is a great interest in understanding which functions are efficiently approximated by the outputs of neural networks. By now, there…

A deep learning approach to numerically approximate the solution to the Eikonal equation is introduced. The proposed method is built on the fast marching scheme which comprises of two components: a local numerical solver and an update…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Moshe Lichtenstein , Gautam Pai , Ron Kimmel