English
Related papers

Related papers: DeepMartNet -- A Martingale based Deep Neural Netw…

200 papers

Eigenvalue problems are fundamental to mathematics and science. We present a simple algorithm for determining eigenvalues and eigenfunctions of the Laplace--Beltrami operator on rather general curved surfaces. Our algorithm, which is based…

Numerical Analysis · Mathematics 2011-09-13 Colin B. Macdonald , Jeremy Brandman , Steven J. Ruuth

We address the approximation of entropy solutions to initial-boundary value problems for nonlinear strictly hyperbolic conservation laws using neural networks. A general and systematic framework is introduced for the design of efficient and…

Analysis of PDEs · Mathematics 2025-09-16 Igor Ciril , Khalil Haddaoui , Yohann Tendero

In many scientific and engineering problems, noise and nonlinearity are unavoidable, which could induce interesting mathematical problem such as transition phenomena. This paper focuses on efficiently discovering the most probable…

Optimization and Control · Mathematics 2023-06-08 Jin Guo , Ting Gao , Peng Zhang , Jiequn Han , Jinqiao Duan

A Neural Process (NP) estimates a stochastic process implicitly defined with neural networks given a stream of data, rather than pre-specifying priors already known, such as Gaussian processes. An ideal NP would learn everything from data…

Machine Learning · Computer Science 2023-04-20 Hyungi Lee , Eunggu Yun , Giung Nam , Edwin Fong , Juho Lee

Random backpropagation (RBP) is a variant of the backpropagation algorithm for training neural networks, where the transpose of the forward matrices are replaced by fixed random matrices in the calculation of the weight updates. It is…

Machine Learning · Computer Science 2017-12-25 Pierre Baldi , Peter Sadowski , Zhiqin Lu

We derive a new margin-based regularization formulation, termed multi-margin regularization (MMR), for deep neural networks (DNNs). The MMR is inspired by principles that were applied in margin analysis of shallow linear classifiers, e.g.,…

Machine Learning · Computer Science 2020-09-15 Berry Weinstein , Shai Fine , Yacov Hel-Or

In this paper, we formulate the deep residual network (ResNet) as a control problem of transport equation. In ResNet, the transport equation is solved along the characteristics. Based on this observation, deep neural network is closely…

Information Theory · Computer Science 2018-01-26 Zhen Li , Zuoqiang Shi

We develop an interpolation-based modeling framework for parameter-dependent partial differential equations arising in control, inverse problems, and uncertainty quantification. The solution is discretized in the physical domain using…

Numerical Analysis · Mathematics 2026-04-20 Erik Burman , Mats G. Larson , Karl Larsson , Jonatan Vallin

In recent years, neural networks have achieved remarkable progress in various fields and have also drawn much attention in applying them on scientific problems. A line of methods involving neural networks for solving partial differential…

Numerical Analysis · Mathematics 2025-05-20 Xianliang Xu , Ye Li , Zhongyi Huang

This paper studies deep neural networks for solving extremely large linear systems arising from highdimensional problems. Because of the curse of dimensionality, it is expensive to store both the solution and right-hand side vector in such…

Numerical Analysis · Mathematics 2023-03-07 Yiqi Gu , Michael K. Ng

We propose a new method to solve eigenvalue problems for linear and semilinear second order differential operators in high dimensions based on deep neural networks. The eigenvalue problem is reformulated as a fixed point problem of the…

Machine Learning · Computer Science 2020-10-28 Jiequn Han , Jianfeng Lu , Mo Zhou

A local and parallel algorithm based on the multilevel discretization is proposed in this paper to solve the eigenvalue problem by the finite element method. With this new scheme, solving the eigenvalue problem in the finest grid is…

Numerical Analysis · Mathematics 2014-01-21 Yu Li , Xiaole Han , Hehu Xie , Chunguang You

Physics-informed neural networks and Physics-informed DeepONet excel in solving partial differential equations; however, they often fail to converge for singularly perturbed problems. To address this, we propose two novel frameworks,…

Machine Learning · Computer Science 2026-04-06 Tiantian Sun , Jian Zu

In this paper, we study numerical approximations for optimal control of a class of stochastic partial differential equations with partial observations. The system state evolves in a Hilbert space, whereas observations are given in…

Optimization and Control · Mathematics 2025-04-02 Feng Bao , Yanzhao Cao , Hongjiang Qian

We consider the fractional elliptic problem with Dirichlet boundary conditions on a bounded and convex domain $D$ of $\mathbb{R}^d$, with $d \geq 2$. In this paper, we perform a stochastic gradient descent algorithm that approximates the…

Analysis of PDEs · Mathematics 2023-09-01 Nicolás Valenzuela

Stochastic control problems with delay are challenging due to the path-dependent feature of the system and thus its intrinsic high dimensions. In this paper, we propose and systematically study deep neural networks-based algorithms to solve…

Optimization and Control · Mathematics 2021-06-18 Jiequn Han , Ruimeng Hu

We propose a numerical method for solving the multi-marginal Monge problem, which extends the classical Monge formulation to settings involving multiple target distributions. Our approach is based on the Hilbert space embedding of…

Optimization and Control · Mathematics 2025-07-15 Yumiharu Nakano , Takafumi Saito

In this work, we develop an efficient solver based on neural networks for second-order elliptic equations with variable coefficients and singular sources. This class of problems covers general point sources, line sources and the combination…

Numerical Analysis · Mathematics 2023-04-18 Tianhao Hu , Bangti Jin , Zhi Zhou

The method is proposed for the study of many-point boundary value problems for systems of nonlinear ODE, by reducing them to special equivalent integral equations, and allows us [in contrast with the known method [1]] to consider boundary…

Classical Analysis and ODEs · Mathematics 2012-05-11 Yu. A. Konyaev

Recently proposed numerical algorithms for solving high-dimensional nonlinear partial differential equations (PDEs) based on neural networks have shown their remarkable performance. We review some of them and study their convergence…

Analysis of PDEs · Mathematics 2021-09-17 Maximilien Germain , Huyen Pham , Xavier Warin