English
Related papers

Related papers: The Deep Ritz method: A deep learning-based numeri…

200 papers

Solving partial differential equations in high dimensions by deep neural network has brought significant attentions in recent years. In many scenarios, the loss function is defined as an integral over a high-dimensional domain. Monte-Carlo…

Numerical Analysis · Mathematics 2019-11-06 Jingrun Chen , Rui Du , Panchi Li , Liyao Lyu

This study presents a two-level Deep Domain Decomposition Method (Deep-DDM) augmented with a coarse-level network for solving boundary value problems using physics-informed neural networks (PINNs). The addition of the coarse level network…

Machine Learning · Computer Science 2024-08-23 Victorita Dolean , Serge Gratton , Alexander Heinlein , Valentin Mercier

We introduce a numerical variational method based on the Rayleigh-Ritz optimization principle for predicting two-dimensional self-trapped beams in nonlinear media. This technique overcomes the limitation of the traditional variational…

Optics · Physics 2018-04-04 Erick I. Duque , Servando Lopez-Aguayo , Boris A. Malomed

We compare different training strategies for the Deep Ritz Method for elliptic equations with Dirichlet boundary conditions and highlight the problems arising from the boundary values. We distinguish between an exact resolution of the…

Numerical Analysis · Mathematics 2021-06-14 Luca Courte , Marius Zeinhofer

Stochastic gradient algorithms are the main focus of large-scale optimization problems and led to important successes in the recent advancement of the deep learning algorithms. The convergence of SGD depends on the careful choice of…

Machine Learning · Computer Science 2017-03-03 Caglar Gulcehre , Jose Sotelo , Marcin Moczulski , Yoshua Bengio

This article introduces the splitting method to systems responding to rough paths as external stimuli. The focus is on nonlinear partial differential equations with rough noise but we also cover rough differential equations. Applications to…

Probability · Mathematics 2010-08-04 Peter Friz , Harald Oberhauser

Multiscale and multiphysics problems need novel numerical methods in order for them to be solved correctly and predictively. To that end, we develop a wavelet based technique to solve a coupled system of nonlinear partial differential…

Numerical Analysis · Mathematics 2023-03-22 Cale Harnish , Luke Dalessandro , Karel Matous , Daniel Livescu

In this paper, we propose a method for computing eigenvalues of elliptic problems using Deep Learning techniques. A key feature of our approach is that it is independent of the space dimension and can compute arbitrary eigenvalues without…

Numerical Analysis · Mathematics 2026-03-04 Julian Fernandez Bonder , Ariel M. Salort

We establish a general convergence theory of the Rayleigh--Ritz method and the refined Rayleigh--Ritz method for computing some simple eigenpair $(\lambda_{*},x_{*})$ of a given analytic regular nonlinear eigenvalue problem (NEP). In terms…

Numerical Analysis · Mathematics 2026-05-14 Zhongxiao Jia , Qingqing Zheng

In this paper, we introduce the Deep Finite Volume Method (DFVM), an innovative deep learning framework tailored for solving high-order (order \(\geq 2\)) partial differential equations (PDEs). Our approach centers on a novel loss function…

Numerical Analysis · Mathematics 2024-07-15 Jianhuan Cen , Qingsong Zou

In recent years, data-driven methods have been developed to learn dynamical systems and partial differential equations (PDE). The goal of such work is discovering unknown physics and the corresponding equations. However, prior to achieving…

Machine Learning · Statistics 2021-02-17 Hao Xu , Haibin Chang , Dongxiao Zhang

Discrete gradient methods are well-known methods of Geometric Numerical Integration, which preserve the dissipation of gradient systems. The preservation of the dissipation of a system is an important feature in numerous image processing…

Numerical Analysis · Mathematics 2016-03-25 V Grimm , R I McLachlan , D McLaren , G R W Quispel , C-B Schönlieb

Deep learning is a powerful tool for solving nonlinear differential equations, but usually, only the solution corresponding to the flattest local minimizer can be found due to the implicit regularization of stochastic gradient descent. This…

Numerical Analysis · Mathematics 2021-03-17 Yiqi Gu , Chunmei Wang , Haizhao Yang

This paper aims at studying the difference between Ritz-Galerkin (R-G) method and deep neural network (DNN) method in solving partial differential equations (PDEs) to better understand deep learning. To this end, we consider solving a…

Numerical Analysis · Mathematics 2020-12-10 Jihong Wang , Zhi-Qin John Xu , Jiwei Zhang , Yaoyu Zhang

This paper presents machine learning techniques and deep reinforcement learningbased algorithms for the efficient resolution of nonlinear partial differential equations and dynamic optimization problems arising in investment decisions and…

Optimization and Control · Mathematics 2021-04-19 Maximilien Germain , Huyên Pham , Xavier Warin

This paper presents an a priori error analysis of the Deep Mixed Residual method (MIM) for solving high-order elliptic equations with non-homogeneous boundary conditions, including Dirichlet, Neumann, and Robin conditions. We examine MIM…

Numerical Analysis · Mathematics 2024-11-26 Mengjia Bai , Jingrun Chen , Rui Du , Zhiwei Sun

Distributionally robust optimization (DRO) problems are increasingly seen as a viable method to train machine learning models for improved model generalization. These min-max formulations, however, are more difficult to solve. We therefore…

Machine Learning · Statistics 2020-11-03 Soumyadip Ghosh , Mark Squillante , Ebisa Wollega

In this paper, we propose a stochastic search algorithm for solving general optimization problems with little structure. The algorithm iteratively finds high quality solutions by randomly sampling candidate solutions from a parameterized…

Optimization and Control · Mathematics 2013-01-08 Enlu Zhou , Jiaqiao Hu

In this paper, we propose a deep learning-based method, deep Euler method (DEM) to solve ordinary differential equations. DEM significantly improves the accuracy of the Euler method by approximating the local truncation error with deep…

Numerical Analysis · Mathematics 2020-03-24 Xing Shen , Xiaoliang Cheng , Kewei Liang

Deep Reinforcement Learning (DRL) methods often rely on the meticulous tuning of hyperparameters to successfully resolve problems. One of the most influential parameters in optimization procedures based on stochastic gradient descent (SGD)…

Machine Learning · Computer Science 2020-08-05 Ralf Gulde , Marc Tuscher , Akos Csiszar , Oliver Riedel , Alexander Verl