English
Related papers

Related papers: Accurate adaptive deep learning method for solving…

200 papers

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

In this paper, a shape optimization problem constrained by a random elliptic partial differential equation with a pure Neumann boundary is presented. The model is motivated by applications in interface identification, where we assume…

Optimization and Control · Mathematics 2020-02-04 Caroline Geiersbach , Estefania Loayza , Kathrin Welker

Elliptic partial differential equations (PDEs) with discontinuous diffusion coefficients occur in application domains such as diffusions through porous media, electro-magnetic field propagation on heterogeneous media, and diffusion…

Numerical Analysis · Mathematics 2015-01-20 Andrea Bonito , Ronald A. DeVore , Ricardo H. Nochetto

The transferable neural network (TransNet) is a two-layer shallow neural network with pre-determined and uniformly distributed neurons in the hidden layer, and the least-squares solvers can be particularly used to compute the parameters of…

Numerical Analysis · Mathematics 2025-02-28 Tianzheng Lu , Lili Ju , Liyong Zhu

This paper proposes an efficient adaptive variant of a quadratic penalty accelerated inexact proximal point (QP-AIPP) method proposed earlier by the authors. Both the QP-AIPP method and its variant solve linearly set constrained nonconvex…

Optimization and Control · Mathematics 2019-12-09 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

In this work, we propose a learning method for solving the linear transport equation under the diffusive scaling. Due to the multiscale nature of our model equation, the model is challenging to solve by using conventional methods. We employ…

Numerical Analysis · Mathematics 2021-02-25 Liu Liu , Tieyong Zeng , Zecheng Zhang

Elliptic partial differential equations are important both from application and analysis points of views. In this paper we apply the Closest Point Method to solving elliptic equations on general curved surfaces. Based on the closest point…

Numerical Analysis · Mathematics 2014-10-28 Yujia Chen , Colin B. Macdonald

While multilevel Monte Carlo (MLMC) methods for the numerical approximation of partial differential equations with random coefficients enjoy great popularity, combinations with spatial adaptivity seem to be rare. We present an adaptive MLMC…

Numerical Analysis · Mathematics 2017-12-20 Ralf Kornhuber , Evgenia Youett

We introduce a generalized finite difference method for solving a large range of fully nonlinear elliptic partial differential equations in three dimensions. Methods are based on Cartesian grids, augmented by additional points carefully…

Numerical Analysis · Mathematics 2021-03-19 Brittany Froese Hamfeldt , Jacob Lesniewski

This paper is concerned with a novel deep learning method for variational problems with essential boundary conditions. To this end, we first reformulate the original problem into a minimax problem corresponding to a feasible augmented…

Numerical Analysis · Mathematics 2022-05-10 Jianguo Huang , Haoqin Wang , Tao Zhou

In the context of unfitted finite element discretizations the realization of high order methods is challenging due to the fact that the geometry approximation has to be sufficiently accurate. We consider a new unfitted finite element method…

Numerical Analysis · Mathematics 2017-06-27 Christoph Lehrenfeld , Arnold Reusken

The paper is concerned with the adaptive finite element solution of linear elliptic differential equations using equidistributing meshes. A strategy is developed for defining this type of mesh based on residual-based a posteriori error…

Numerical Analysis · Mathematics 2020-04-20 Yinnian He , Weizhang Huang

We develop a novel deep learning technique, termed Deep Orthogonal Decomposition (DOD), for dimensionality reduction and reduced order modeling of parameter dependent partial differential equations. The approach consists in the construction…

Numerical Analysis · Mathematics 2024-05-15 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino , Jan S. Hesthaven

We propose an adaptive finite element algorithm to approximate solutions of elliptic problems whose forcing data is locally defined and is approximated by regularization (or mollification). We show that the energy error decay is…

Numerical Analysis · Mathematics 2022-07-26 Luca Heltai , Wenyu Lei

Developing algorithms for solving high-dimensional partial differential equations (PDEs) has been an exceedingly difficult task for a long time, due to the notoriously difficult problem known as the "curse of dimensionality". This paper…

Numerical Analysis · Mathematics 2020-07-17 Jiequn Han , Arnulf Jentzen , Weinan E

We propose and analyze a numerical method to solve an elliptic transmission problem in full space. The method consists of a variational formulation involving standard boundary integral operators on the coupling interface and an ultra-weak…

Numerical Analysis · Mathematics 2014-12-16 Norbert Heuer , Michael Karkulik

In this paper we present an algebraic dimension-oblivious two-level domain decomposition solver for discretizations of elliptic partial differential equations. The proposed parallel solver is based on a space-filling curve partitioning…

Numerical Analysis · Mathematics 2026-05-01 Michael Griebel , Marc Alexander Schweitzer , Lukas Troska

Training deep neural networks is challenging. To accelerate training and enhance performance, we propose PadamP, a novel optimization algorithm. PadamP is derived by applying the adaptive estimation of the p-th power of the second-order…

Optimization and Control · Mathematics 2025-03-14 Yongqi Li , Xiaowei Zhang

First order optimization algorithms play a major role in large scale machine learning. A new class of methods, called adaptive algorithms, were recently introduced to adjust iteratively the learning rate for each coordinate. Despite great…

Machine Learning · Computer Science 2019-10-01 André Belotto da Silva , Maxime Gazeau

In this paper, we adopt a probability distribution estimation perspective to explore the optimization mechanisms of supervised classification using deep neural networks. We demonstrate that, when employing the Fenchel-Young loss, despite…

Machine Learning · Computer Science 2025-04-01 Binchuan Qi , Wei Gong , Li Li