English
Related papers

Related papers: A Residual Minimization approach for Nonlinear Par…

200 papers

We construct least squares formulations of PDEs with inhomogeneous essential boundary conditions, where boundary residuals are not measured in unpractical fractional Sobolev norms, but which formulations nevertheless are shown to yield a…

Numerical Analysis · Mathematics 2025-05-12 Harald Monsuur , Robin Smeets , Rob Stevenson

A central challenge to many fields of science and engineering involves minimizing non-convex error functions over continuous, high dimensional spaces. Gradient descent or quasi-Newton methods are almost ubiquitously used to perform such…

Machine Learning · Computer Science 2014-06-11 Yann Dauphin , Razvan Pascanu , Caglar Gulcehre , Kyunghyun Cho , Surya Ganguli , Yoshua Bengio

We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates…

Machine Learning · Computer Science 2017-04-13 Adams Wei Yu , Qihang Lin , Tianbao Yang

As an alternative to PINNs, a Deep Ritz framework is proposed to solve fully nonlinear PDEs. A least-squares algorithm is advocated to decouple the nonlinearities from the variational features of several fully nonlinear PDEs. A splitting…

Numerical Analysis · Mathematics 2026-05-01 Alexandre Caboussat , Martin T. Leclercq , Anna Peruso

The current study addresses the control problems posed by a semilinear neutral integro-differential equation with memory. The primary objectives of this study are to investigate the existence of a mild solution and approximate…

Optimization and Control · Mathematics 2025-01-28 Sumit Arora , Akambadath Nandakumaran

We address the numerical solution of minimal norm residuals of {\it nonlinear} equations in finite dimensions. We take inspiration from the problem of finding a sparse vector solution by using greedy algorithms based on iterative residual…

Numerical Analysis · Mathematics 2015-04-28 Juliane Sigl

Nonlinear partial differential equations (PDEs) are used to model dynamical processes in a large number of scientific fields, ranging from finance to biology. In many applications standard local models are not sufficient to accurately…

Numerical Analysis · Mathematics 2022-05-10 Victor Boussange , Sebastian Becker , Arnulf Jentzen , Benno Kuckuck , Loïc Pellissier

In recent years Landweber(-Kaczmarz) method has been proposed for solving nonlinear ill-posed inverse problems in Banach spaces using general convex penalty functions. The implementation of this method involves solving a (nonsmooth) convex…

Numerical Analysis · Mathematics 2016-08-24 Qinian Jin

In recent years, there has been a growing interest in leveraging deep learning and neural networks to address scientific problems, particularly in solving partial differential equations (PDEs). However, many neural network-based methods…

Machine Learning · Computer Science 2024-04-24 Adrian Celaya , Keegan Kirk , David Fuentes , Beatrice Riviere

Stochastic gradient methods have been a popular and powerful choice of optimization methods, aimed at minimizing functions. Their advantage lies in the fact that that one approximates the gradient as opposed to using the full Jacobian…

Numerical Analysis · Mathematics 2025-09-26 Neil K. Chada , Philip J. Herbert

We propose new machine learning schemes for solving high dimensional nonlinear partial differential equations (PDEs). Relying on the classical backward stochastic differential equation (BSDE) representation of PDEs, our algorithms estimate…

Probability · Mathematics 2020-06-08 Côme Huré , Huyên Pham , Xavier Warin

We propose machine learning methods for solving fully nonlinear partial differential equations (PDEs) with convex Hamiltonian. Our algorithms are conducted in two steps. First the PDE is rewritten in its dual stochastic control…

Computational Finance · Quantitative Finance 2022-05-23 William Lefebvre , Grégoire Loeper , Huyên Pham

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by means of solving an…

Applications · Statistics 2015-11-02 Isabell M. Franck , P. S. Koutsourelakis

A new primal-dual algorithm is presented for solving a class of non-convex minimization problems. This algorithm is based on canonical duality theory such that the original non-convex minimization problem is first reformulated as a…

Numerical Analysis · Computer Science 2013-01-01 Changzhi Wu , Chaojie Li , David Yang Gao

We consider convex-concave saddle point problems with a separable structure and non-strongly convex functions. We propose an efficient stochastic block coordinate descent method using adaptive primal-dual updates, which enables flexible…

Machine Learning · Statistics 2015-11-24 Zhanxing Zhu , Amos J. Storkey

We present a collection of algorithms which utilize dimensional reduction to perform mesh refinement and study possibly singular solutions of time-dependent partial differential equations. The algorithms are inspired by constructions used…

Numerical Analysis · Mathematics 2007-06-21 Panagiotis Stinis

We consider a minimal residual discretization of a simultaneous space-time variational formulation of parabolic evolution equations. Under the usual `LBB' stability condition on pairs of trial- and test spaces we show quasi-optimality of…

Numerical Analysis · Mathematics 2021-09-17 Rob Stevenson , Jan Westerdiep

We introduce an $r-$adaptive algorithm to solve Partial Differential Equations using a Deep Neural Network. The proposed method restricts to tensor product meshes and optimizes the boundary node locations in one dimension, from which we…

Numerical Analysis · Mathematics 2022-10-21 Ángel J. Omella , David Pardo

Constructing or learning a function from a finite number of sampled data points (measurements) is a fundamental problem in science and engineering. This is often formulated as a minimum norm interpolation problem, regularized learning…

Functional Analysis · Mathematics 2020-06-26 Rui Wang , Yuesheng Xu

We develop a semismooth Newton framework for the numerical solution of fixed-point equations that are posed in Banach spaces. The framework is motivated by applications in the field of obstacle-type quasi-variational inequalities and…

Numerical Analysis · Mathematics 2024-10-01 Amal Alphonse , Constantin Christof , Michael Hintermüller , Ioannis P. A. Papadopoulos