English
Related papers

Related papers: Sequential bi-level regularized inversion with app…

200 papers

Surface partial differential equations arise in numerous scientific and engineering applications. Their numerical solution on static and evolving surfaces remains challenging due to geometric complexity and, for evolving geometries, the…

Numerical Analysis · Mathematics 2026-03-03 Jingbo Sun , Fei Wang

We propose a new approach to solving bilevel optimization problems, intermediate between solving full-system optimality conditions with a Newton-type approach, and treating the inner problem as an implicit function. The overall idea is to…

Optimization and Control · Mathematics 2024-05-08 Ensio Suonperä , Tuomo Valkonen

We propose a novel framework, Continuous_Time Attention, which infuses partial differential equations (PDEs) into the Transformer's attention mechanism to address the challenges of extremely long input sequences. Instead of relying solely…

Machine Learning · Computer Science 2025-12-30 Yukun Zhang , Xueqing Zhou

We propose an optimization proxy in terms of iterative implicit gradient methods for solving constrained optimization problems with nonconvex loss functions. This framework can be applied to a broad range of machine learning settings,…

Optimization and Control · Mathematics 2025-10-14 Harshal D. Kaushik , Ming Jin

Providing fast and accurate solutions to partial differential equations is a problem of continuous interest to the fields of applied mathematics and physics. With the recent advances in machine learning, the adoption learning techniques in…

Computational Physics · Physics 2019-04-16 S. Mohammad H. Hashemi , Demetri Psaltis

A high-order accurate adjoint-based optimization framework is presented for unsteady multiphysics problems. The fully discrete adjoint solver relies on the high-order, linearly stable, partitioned solver introduced in [1], where different…

Numerical Analysis · Mathematics 2019-01-01 Daniel Z. Huang , Per-Olof Persson , Matthew J. Zahr

In the first part of planned series of papers the formal general solutions to selection of 80 examples of different types of second order nonlinear PDEs in two independent variables with constant parameters are given. The main goal here is…

Mathematical Physics · Physics 2008-01-29 Yu. N. Kosovtsov

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

Optimization and Control · Mathematics 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

A kernel-based approach for the learning of the solution operator of general nonhomogeneous partial differential equations (PDEs) is proposed. The method incorporates physical priors, typically encoded through the PDE operator, into a…

Numerical Analysis · Mathematics 2026-05-12 Jianyu Hu , Juan-Pablo Ortega

Identifying parameters in partial differential equations (PDEs) represents a very broad class of applied inverse problems. In recent years, several unsupervised learning approaches using (deep) neural networks have been developed to solve…

Numerical Analysis · Mathematics 2025-08-22 Siyu Cen , Bangti Jin , Qimeng Quan , Zhi Zhou

Regularization methods are a key tool in the solution of inverse problems. They are used to introduce prior knowledge and make the approximation of ill-posed (pseudo-)inverses feasible. In the last two decades interest has shifted from…

Numerical Analysis · Mathematics 2018-01-31 Martin Benning , Martin Burger

Physics-informed neural networks (PINNs) represent a new paradigm for solving partial differential equations (PDEs) by integrating physical laws into the learning process of neural networks. However, ensuring that such frameworks fully…

Machine Learning · Computer Science 2025-12-12 Nanxi Chen , Sifan Wang , Rujin Ma , Airong Chen , Chuanjie Cui

Efficient and stable solution of partial differential equations (PDEs) is central to scientific and engineering applications, yet existing numerical solvers rely heavily on matrix based discretizations, while learning based methods require…

Machine Learning · Computer Science 2026-04-30 Yi Bing , Zheng Ran , Fu Jinyang , Liu Long , Peng Xiang

The solution to partial differential equations using deep learning approaches has shown promising results for several classes of initial and boundary-value problems. However, their ability to surpass, particularly in terms of accuracy,…

Numerical Analysis · Mathematics 2023-08-23 Ziad Aldirany , Régis Cottereau , Marc Laforest , Serge Prudhomme

We introduce a novel numerical approach for a class of stochastic dynamic programs which arise as discretizations of backward stochastic differential equations or semi-linear partial differential equations. Solving such dynamic programs…

Numerical Analysis · Mathematics 2016-06-24 Christian Bender , Christian Gaertner , Nikolaus Schweizer

Realistic physical phenomena exhibit random fluctuations across many scales in the input and output processes. Models of these phenomena require stochastic PDEs. For three-dimensional coupled (vector-valued) stochastic PDEs (SPDEs), for…

Computational Engineering, Finance, and Science · Computer Science 2022-08-24 Ajit Desai , Mohammad Khalil , Chris L. Pettit , Dominique Poirel , Abhijit Sarkar

This paper aims to develop and analyze a numerical scheme for solving the backward problem of semilinear subdiffusion equations. We establish the existence, uniqueness, and conditional stability of the solution to the inverse problem by…

Numerical Analysis · Mathematics 2025-05-07 Xu Wu , Jiang Yang , Zhi Zhou

In this paper we first study the penalization approximation of stochastic differential equations reflected in a domain which satisfies conditions (A) and (B) and prove that the sequence of solutions of the penalizing equations converges in…

Probability · Mathematics 2016-04-08 Jiagang Ren , Jing Wu

Multilevel methods are among the most efficient numerical methods for solving large-scale linear systems that arise from discretized partial differential equations. The fundamental module of such methods is a two-level procedure, which…

Numerical Analysis · Mathematics 2021-11-09 Xuefeng Xu

We propose a novel type of nonlinear solver acceleration for systems of nonlinear partial differential equations (PDEs) that is based on online/adaptive learning. It is applied in the context of multiphase flow in porous media. The proposed…

Machine Learning · Computer Science 2025-04-28 Vinicius L S Silva , Pablo Salinas , Claire E Heaney , Matthew Jackson , Christopher C Pain