English
Related papers

Related papers: Sequential bi-level regularized inversion with app…

200 papers

The numerical solution of differential equations can be formulated as an inference problem to which formal statistical approaches can be applied. However, nonlinear partial differential equations (PDEs) pose substantial challenges from an…

Numerical Analysis · Mathematics 2021-08-26 Junyang Wang , Jon Cockayne , Oksana Chkrebtii , T. J. Sullivan , Chris. J. Oates

We explore anisotropic regularisation methods in the spirit of [Holler & Kunisch, 14]. Based on ground truth data, we propose a bilevel optimisation strategy to compute the optimal regularisation parameters of such a model for the…

Numerical Analysis · Mathematics 2016-02-04 Martin Benning , Carola-Bibiane Schönlieb , Tuomo Valkonen , Verner Vlačić

Bilevel programs are optimization problems where some variables are solutions to optimization problems themselves, and they arise in a variety of control applications, including: control of vehicle traffic networks, inverse reinforcement…

Optimization and Control · Mathematics 2017-09-27 Aurélien Ouattara , Anil Aswani

Machine learning has been successfully applied to various fields of scientific computing in recent years. In this work, we propose a sparse radial basis function neural network method to solve elliptic partial differential equations (PDEs)…

Numerical Analysis · Mathematics 2023-09-07 Zhiwen Wang , Minxin Chen , Jingrun Chen

In the present work, a multi-scale framework for neural network enhanced methods is proposed for approximation of function and solution of partial differential equations (PDEs). By introducing the multi-scale concept, the total solution of…

Numerical Analysis · Mathematics 2022-09-07 Xiaodan Ren

We present a regularization method to approach a solution of the pessimistic formulation of ill -posed bilevel problems . This allows to overcome the difficulty arising from the non uniqueness of the lower level problems solutions and…

Optimization and Control · Mathematics 2016-08-16 Maïtine Bergounioux , Mounir Haddou

Partial differential equations (PDEs) play a crucial role in studying a vast number of problems in science and engineering. Numerically solving nonlinear and/or high-dimensional PDEs is often a challenging task. Inspired by the traditional…

Numerical Analysis · Mathematics 2022-01-11 Yihao Hu , Tong Zhao , Shixin Xu , Zhiliang Xu , Lizhen Lin

Regularization is a core component of modern inverse problems, as it helps establish the well-posedness of the solution of interest. Popular regularization approaches include variational regularization and iterative regularization. The…

Optimization and Control · Mathematics 2025-08-08 Jie Gao , Cesare Molinari , Silvia Villa , Jingwei Liang

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

Statistics Theory · Mathematics 2007-06-13 Ana K. Fermin , Carenne Ludena

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

Machine Learning · Computer Science 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

Different relaxation approximations to partial differential equations, including conservation laws, Hamilton-Jacobi equations, convection-diffusion problems, gas dynamics problems, have been recently proposed. The present paper focuses onto…

Numerical Analysis · Mathematics 2008-04-04 F. Cavalli , M. Semplice

The discovery of partial differential equations (PDEs) is a challenging task that involves both theoretical and empirical methods. Machine learning approaches have been developed and used to solve this problem; however, it is important to…

Machine Learning · Statistics 2023-06-09 Kalpesh More , Tapas Tripura , Rajdip Nayek , Souvik Chakraborty

Block coordinate descent (BCD) methods approach optimization problems by performing gradient steps along alternating subgroups of coordinates. This is in contrast to full gradient descent, where a gradient step updates all coordinates…

Numerical Analysis · Mathematics 2019-07-29 Simon Rabanser , Lukas Neumann , Markus Haltmeier

In this work, we prove global existence of solutions for second order differential problems in a general framework. More precisely, we consider second order differential inclusions involving proximal normal cone to a set-valued map. This…

Analysis of PDEs · Mathematics 2010-06-14 Frederic Bernicot , Juliette Venel

Bilevel learning has gained prominence in machine learning, inverse problems, and imaging applications, including hyperparameter optimization, learning data-adaptive regularizers, and optimizing forward operators. The large-scale nature of…

Optimization and Control · Mathematics 2025-05-20 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

Regularizing continual learning techniques is important for anticipating algorithmic behavior under new realizations of data. We introduce a new approach to continual learning by imposing the properties of a parabolic partial differential…

Machine Learning · Computer Science 2025-03-05 Haoming Yang , Ali Hasan , Vahid Tarokh

Physics-based models often involve large systems of parametrized partial differential equations, where design parameters control various properties. However, high-fidelity simulations of such systems on large domains or with high grid…

Computational Physics · Physics 2025-05-15 Diba Behnoudfar

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

State-dependent parameter identification, where unknown model parameters depend on one or more state variables in partial differential equations (PDEs) or coupled PDE systems, is fundamental to a wide range of problems in physics,…

Optimization and Control · Mathematics 2026-01-19 Vladislav Bukshtynov

A common challenge in regression is that for many problems, the degrees of freedom required for a high-quality solution also allows for overfitting. Regularization is a class of strategies that seek to restrict the range of possible…

Machine Learning · Computer Science 2022-11-15 Colin Ponce , Ruipeng Li , Christina Mao , Panayot Vassilevski