English
Related papers

Related papers: Complexity analysis of regularization methods for …

200 papers

The estimation of distributed parameters in partial differential equations (PDE) from measures of the solution of the PDE may lead to under-determination problems. The choice of a parameterization is a usual way of adding a-priori…

Numerical Analysis · Mathematics 2008-01-16 Hend Ben Ameur , François Clément , Pierre Weis , Guy Chavent

This paper studies an unsupervised deep learning-based numerical approach for solving partial differential equations (PDEs). The approach makes use of the deep neural network to approximate solutions of PDEs through the compositional…

Machine Learning · Computer Science 2020-08-26 Zhiqiang Cai , Jingshuang Chen , Min Liu , Xinyu Liu

We introduce a novel formulation for curvature regularization by penalizing normal curvatures from multiple directions. This total normal curvature regularization is capable of producing solutions with sharp edges and precise isotropic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Tianle Lu , Ke Chen , Yuping Duan

In this paper, we propose a multilevel stochastic framework for the solution of nonconvex unconstrained optimization problems. The proposed approach uses random regularized first-order models that exploit an available hierarchical…

Optimization and Control · Mathematics 2025-11-27 Filippo Marini , Margherita Porcelli , Elisa Riccietti

Many inverse problems can be described by a PDE model with unknown parameters that need to be calibrated based on measurements related to its solution. This can be seen as a constrained minimization problem where one wishes to minimize the…

Numerical Analysis · Mathematics 2018-09-06 Nick Schenkels , Wim Vanroose

Partial differential equation (PDE) models with multiple temporal/spatial scales are prevalent in several disciplines such as physics, engineering, and many others. These models are of great practical importance but notoriously difficult to…

Numerical Analysis · Mathematics 2023-04-17 Junpeng Hu , Shi Jin , Lei Zhang

Viewing optimization methods as numerical integrators for ordinary differential equations (ODEs) provides a thought-provoking modern framework for studying accelerated first-order optimizers. In this literature, acceleration is often…

Optimization and Control · Mathematics 2021-02-24 Peiyuan Zhang , Antonio Orvieto , Hadi Daneshmand , Thomas Hofmann , Roy Smith

Inverse problems are common and important in many applications in computational physics but are inherently ill-posed with many possible model parameters resulting in satisfactory results in the observation space. When solving the inverse…

Computational Physics · Physics 2020-06-24 Xin-Lei Zhang , Carlos Michelén-Ströfer , Heng Xiao

We address the numerical solution of minimal norm residuals of {\it nonlinear} equations in finite dimensions. We take inspiration from the problem of finding a sparse vector solution by using greedy algorithms based on iterative residual…

Numerical Analysis · Mathematics 2015-04-28 Juliane Sigl

We consider a class of $\ell_0$-regularized linear-quadratic (LQ) optimal control problems. This class of problems is obtained by augmenting a penalizing sparsity measure to the cost objective of the standard linear-quadratic regulator…

Optimization and Control · Mathematics 2015-07-31 MirSaleh Bahavarnia

In this article, we propose a novel regularization method for a class of nonlinear inverse problems that is inspired by an application in quantitative magnetic resonance imaging (qMRI). The latter is a special instance of a general…

Optimization and Control · Mathematics 2025-06-16 Guozhi Dong , Michael Hintermüller , Clemens Sirotenko

We propose a neural network-based algorithm for solving forward and inverse problems for partial differential equations in unsupervised fashion. The solution is approximated by a deep neural network which is the minimizer of a cost…

Machine Learning · Computer Science 2019-04-12 Leah Bar , Nir Sochen

First-order methods in convex optimization offer low per-iteration cost but often suffer from slow convergence, while second-order methods achieve fast local convergence at the expense of costly Hessian inversions. In this paper, we…

Machine Learning · Statistics 2025-07-08 Qiang Heng , Caixing Wang

A novel refinement measure for non-intrusive surrogate modelling of partial differential equations (PDEs) with uncertain parameters is proposed. Our approach uses an empirical interpolation procedure, where the proposed refinement measure…

Numerical Analysis · Mathematics 2019-07-10 Yous van Halder , Benjamin Sanderse , Barry Koren

State-dependent parameter identification, where unknown model parameters depend on one or more state variables in partial differential equations (PDEs) or coupled PDE systems, is fundamental to a wide range of problems in physics,…

Optimization and Control · Mathematics 2026-01-19 Vladislav Bukshtynov

In this paper, we present a novel nonlinear programming-based approach to fine-tune pre-trained neural networks to improve robustness against adversarial attacks while maintaining high accuracy on clean data. Our method introduces…

Machine Learning · Computer Science 2024-10-28 Shudian Zhao , Jan Kronqvist

In this paper, the compact linearization approach originally proposed for binary quadratic programs with assignment constraints is generalized to such programs with arbitrary linear equations and inequalities that have positive coefficients…

Optimization and Control · Mathematics 2018-08-28 Sven Mallach

For a wide variety of regularization methods, algorithms computing the entire solution path have been developed recently. Solution path algorithms do not only compute the solution for one particular value of the regularization parameter but…

Machine Learning · Computer Science 2009-03-30 Bernd Gärtner , Joachim Giesen , Martin Jaggi , Torsten Welsch

In this paper, we study the estimation of partially linear models for spatial data distributed over complex domains. We use bivariate splines over triangulations to represent the nonparametric component on an irregular two-dimensional…

Statistics Theory · Mathematics 2021-06-03 Li Wang , Guannan Wang , Min-Jun Lai , Lei Gao

In this paper we propose a fast optimization algorithm for approximately minimizing convex quadratic functions over the intersection of affine and separable constraints (i.e., the Cartesian product of possibly nonconvex real sets). This…

Optimization and Control · Mathematics 2015-09-29 Reza Takapoui , Nicholas Moehle , Stephen Boyd , Alberto Bemporad