English
Related papers

Related papers: Complexity analysis of regularization methods for …

200 papers

We conduct a study and comparison of superiorization and optimization approaches for the reconstruction problem of superiorized/regularized least-squares solutions of underdetermined linear equations with nonnegativity variable bounds.…

Optimization and Control · Mathematics 2020-04-02 Yair Censor , Stefania Petra , Christoph Schnörr

We present a novel framework for PDE-constrained $r$-adaptivity of high-order meshes. The proposed method formulates mesh movement as an optimization problem, with an objective function defined as a convex combination of a mesh quality…

Numerical Analysis · Mathematics 2025-07-03 Tzanio Kolev , Boyan Lazarov , Ketan Mittal , Mathias Schmidt , Vladimir Tomov

Many least squares problems involve affine equality and inequality constraints. Although there are variety of methods for solving such problems, most statisticians find constrained estimation challenging. The current paper proposes a new…

Computation · Statistics 2013-10-22 Hua Zhou , Kenneth Lange

Optimization problems over discrete or quantized variables are very challenging in general due to the combinatorial nature of their search space. Piecewise-affine regularization (PAR) provides a flexible modeling and computational framework…

Machine Learning · Computer Science 2025-08-18 Jianhao Ma , Lin Xiao

This paper is concerned with the design and analysis of least squares solvers for ill-posed PDEs that are conditionally stable. The norms and the regularization term used in the least squares functional are determined by the ingredients of…

Numerical Analysis · Mathematics 2023-06-02 Wolfgang Dahmen , Harald Monsuur , Rob Stevenson

Differential equations (DE) constrained optimization plays a critical role in numerous scientific and engineering fields, including energy systems, aerospace engineering, ecology, and finance, where optimal configurations or control…

Machine Learning · Computer Science 2024-10-03 Vincenzo Di Vito , Mostafa Mohammadian , Kyri Baker , Ferdinando Fioretto

Regularization is used in many different areas of optimization when solutions are sought which not only minimize a given function, but also possess a certain degree of regularity. Popular applications are image denoising, sparse regression…

Optimization and Control · Mathematics 2021-11-15 Bennet Gebken , Katharina Bieker , Sebastian Peitz

Coupled 3D-1D problems arise in many practical applications, in an attempt to reduce the computational burden in simulations where cylindrical inclusions with a small section are embedded in a much larger domain. Nonetheless the resolution…

Numerical Analysis · Mathematics 2021-06-10 Stefano Berrone , Denise Grappein , Stefano Scialò , Fabio Vicini

We introduce a practical method to enforce partial differential equation (PDE) constraints for functions defined by neural networks (NNs), with a high degree of accuracy and up to a desired tolerance. We develop a differentiable…

Machine Learning · Computer Science 2023-04-19 Geoffrey Négiar , Michael W. Mahoney , Aditi S. Krishnapriyan

Linear projection schemes like Proper Orthogonal Decomposition can efficiently reduce the dimensions of dynamical systems but are naturally limited, e.g., for convection-dominated problems. Nonlinear approaches have shown to outperform…

Dynamical Systems · Mathematics 2022-10-03 Peter Benner , Pawan Goyal , Jan Heiland , Igor Pontes

We consider constrained bilinear optimal control of second-order linear evolution partial differential equations (PDEs) with a reaction term on the half line, where control arises as a time-dependent reaction coefficient and constraints are…

Computational Physics · Physics 2025-11-20 Zhexian Li , Felipe de Barros , Ketan Savla

We examine the challenges associated with numerical integration when applying Neural Networks to solve Partial Differential Equations (PDEs). We specifically investigate the Deep Ritz Method (DRM), chosen for its practical applicability and…

Numerical Analysis · Mathematics 2025-05-09 Jamie M. Taylor , David Pardo

We derive novel algorithms for optimization problems constrained by partial differential equations describing multiscale particle dynamics, including non-local integral terms representing interactions between particles. In particular, we…

Numerical Analysis · Mathematics 2021-09-09 Mildred Aduamoah , Benjamin D. Goddard , John W. Pearson , Jonna C. Roden

We present a parameter estimation method in Ordinary Differential Equation (ODE) models. Due to complex relationships between parameters and states the use of standard techniques such as nonlinear least squares can lead to the presence of…

Methodology · Statistics 2018-10-11 Quentin Clairon

Nonconvex and nonsmooth optimization problems are frequently encountered in much of statistics, business, science and engineering, but they are not yet widely recognized as a technology in the sense of scalability. A reason for this…

Optimization and Control · Mathematics 2018-01-19 Bo Jiang , Tianyi Lin , Shiqian Ma , Shuzhong Zhang

This article presents a new approach to the real-time solution of inverse problems on embedded systems. The class of problems addressed corresponds to ordinary differential equations (ODEs) with generalized linear constraints, whereby the…

Discrete Mathematics · Computer Science 2014-06-03 Christoph Gugg , Matthew Harker , Paul O'Leary , Gerhard Rath

This manuscript presents a framework for using multilevel quadrature formulae to compute the solution of optimal control problems constrained by random partial differential equations. Our approach consists in solving a sequence of optimal…

Numerical Analysis · Mathematics 2025-05-19 Fabio Nobile , Tommaso Vanzan

In this paper, we investigate optimization problems with nonnegative and orthogonal constraints, where any feasible matrix of size $n \times p$ exhibits a sparsity pattern such that each row accommodates at most one nonzero entry. Our…

Optimization and Control · Mathematics 2025-11-06 Lei Wang , Xin Liu , Xiaojun Chen

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

Optimization of frame structures is formulated as a~non-convex optimization problem, which is currently solved to local optimality. In this contribution, we investigate four optimization approaches: (i) general non-linear optimization, (ii)…

Optimization and Control · Mathematics 2019-09-17 Marek Tyburec , Jan Zeman , Martin Kružík , Didier Henrion