English
Related papers

Related papers: Parallel Inexact Levenberg-Marquardt Method for Ne…

200 papers

To construct a parallel approach for solving optimization problems with orthogonality constraints is usually regarded as an extremely difficult mission, due to the low scalability of the orthonormalization procedure. However, such demand is…

Optimization and Control · Mathematics 2021-11-16 Bin Gao , Xin Liu , Ya-xiang Yuan

Differentiable systems in this paper means systems of equations that are described by differentiable real functions in real matrix variables. This paper proposes algorithms for finding minimal rank solutions to such systems over (arbitrary…

Optimization and Control · Mathematics 2017-05-30 Thanh Hieu Le

Recently, in Applied Mathematics and Computation 474 (2024) 128688, a Levenberg-Marquardt method (LMM) with Singular Scaling was analyzed and successfully applied in parameter estimation problems in heat conduction where the use of a…

Numerical Analysis · Mathematics 2025-06-03 Rafaela Filippozzi , Everton Boos , Douglas S. Gonçalves , Fermin S. V. Bazán

This paper proposes a novel algorithm for training recurrent neural network models of nonlinear dynamical systems from an input/output training dataset. Arbitrary convex and twice-differentiable loss functions and regularization terms are…

Machine Learning · Computer Science 2022-10-18 Alberto Bemporad

Physics Informed Neural Networks (PINNs) have recently gained popularity for solving partial differential equations, given the fact they escape the curse of dimensionality. In this paper, we present Physics Informed Neural Networks as an…

Numerical Analysis · Mathematics 2022-07-26 Umberto Zerbinati

Distance Geometry Problem (DGP) and Nonlinear Mapping (NLM) are two well established questions: Distance Geometry Problem is about finding a Euclidean realization of an incomplete set of distances in a Euclidean space, whereas Nonlinear…

Computational Geometry · Computer Science 2019-05-10 Alain Franc , Pierre Blanchard , Olivier Coulaud

Speeding up computationally expensive problems, such as numerical simulations of large micromagnetic systems, requires efficient use of parallel computing infrastructures. While parallelism across space is commonly exploited in…

Computational Physics · Physics 2023-10-19 Robert Kraft , Sabri Koraltan , Markus Gattringer , Florian Bruckner , Dieter Suess , Claas Abert

In this paper, we study least-squares finite element methods (LSFEM) for general second-order elliptic equations with nonconforming finite element approximations. The equation may be indefinite. For the two-field potential-flux div LSFEM…

Numerical Analysis · Mathematics 2022-05-06 Yuxiang Liang , Shun Zhang

Solving constrained nonlinear programs (NLPs) is of great importance in various domains such as power systems, robotics, and wireless communication networks. One widely used approach for addressing NLPs is the interior point method (IPM).…

Optimization and Control · Mathematics 2024-10-22 Xi Gao , Jinxin Xiong , Akang Wang , Qihong Duan , Jiang Xue , Qingjiang Shi

Data approximation is essential in fields such as geometric design, numerical PDEs, and curve modeling. Moving Least Squares (MLS) is a widely used method for data fitting; however, its accuracy degrades in the presence of discontinuities,…

Numerical Analysis · Mathematics 2026-03-05 Inmaculada Garcés , Juan Ruiz-Álvarez , Dionisio F. Yáñez

Current algorithms for large-scale industrial optimization problems typically face a trade-off: they either require exponential time to reach optimal solutions, or employ problem-specific heuristics. To overcome these limitations, we…

Quantum Physics · Physics 2025-10-16 Matteo Vandelli , Francesco Ferrari , Daniele Dragoni

In these notes we propose and analyze an inertial type method for obtaining stable approximate solutions to nonlinear ill-posed operator equations. The method is based on the Levenberg-Marquardt (LM) iteration. The main obtained results…

Numerical Analysis · Mathematics 2024-06-12 Antonio Leitão , Joel C. Rabelo , Dirk A. Lorenz , Maximilian Winkler

In this paper, we study a class of approximation problems, appearing in data approximation and signal processing. The approximations are constructed as combinations of polynomial splines (piecewise polynomials), whose parameters are subject…

Optimization and Control · Mathematics 2015-03-05 Zahra Roshan Zamir , Nadezda Sukhorukova

The Material Point Method (MPM) is a hybrid Eulerian Lagrangian simulation technique for solid mechanics with significant deformation. Structured background grids are commonly employed in the standard MPM, but they may give rise to several…

Computational Engineering, Finance, and Science · Computer Science 2024-08-02 Yadi Cao , Yidong Zhao , Minchen Li , Yin Yang , Jinhyun Choo , Demetri Terzopoulos , Chenfanfu Jiang

This article considers stochastic algorithms for efficiently solving a class of large scale non-linear least squares (NLS) problems which frequently arise in applications. We propose eight variants of a practical randomized algorithm where…

Numerical Analysis · Mathematics 2015-01-27 Farbod Roosta-Khorasani , Gábor J. Székely , Uri Ascher

The problem of fitting experimental data to a given model function $f(t; p_1,p_2,\dots,p_N)$ is conventionally solved numerically by methods such as that of Levenberg-Marquardt, which are based on approximating the Chi-squared measure of…

Optimization and Control · Mathematics 2017-03-14 Alberto Herrera-Gomez , R. Michael Porter

Shape-constrained convex regression problem deals with fitting a convex function to the observed data, where additional constraints are imposed, such as component-wise monotonicity and uniform Lipschitz continuity. This paper provides a…

Optimization and Control · Mathematics 2020-02-27 Meixia Lin , Defeng Sun , Kim-Chuan Toh

Motivated by renal imaging studies that combine renogram curves with pharmacokinetic and demographic covariates, we propose Hybrid partial least squares (Hybrid PLS) for simultaneous supervised dimension reduction and regression in the…

Methodology · Statistics 2026-01-26 Jongmin Mun , Jeong Hoon Jang

In this paper we propose a variant of the linear least squares model allowing practitioners to partition the input features into groups of variables that they require to contribute similarly to the final result. The output allows…

Machine Learning · Computer Science 2024-07-17 Roberto Esposito , Mattia Cerrato , Marco Locatelli

We consider the problem of efficiently solving large-scale linear least squares problems that have one or more linear constraints that must be satisfied exactly. Whilst some classical approaches are theoretically well founded, they can face…

Numerical Analysis · Mathematics 2021-12-24 Jennifer Scott , Miroslav Tuma