English
Related papers

Related papers: An efficient Quasi-Newton method for nonlinear inv…

200 papers

In this paper, we introduce a Gauss-Newton method for solving the complex phase retrieval problem. In contrast to the real-valued setting, the Gauss-Newton matrix for complex-valued signals is rank-deficient and, thus, non-invertible. To…

Numerical Analysis · Mathematics 2024-06-17 Meng Huang

Recent works in deep learning have shown that integrating differentiable physics simulators into the training process can greatly improve the quality of results. Although this combination represents a more complex optimization task than…

Machine Learning · Computer Science 2022-03-22 Patrick Schnell , Philipp Holl , Nils Thuerey

This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and…

Optimization and Control · Mathematics 2026-03-03 Pham Duy Khanh , Boris S. Mordukhovich , Vo Thanh Phat

In this work we present an adaptive Newton-type method to solve nonlinear constrained optimization problems in which the constraint is a system of partial differential equations discretized by the finite element method. The adaptive…

Optimization and Control · Mathematics 2017-06-05 Thomas Carraro , Simon Dörsam , Stefan Frei , Daniel Schwarz

The weighted nonlinear least-squares problem for low-rank signal estimation is considered. The problem of constructing a numerical solution that is stable and fast for long time series is addressed. A modified weighted Gauss-Newton method,…

Numerical Analysis · Mathematics 2022-07-08 Nikita Zvonarev , Nina Golyandina

Inverse problems arise in a number of domains such as medical imaging, remote sensing, and many more, relying on the use of advanced signal and image processing approaches -- such as sparsity-driven techniques -- to determine their…

Machine Learning · Computer Science 2019-02-01 Jaweria Amjad , Zhaoyan Lyu , Miguel R. D. Rodrigues

Quasi-Newton algorithms are among the most popular iterative methods for solving unconstrained minimization problems, largely due to their favorable superlinear convergence property. However, existing results for these algorithms are…

Optimization and Control · Mathematics 2023-07-26 Ruichen Jiang , Qiujiang Jin , Aryan Mokhtari

Nonlinear optimal control is vital for numerous applications but remains challenging for unknown systems due to the difficulties in accurately modelling dynamics and handling computational demands, particularly in high-dimensional settings.…

Systems and Control · Electrical Eng. & Systems 2024-12-03 Zhexuan Zeng , Ruikun Zhou , Yiming Meng , Jun Liu

We consider a parametric quasi-variational inequality (QVI) without any convexity assumption. Using the concept of \emph{optimal value function}, we transform the problem into that of solving a nonsmooth system of inequalities. Based on…

Optimization and Control · Mathematics 2024-08-21 Joydeep Dutta , Lahoussine Lafhim , Alain Zemkoho , Shenglong Zhou

We consider parameterized variational inverse problems that are constrained by partial differential equations (PDEs). We seek to efficiently compute the solution of the inverse problem when auxiliary model parameters, which appear in the…

Numerical Analysis · Mathematics 2026-01-29 Joseph Hart , Alen Alexanderian , Bart van Bloemen Waanders

The Bayesian approach has proved to be a coherent approach to handle ill posed Inverse problems. However, the Bayesian calculations need either an optimization or an integral calculation. The maximum a posteriori (MAP) estimation requires…

Data Analysis, Statistics and Probability · Physics 2007-05-23 A. Mohammad-Djafari

We study a semismooth Newton-type method for the nearest doubly stochastic matrix problem where both differentiability and nonsingularity of the Jacobian can fail. The optimality conditions for this problem are formulated as a system of…

Optimization and Control · Mathematics 2021-07-21 Hao Hu , Haesol Im , Xinxin Li , Henry Wolkowicz

We introduce a simple, rigorous, and unified framework for solving nonlinear partial differential equations (PDEs), and for solving inverse problems (IPs) involving the identification of parameters in PDEs, using the framework of Gaussian…

Numerical Analysis · Mathematics 2021-08-12 Yifan Chen , Bamdad Hosseini , Houman Owhadi , Andrew M Stuart

Minimax problems have gained tremendous attentions across the optimization and machine learning community recently. In this paper, we introduce a new quasi-Newton method for minimax problems, which we call $J$-symmetric quasi-Newton method.…

Optimization and Control · Mathematics 2023-01-20 Azam Asl , Haihao Lu , Jinwen Yang

We propose an efficient way of solving optimal control problems for rigid-body systems on the basis of inverse dynamics and the multiple-shooting method. We treat all variables, including the state, acceleration, and control input torques,…

Optimization and Control · Mathematics 2022-10-25 Sotaro Katayama , Toshiyuki Ohtsuka

Iterative methods with certified convergence for the computation of Gauss--Jacobi quadratures are described. The methods do not require a priori estimations of the nodes to guarantee its fourth-order convergence. They are shown to be…

Numerical Analysis · Mathematics 2020-08-24 A. Gil , J. Segura , N. M. Temme

This work blends the inexact Newton method with iterative combined approximations (ICA) for solving topology optimization problems under the assumption of geometric nonlinearity. The density-based problem formulation is solved using a…

Numerical Analysis · Mathematics 2021-12-17 Thadeu A. Senne , Francisco A. M. Gomes , Sandra A. Santos

Many problems give rise to polynomial systems. These systems often have several parameters and we are interested to study how the solutions vary when we change the values for the parameters. Using predictor-corrector methods we track the…

Numerical Analysis · Mathematics 2008-10-01 Kathy Piret , Jan Verschelde

In this paper, a novel stochastic extra-step quasi-Newton method is developed to solve a class of nonsmooth nonconvex composite optimization problems. We assume that the gradient of the smooth part of the objective function can only be…

Optimization and Control · Mathematics 2019-10-22 Minghan Yang , Andre Milzarek , Zaiwen Wen , Tong Zhang

Engineered systems naturally experience large disturbances that can disrupt desired operation because the system may fail to recover to a stable equilibrium point. It is valuable to determine the mechanism of instability when the system is…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Jinghan Wang , Michael W. Fisher