English
Related papers

Related papers: Computing quasisolutions of nonlinear inverse prob…

200 papers

In this paper, we propose an inexact proximal Newton-type method for nonconvex composite problems. We establish the global convergence rate of the order $\mathcal{O}(k^{-1/2})$ in terms of the minimal norm of the KKT residual mapping and…

Optimization and Control · Mathematics 2024-12-26 Hong Zhu

Separable nonlinear least squares problems appear in many inverse problems, including semi-blind image deblurring. The variable projection (VarPro) method provides an efficient approach for solving such problems by eliminating linear…

Numerical Analysis · Mathematics 2026-01-09 Delfina B. Comerso Salzer , Malena I. Español , Gabriela Jeronimo

The $p$-regularized subproblem (p-RS) is a regularisation technique in computing a Newton-like step for unconstrained optimization, which globally minimizes a local quadratic approximation of the objective function while incorporating with…

Optimization and Control · Mathematics 2018-05-01 Yong Hsia , Ruey-Lin Sheu , Ya-xiang Yuan

In this paper, we consider the asymptotical regularization with convex constraints for nonlinear ill-posed problems. The method allows to use non-smooth penalty terms, including the L1-like and the total variation-like penalty functionals,…

Numerical Analysis · Mathematics 2022-03-23 Min Zhong , Wei Wang

In this paper, a globally convergent trust region proximal gradient method is developed for composite multi-objective optimization problems where each objective function can be represented as the sum of a smooth function and a nonsmooth…

Optimization and Control · Mathematics 2024-10-28 Md Abu Talhamainuddin Ansary

We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized…

Numerical Analysis · Mathematics 2018-06-05 Robert Plato , Bernd Hofmann

We present a converged algorithm for Tikhonov regularized nonnegative matrix factorization (NMF). We specially choose this regularization because it is known that Tikhonov regularized least square (LS) is the more preferable form in solving…

Machine Learning · Computer Science 2015-03-20 Andri Mirzal

We introduce a new method for solving nonlinear continuous optimization problems with chance constraints. Our method is based on a reformulation of the probabilistic constraint as a quantile function. The quantile function is approximated…

Optimization and Control · Mathematics 2020-03-17 Alejandra Peña-Ordieres , James R. Luedtke , Andreas Wächter

This work introduces a new cubic regularization method for nonconvex unconstrained multiobjective optimization problems. At each iteration of the method, a model associated with the cubic regularization of each component of the objective…

Optimization and Control · Mathematics 2025-06-11 Douglas S. Gonçalves , Max L. N. Gonçalves , Jefferson G. Melo

Low-rank tensor completion problem aims to recover a tensor from limited observations, which has many real-world applications. Due to the easy optimization, the convex overlapping nuclear norm has been popularly used for tensor completion.…

Machine Learning · Computer Science 2019-01-24 Quanming Yao , James T Kwok , Bo Han

We consider minimizing a function consisting of a quadratic term and a proximable term which is possibly nonconvex and nonsmooth. This problem is also known as scaled proximal operator. Despite its simple form, existing methods suffer from…

Optimization and Control · Mathematics 2024-03-01 Yiming Zhou , Wei Dai

In this paper, we introduce a class of nonsmooth nonconvex least square optimization problem using convex analysis tools and we propose to use the iterative minimization-majorization (MM) algorithm on a convex set with initializer away from…

Optimization and Control · Mathematics 2019-06-14 Azita Mayeli

In this paper we introduce the class of infinite infimal convolution functionals and apply these functionals to the regularization of ill-posed inverse problems. The proposed regularization involves an infimal convolution of a continuously…

Optimization and Control · Mathematics 2024-12-17 Kristian Bredies , Marcello Carioni , Martin Holler , Yury Korolev , Carola-Bibiane Schönlieb

An emerging new paradigm for solving inverse problems is via the use of deep learning to learn a regularizer from data. This leads to high-quality results, but often at the cost of provable guarantees. In this work, we show how…

Machine Learning · Computer Science 2023-11-06 Zakhar Shumaylov , Jeremy Budd , Subhadip Mukherjee , Carola-Bibiane Schönlieb

The first-order optimality condition of convexly constrained nonconvex nonconcave min-max optimization problems with box constraints formulates a nonmonotone variational inequality (VI), which is equivalent to a system of nonsmooth…

Optimization and Control · Mathematics 2024-04-17 Zicheng Qiu , Jie Jiang , Xiaojun Chen

In this paper, we provide the first provable linear-time (in the number of non-zero entries of the input) algorithm for approximately solving the generalized trust region subproblem (GTRS) of minimizing a quadratic function over a quadratic…

Optimization and Control · Mathematics 2019-05-07 Rujun Jiang , Duan Li

Iterative regularization exploits the implicit bias of an optimization algorithm to regularize ill-posed problems. Constructing algorithms with such built-in regularization mechanisms is a classic challenge in inverse problems but also in…

Optimization and Control · Mathematics 2022-02-02 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

We propose a forward-backward proximal-type algorithm with inertial/memory effects for minimizing the sum of a nonsmooth function with a smooth one in the nonconvex setting. The sequence of iterates generated by the algorithm converges to a…

Optimization and Control · Mathematics 2014-10-03 Radu Ioan Bot , Ernö Robert Csetnek , Szilárd László

Optimization on Riemannian manifolds widely arises in eigenvalue computation, density functional theory, Bose-Einstein condensates, low rank nearest correlation, image registration, and signal processing, etc. We propose an adaptive…

Optimization and Control · Mathematics 2017-08-08 Jiang Hu , Andre Milzarek , Zaiwen Wen , Yaxiang Yuan

In a Hilbertian framework, for the minimization of a general convex differentiable function $f$, we introduce new inertial dynamics and algorithms that generate trajectories and iterates that converge fastly towards the minimizer of $f$…

Optimization and Control · Mathematics 2021-04-27 Hedy Attouch , Szilard Laszlo