English
Related papers

Related papers: A Mini-Batch Quasi-Newton Proximal Method for Cons…

200 papers

Model-based methods are widely used for reconstruction in compressed sensing (CS) magnetic resonance imaging (MRI), using regularizers to describe the images of interest. The reconstruction process is equivalent to solving a composite…

Optimization and Control · Mathematics 2024-02-27 Tao Hong , Luis Hernandez-Garcia , Jeffrey A. Fessler

Inverse problems span across diverse fields. In medical contexts, computed tomography (CT) plays a crucial role in reconstructing a patient's internal structure, presenting challenges due to artifacts caused by inherently ill-posed inverse…

Image and Video Processing · Electrical Eng. & Systems 2024-04-01 Ishak Ayad , Nicolas Larue , Maï K. Nguyen

Since the matrix formed by nonlocal similar patches in a natural image is of low rank, the nuclear norm minimization (NNM) has been widely used in various image processing studies. Nonetheless, nuclear norm based convex surrogate of the…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 Zhiyuan Zha , Xinggan Zhang , Yu Wu , Qiong Wang , Lan Tang

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner

This paper addresses the challenge of developing efficient algorithms for large-scale nonconvex multiobjective optimization problems (MOPs). While quasi-Newton methods are effective, their traditional application to MOPs is computationally…

Optimization and Control · Mathematics 2025-12-23 Hua Liu

We propose an inexact variable-metric proximal point algorithm to accelerate gradient-based optimization algorithms. The proposed scheme, called QNing can be notably applied to incremental first-order methods such as the stochastic…

Machine Learning · Statistics 2019-01-30 Hongzhou Lin , Julien Mairal , Zaid Harchaoui

Recently, the proximal Newton-type method and its variants have been generalized to solve composite optimization problems over the Stiefel manifold whose objective function is the summation of a smooth function and a nonsmooth function. In…

Optimization and Control · Mathematics 2025-02-11 Qinsi Wang , Wei Hong Yang

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

Numerical Analysis · Computer Science 2017-10-18 Hiva Ghanbari , Katya Scheinberg

Interior Point Methods (IPM) rely on the Newton method for solving systems of nonlinear equations. Solving the linear systems which arise from this approach is the most computationally expensive task of an interior point iteration. If, due…

Optimization and Control · Mathematics 2018-06-27 J. Gondzio , F. N. C. Sobral

Channel estimation and extrapolation are fundamental issues in MIMO communication systems. In this paper, we proposed the quasi-Newton orthogonal matching pursuit (QNOMP) approach to overcome these issues with high efficiency while…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Yi Zeng , Mingguang Han , Xiaoguang Li , Tiejun Li

We introduce a framework for quasi-Newton forward--backward splitting algorithms (proximal quasi-Newton methods) with a metric induced by diagonal $\pm$ rank-$r$ symmetric positive definite matrices. This special type of metric allows for a…

Optimization and Control · Mathematics 2018-11-27 Stephen Becker , Jalal Fadili , Peter Ochs

In this paper, we propose an inexact proximal Newton-type method for nonconvex composite problems. We establish the global convergence rate of the order $\mathcal{O}(k^{-1/2})$ in terms of the minimal norm of the KKT residual mapping and…

Optimization and Control · Mathematics 2024-12-26 Hong Zhu

This paper develops an adaptive proximal alternating direction method of multipliers (ADMM) for solving linearly constrained, composite optimization problems under the assumption that the smooth component of the objective is weakly convex,…

Optimization and Control · Mathematics 2026-05-04 Leandro Farias Maia , David H. Gutman , Renato D. C. Monteiro , Gilson N. Silva

Quasi-Newton (QN) methods provide an efficient alternative to second-order methods for minimizing smooth unconstrained problems. While QN methods generally compose a Hessian estimate based on one secant interpolation per iteration,…

Optimization and Control · Mathematics 2025-04-11 Mokhwa Lee , Yifan Sun

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

Image restoration is typically addressed through non-convex inverse problems, which are often solved using first-order block-wise splitting methods. In this paper, we consider a general type of non-convex optimisation model that captures…

We present a proximal augmented Lagrangian based solver for general convex quadratic programs (QPs), relying on semismooth Newton iterations with exact line search to solve the inner subproblems. The exact line search reduces in this case…

Optimization and Control · Mathematics 2020-04-02 Ben Hermans , Andreas Themelis , Panagiotis Patrinos

We propose QPALM, a nonconvex quadratic programming (QP) solver based on the proximal augmented Lagrangian method. This method solves a sequence of inner subproblems which can be enforced to be strongly convex and which therefore admit a…

Optimization and Control · Mathematics 2024-04-17 Ben Hermans , Andreas Themelis , Panagiotis Patrinos

This paper proposes QPALM, a proximal augmented Lagrangian method based on quadratic approximations, for solving nonlinear programming problems with weakly convex objective and constraint functions. The algorithm is constructed by…

Optimization and Control · Mathematics 2026-05-06 Yule Zhang , Benqi Liu , Xiantao Xiao , Liwei Zhang

Solving an optimization problem whose objective function is the sum of two convex functions has received considerable interests in the context of image processing recently. In particular, we are interested in the scenario when a…

Computer Vision and Pattern Recognition · Computer Science 2014-12-16 Dai-Qiang Chen
‹ Prev 1 2 3 10 Next ›