English
Related papers

Related papers: An inexact alternating projection method with appl…

200 papers

Alternating minimization represents a widely applicable and empirically successful approach for finding low-rank matrices that best fit the given data. For example, for the problem of low-rank matrix completion, this method is believed to…

Machine Learning · Statistics 2012-12-04 Prateek Jain , Praneeth Netrapalli , Sujay Sanghavi

This paper combines two ingredients in order to get a rather surprising result on one of the most studied, elegant and powerful tools for solving convex feasibility problems, the method of alternating projections (MAP). Going back to names…

Optimization and Control · Mathematics 2021-11-11 Roger Behling , Yunier Bello-Cruz , Luiz-Rafael Santos

The variational inequality problem in finite-dimensional Euclidean space is addressed in this paper, and two inexact variants of the extragradient method are proposed to solve it. Instead of computing exact projections on the constraint…

Optimization and Control · Mathematics 2024-06-24 R. Díaz Millán , O. P. Ferreira , J. Ugon

In this paper, we consider the convergence of an abstract inexact nonconvex and nonsmooth algorithm. We promise a pseudo sufficient descent condition and a pseudo relative error condition, which are both related to an auxiliary sequence,…

Optimization and Control · Mathematics 2018-11-29 Tao Sun , Hao Jiang , Lizhi Cheng , Wei Zhu

This paper proposes and develops inexact proximal methods for finding stationary points of the sum of a smooth function and a nonsmooth weakly convex one, where an error is present in the calculation of the proximal mapping of the nonsmooth…

Optimization and Control · Mathematics 2023-08-07 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat , Dat Ba Tran

In the numerical treatment of large-scale Sylvester and Lyapunov equations, projection methods require solving a reduced problem to check convergence. As the approximation space expands, this solution takes an increasing portion of the…

Numerical Analysis · Mathematics 2017-02-03 Davide Palitta , Valeria Simoncini

We study the convergence of specific inexact alternating projections for two non-convex sets in a Euclidean space. The $\sigma$-quasioptimal metric projection ($\sigma \geq 1$) of a point $x$ onto a set $A$ consists of points in $A$ the…

Optimization and Control · Mathematics 2025-09-09 Stanislav Budzinskiy

The classical Krasnoselskii-Mann iteration is broadly used for approximating fixed points of nonexpansive operators. To accelerate the convergence of the Krasnoselskii-Mann iteration, the inertial methods were received much attention in…

Functional Analysis · Mathematics 2020-01-09 Fuying Cui , Yang Yang , Yuchao Tang , Chuanxi Zhu

In this paper, we propose a new inexact version of the projected subgradient method to solve nondifferentiable constrained convex optimization problems. The method combine $\epsilon$-subgradient method with a procedure to obtain a feasible…

Optimization and Control · Mathematics 2020-06-17 Ademir Alves Aguiar , Orizon Pereira Ferreira , Leandro da Fonseca Prudente

We propose a framework for modeling and solving low-rank optimization problems to certifiable optimality. We introduce symmetric projection matrices that satisfy $Y^2=Y$, the matrix analog of binary variables that satisfy $z^2=z$, to model…

Optimization and Control · Mathematics 2021-12-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

In this paper, an inexact Newton method for solving real-valued nonlinear eigenvalue problems with eigenvector dependency (NEPv) is introduced that is able to solve the problem on a matrix level. Our main contribution is to derive a variant…

Numerical Analysis · Mathematics 2024-09-04 Tom Werner

This paper introduces new solvers for efficiently computing solutions to large-scale inverse problems with group sparsity regularization, including both non-overlapping and overlapping groups. Group sparsity regularization refers to a type…

Numerical Analysis · Mathematics 2023-06-16 Julianne Chung , Malena Sabaté Landman

We study the usage of regularity properties of collections of sets in convergence analysis of alternating projection methods for solving feasibility problems. Several equivalent characterizations of these properties are provided. Two…

Optimization and Control · Mathematics 2018-02-27 Alexander Y. Kruger , Nguyen H. Thao

In this paper, we consider solving a class of nonconvex and nonsmooth problems frequently appearing in signal processing and machine learning research. The traditional alternating direction method of multipliers encounters troubles in both…

Numerical Analysis · Computer Science 2018-10-17 Tao Sun , Hao Jiang , Lizhi Cheng , Wei Zhu

Gradient descent methods are fundamental first-order optimization algorithms in both Euclidean spaces and Riemannian manifolds. However, the exact gradient is not readily available in many scenarios. This paper proposes a novel inexact…

Optimization and Control · Mathematics 2024-09-18 Juan Zhou , Kangkang Deng , Hongxia Wang , Zheng Peng

This paper concerns the minimization of the composition of a nonsmooth convex function and a $\mathcal{C}^{1,1}$ mapping $F$ over a $\mathcal{C}^2$-smooth embedded closed submanifold $\mathcal{M}$. For this class of nonconvex and nonsmooth…

Optimization and Control · Mathematics 2026-05-12 Hao He , Ruyu Liu , Yitian Qian , Shaohua Pan

We establish sufficient conditions for finite convergence of the alternating projections method for two non-intersecting and potentially nonconvex sets. Our results are based on a generalization of the concept of intrinsic transversality,…

Optimization and Control · Mathematics 2021-02-18 Hoa T. Bui , Ryan Loxton , Asghar Moeini

Nonconvex regularization has been popularly used in low-rank matrix learning. However, extending it for low-rank tensor learning is still computationally expensive. To address this problem, we develop an efficient solver for use with a…

Machine Learning · Computer Science 2022-05-09 Quanming Yao , Yaqing Wang , Bo Han , James Kwok

We consider a variable metric linesearch based proximal gradient method for the minimization of the sum of a smooth, possibly nonconvex function plus a convex, possibly nonsmooth term. We prove convergence of this iterative algorithm to a…

Numerical Analysis · Mathematics 2017-04-11 Silvia Bonettini , Ignace Loris , Federica Porta , Marco Prato , Simone Rebegoldi

Feasibility problem aims to find a common point of two or more closed (convex) sets whose intersection is nonempty. In the literature, projection based algorithms are widely adopted to solve the problem, such as the method of alternating…

Optimization and Control · Mathematics 2025-04-16 Yuting Shen , Jingwei Liang