English
Related papers

Related papers: Local convergence of alternating low-rank optimiza…

200 papers

We propose Regularized Overestimated Newton (RON), a Newton-type method with low per-iteration cost and strong global and local convergence guarantees for smooth convex optimization. RON interpolates between gradient descent and globally…

Optimization and Control · Mathematics 2025-10-02 Danny Duan , Hanbaek Lyu

A local convergence rate is established for a Gauss orthogonal collocation method applied to optimal control problems with control constraints. If the Hamiltonian possesses a strong convexity property, then the theory yields convergence for…

Numerical Analysis · Mathematics 2018-09-17 William W. Hager , Jun Liu , Subhashree Mohapatra , Anil V. Rao , Xiang-Sheng Wang

In recent studies, the tensor ring (TR) rank has shown high effectiveness in tensor completion due to its ability of capturing the intrinsic structure within high-order tensors. A recently proposed TR rank minimization method is based on…

Computer Vision and Pattern Recognition · Computer Science 2020-05-21 Meng Ding , Ting-Zhu Huang , Xi-Le Zhao , Tian-Hui Ma

The existing matrix completion methods focus on optimizing the relaxation of rank function such as nuclear norm, Schatten-p norm, etc. They usually need many iterations to converge. Moreover, only the low-rank property of matrices is…

Machine Learning · Computer Science 2022-03-07 Xuelong Li , Hongyuan Zhang , Rui Zhang

Low-rank tensor methods for the approximate solution of second-order elliptic partial differential equations in high dimensions have recently attracted significant attention. A critical issue is to rigorously bound the error of such…

Numerical Analysis · Mathematics 2014-12-15 Markus Bachmayr , Wolfgang Dahmen

Tensor network contractions are widely used in statistical physics, quantum computing, and computer science. We introduce a method to efficiently approximate tensor network contractions using low-rank approximations, where each intermediate…

Quantum Physics · Physics 2025-01-01 Linjian Ma , Matthew Fishman , Miles Stoudenmire , Edgar Solomonik

In this paper, to solve a broad class of complex symmetric linear systems, we recast the complex system in a real formulation and apply the generalized successive overrelaxation (GSOR) iterative method to the equivalent real system. We then…

Numerical Analysis · Mathematics 2014-03-25 Davod Khojasteh Salkuyeh , Davod Hezari , Vahid Edalatpour

Due to the multi-linearity of tensors, most algorithms for tensor optimization problems are designed based on the block coordinate descent method. Such algorithms are widely employed by practitioners for their implementability and…

Optimization and Control · Mathematics 2022-01-14 Ke Ye , Shenglong Hu

The local relaxation algorithm is promising for fast solution of Poisson's equations, which computes the electric field distribution in a stepwise manner via local curl-free updates while strictly enforcing Gauss's law. We propose a novel…

Numerical Analysis · Mathematics 2026-03-04 Zhenli Xu , Qian Yin , Hongyu Zhou

We study the finite convergence of iterative methods for solving convex feasibility problems. Our key assumptions are that the interior of the solution set is nonempty and that certain overrelaxation parameters converge to zero, but with a…

Optimization and Control · Mathematics 2021-07-13 Victor I. Kolobov , Simeon Reich , Rafał Zalas

Anisotropic rotation averaging has recently been explored as a natural extension of respective isotropic methods. In the anisotropic formulation, uncertainties of the estimated relative rotations -- obtained via standard two-view…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Yaroslava Lochman , Carl Olsson , Christopher Zach

Efficient probabilistic inference by variable elimination in graphical models requires an optimal elimination order. However, finding an optimal order is a challenging combinatorial optimisation problem for models with a large number of…

Artificial Intelligence · Computer Science 2025-03-13 Sagad Hamid , Tanya Braun

We present a general approach to rounding semidefinite programming relaxations obtained by the Sum-of-Squares method (Lasserre hierarchy). Our approach is based on using the connection between these relaxations and the Sum-of-Squares proof…

Data Structures and Algorithms · Computer Science 2013-12-24 Boaz Barak , Jonathan Kelner , David Steurer

In this paper we suggest a new algorithm for the computation of a best rank one approximation of tensors, called alternating singular value decomposition. This method is based on the computation of maximal singular values and the…

Numerical Analysis · Mathematics 2015-03-19 S. Friedland , V. Mehrmann , R. Pajarola , S. K. Suter

In this contribution, we are concerned with parameter optimization problems that are constrained by multiscale PDE state equations. As an efficient numerical solution approach for such problems, we introduce and analyze a new relaxed and…

Numerical Analysis · Mathematics 2023-04-13 Tim Keil , Mario Ohlberger

Alternating minimization heuristics seek to solve a (difficult) global optimization task through iteratively solving a sequence of (much easier) local optimization tasks on different parts (or blocks) of the input parameters. While popular…

Computational Complexity · Computer Science 2020-03-10 Peter Bürgisser , Ankit Garg , Rafael Oliveira , Michael Walter , Avi Wigderson

This paper describes a flexible framework for generalized low-rank tensor estimation problems that includes many important instances arising from applications in computational imaging, genomics, and network analysis. The proposed estimator…

Statistics Theory · Mathematics 2021-02-08 Rungang Han , Rebecca Willett , Anru R. Zhang

Identifying locally optimal solutions is an important issue given an optimization model. In this paper, we focus on a special class of symmetric tensors termed regular simplex tensors, which is a newly-emerging concept, and investigate its…

Optimization and Control · Mathematics 2024-02-20 Lei Wang

This paper considers the recovery of a rank $r$ positive semidefinite matrix $X X^T\in\mathbb{R}^{n\times n}$ from $m$ scalar measurements of the form $y_i := a_i^T X X^T a_i$ (i.e., quadratic measurements of $X$). Such problems arise in a…

Numerical Analysis · Mathematics 2016-06-02 Chris D. White , Sujay Sanghavi , Rachel Ward

We address the sensor network localization problem given noisy range measurements between pairs of nodes. We approach the non-convex maximum-likelihood formulation via a known simple convex relaxation. We exploit its favorable optimization…

Optimization and Control · Mathematics 2015-09-30 Cláudia Soares , João Xavier , João Gomes