English
Related papers

Related papers: Rank-one Riemannian Subspace Descent for Nonlinear…

200 papers

This paper introduces a new robust interior point method analysis for semidefinite programming (SDP). This new robust analysis can be combined with either logarithmic barrier or hybrid barrier. Under this new framework, we can improve the…

Optimization and Control · Mathematics 2021-11-22 Baihe Huang , Shunhua Jiang , Zhao Song , Runzhou Tao , Ruizhe Zhang

We introduce the manifold of {\it restricted} $n\times n$ positive semidefinite matrices of fixed rank $p$, denoted $S(n,p)^{*}$. The manifold itself is an open and dense submanifold of $S(n,p)$, the manifold of $n\times n$ positive…

Differential Geometry · Mathematics 2023-04-04 A. Martina Neuman , Yuying Xie , Qiang Sun

Grover's algorithm is a fundamental quantum algorithm that offers a quadratic speedup for the unstructured search problem by alternately applying physically implementable oracle and diffusion operators. In this paper, we reformulate the…

Quantum Physics · Physics 2025-12-15 Zhijian Lai , Dong An , Jiang Hu , Zaiwen Wen

Grover's algorithm is a fundamental quantum algorithm that achieves a quadratic speedup for unstructured search problems of size $N$. Recent studies have reformulated this task as a maximization problem on the unitary manifold and solved it…

Quantum Physics · Physics 2026-04-06 Zhijian Lai , Dong An , Jiang Hu , Zaiwen Wen

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

Optimization and Control · Mathematics 2023-02-07 Junhyung Lyle Kim , JA Lara Benitez , Mohammad Taha Toghani , Cameron Wolfe , Zhiwei Zhang , Anastasios Kyrillidis

Direct search methods represent a robust and reliable class of algorithms for solving black-box optimization problems. In this paper, we explore the application of those strategies to Riemannian optimization, wherein minimization is to be…

Optimization and Control · Mathematics 2022-02-23 Vyacheslav Kungurtsev , Francesco Rinaldi , Damiano Zeffiro

Gradient descent with momentum has been widely applied in various signal processing and machine learning tasks, demonstrating a notable empirical advantage over standard gradient descent. However, momentum-based distributed Riemannian…

Optimization and Control · Mathematics 2026-02-17 Jun Chen , Tianyi Zhu , Haishan Ye , Lina Liu , Guang Dai , Yong Liu , Yunliang Jiang , Ivor W. Tsang

We propose a fast, simple and robust algorithm for computing shortest paths and distances on Riemannian manifolds learned from data. This amounts to solving a system of ordinary differential equations (ODEs) subject to boundary conditions.…

Machine Learning · Statistics 2019-01-23 Georgios Arvanitidis , Søren Hauberg , Philipp Hennig , Michael Schober

There is extensive literature on accelerating first-order optimization methods in a Euclidean setting. Under which conditions such acceleration is feasible in Riemannian optimization problems is an active area of research. Motivated by the…

Optimization and Control · Mathematics 2025-09-23 Jiyoung Park , Abhishek Roy , Jonathan W. Siegel , Anirban Bhattacharya

We have recently presented a method to solve an overdetermined linear system of equations with multiple right hand side vectors, where the unknown matrix is to be symmetric and positive definite. The coefficient and the right hand side…

Optimization and Control · Mathematics 2014-09-19 Negin Bagherpour , Nezam Mahdavi-Amiri

An iterative algorithm is presented for soft-input-soft-output (SISO) decoding of Reed-Solomon (RS) codes. The proposed iterative algorithm uses the sum product algorithm (SPA) in conjunction with a binary parity check matrix of the RS…

Information Theory · Computer Science 2009-09-29 Jing Jiang , Krishna R. Narayanan

We consider dynamic algorithms for maintaining Single-Source Reachability (SSR) and approximate Single-Source Shortest Paths (SSSP) on $n$-node $m$-edge directed graphs under edge deletions (decremental algorithms). The previous fastest…

Data Structures and Algorithms · Computer Science 2018-03-02 Monika Henzinger , Sebastian Krinninger , Danupon Nanongkai

We present a fast direct solver for structured linear systems based on multilevel matrix compression. Using the recently developed interpolative decomposition of a low-rank matrix in a recursive manner, we embed an approximation of the…

Numerical Analysis · Mathematics 2014-04-10 Kenneth L. Ho , Leslie Greengard

Image set-based visual classification methods have achieved remarkable performance, via characterising the image set in terms of a non-singular covariance matrix on a symmetric positive definite (SPD) manifold. To adapt to complicated…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Rui Wang , Xiao-Jun Wu , Ziheng Chen , Tianyang Xu , Josef Kittler

Matrices arising in scientific applications frequently admit linear low-rank approximations due to smoothness in the physical and/or temporal domain of the problem. In large-scale problems, computing an optimal low-rank approximation can be…

Numerical Analysis · Mathematics 2021-05-05 Alec Michael Dunton , Alireza Doostan

The numerical solution of partial differential equations on high-dimensional domains gives rise to computationally challenging linear systems. When using standard discretization techniques, the size of the linear system grows exponentially…

Numerical Analysis · Mathematics 2015-08-13 Daniel Kressner , Michael Steinlechner , Bart Vandereycken

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

Machine Learning · Statistics 2024-03-07 Xiao Ling , Paul Brooks

In this paper, we present several descent methods that can be applied to nonnegative matrix factorization and we analyze a recently developped fast block coordinate method called Rank-one Residue Iteration (RRI). We also give a comparison…

Numerical Analysis · Computer Science 2009-08-25 Ngoc-Diep Ho , Paul Van Dooren , Vincent D. Blondel

We propose an efficient ADMM method with guarantees for high-dimensional problems. We provide explicit bounds for the sparse optimization problem and the noisy matrix decomposition problem. For sparse optimization, we establish that the…

Machine Learning · Computer Science 2015-07-08 Hanie Sedghi , Anima Anandkumar , Edmond Jonckheere

Numerical resolution of high-dimensional nonlinear PDEs remains a huge challenge due to the curse of dimensionality. Starting from the weak formulation of the Lawson-Euler scheme, this paper proposes a stochastic particle method (SPM) by…

Numerical Analysis · Mathematics 2025-02-11 Zhengyang Lei , Sihong Shao , Yunfeng Xiong