English
Related papers

Related papers: Sequential subspace methods on Stiefel manifold op…

200 papers

This paper presents a stabilized sequential quadratic programming (SQP) method for solving optimization problems in Banach spaces. The optimization problem considered in this study has a general form that enables us to represent various…

Optimization and Control · Mathematics 2025-06-03 Yuya Yamakawa

We consider optimization problems on Riemannian manifolds with equality and inequality constraints, which we call Riemannian nonlinear optimization (RNLO) problems. Although they have numerous applications, the existing studies on them are…

Optimization and Control · Mathematics 2021-06-16 Mitsuaki Obara , Takayuki Okuno , Akiko Takeda

We address the non-convex optimisation problem of finding a sparse matrix on the Stiefel manifold (matrices with mutually orthogonal columns of unit length) that maximises (or minimises) a quadratic objective function. Optimisation problems…

Optimization and Control · Mathematics 2021-10-04 Florian Bernard , Daniel Cremers , Johan Thunberg

In this paper, we propose a robust subspace-constrained quadratic model (SCQM) for learning low-dimensional structure from high-dimensional data. Building upon the subspace-constrained quadratic matrix factorization (SQMF) framework, the…

Machine Learning · Computer Science 2026-05-21 Zheng Zhai , Xiaohui Li

We have recently presented a method to solve an overdetermined linear system of equations with multiple right hand side vectors, where the unknown matrix is to be symmetric and positive definite. The coefficient and the right hand side…

Optimization and Control · Mathematics 2014-09-19 Negin Bagherpour , Nezam Mahdavi-Amiri

In this paper, we propose a trust-region interior-point stochastic sequential quadratic programming (TR-IP-SSQP) method for solving optimization problems with a stochastic objective and deterministic nonlinear equality and inequality…

Optimization and Control · Mathematics 2026-03-12 Yuchen Fang , Jihun Kim , Sen Na , James Demmel , Javad Lavaei

Various tasks in scientific computing can be modeled as an optimization problem on the indefinite Stiefel manifold. We address this using the Riemannian approach, which basically consists of equipping the feasible set with a Riemannian…

Optimization and Control · Mathematics 2026-04-17 Dinh Van Tiep , Duong Thi Viet An , Nguyen Thi Ngoc Oanh , Nguyen Thanh Son

We address the problem of computing the smallest symplectic eigenvalues and the corresponding eigenvectors of symmetric positive-definite matrices in the sense of Williamson's theorem. It is formulated as minimizing a trace cost function…

Optimization and Control · Mathematics 2022-01-06 Nguyen Thanh Son , P. -A. Absil , Bin Gao , Tatjana Stykel

We study optimization over Riemannian embedded submanifolds, where the objective function is relatively smooth in the ambient Euclidean space. Such problems have broad applications but are still largely unexplored. We introduce two…

Optimization and Control · Mathematics 2025-08-08 Chang He , Jiaxiang Li , Bo Jiang , Shiqian Ma , Shuzhong Zhang

The symplectic Stiefel manifold, denoted by $\mathrm{Sp}(2p,2n)$, is the set of linear symplectic maps between the standard symplectic spaces $\mathbb{R}^{2p}$ and $\mathbb{R}^{2n}$. When $p=n$, it reduces to the well-known set of $2n\times…

Optimization and Control · Mathematics 2021-07-20 Bin Gao , Nguyen Thanh Son , P. -A. Absil , Tatjana Stykel

We introduce a new sequential subspace optimization method for large-scale saddle-point problems. It solves iteratively a sequence of auxiliary saddle-point problems in low-dimensional subspaces, spanned by directions derived from…

Optimization and Control · Mathematics 2020-08-24 Yoni Choukroun , Michael Zibulevsky , Pavel Kisilev

Among the most famous algorithms for solving classification problems are support vector machines (SVMs), which find a separating hyperplane for a set of labeled data points. In some applications, however, labels are only available for a…

Optimization and Control · Mathematics 2023-10-17 Jan Pablo Burgard , Maria Eduarda Pinheiro , Martin Schmidt

We consider the optimization problem with a generally quadratic matrix constraint of the form $X^TAX = J$, where $A$ is a given nonsingular, symmetric $n\times n$ matrix and $J$ is a given $k\times k$ symmetric matrix, with $k\leq n$,…

Optimization and Control · Mathematics 2026-05-26 Dinh Van Tiep , Nguyen Thanh Son

In this paper,we propose a Multi-Objective Sequential Quadratic Programming (MOSQP) algorithm for constrained multi-objective optimization problems,basd on a low-order smooth penalty function as the merit function for line search. The…

Optimization and Control · Mathematics 2025-03-13 Zanyang Kong

Many real-world datasets live on high-dimensional Stiefel and Grassmannian manifolds, $V_k(\mathbb{R}^N)$ and $Gr(k, \mathbb{R}^N)$ respectively, and benefit from projection onto lower-dimensional Stiefel and Grassmannian manifolds. In this…

Computational Geometry · Computer Science 2025-04-16 Andrew Lee , Harlin Lee , Jose A. Perea , Nikolas Schonsheck , Madeleine Weinstein

In this paper, we consider the composite optimization problems over the Stiefel manifold. A successful method to solve this class of problems is the proximal gradient method proposed by Chen et al. Motivated by the proximal Newton-type…

Optimization and Control · Mathematics 2025-01-17 Qinsi Wang , Wei Hong Yang

We consider a degenerate nonsmooth and nonconvex optimization problem for which the standard constraint qualification such as the generalized Mangasarian Fromovitz constraint qualification (GMFCQ) may not hold. We use smoothing functions…

Optimization and Control · Mathematics 2014-06-05 Mengwei Xu , Jane Ye , Liwei Zhang

We propose a sequential minimal optimization method for quantum-classical hybrid algorithms, which converges faster, is robust against statistical error, and is hyperparameter-free. Specifically, the optimization problem of the…

Quantum Physics · Physics 2020-11-04 Ken M. Nakanishi , Keisuke Fujii , Synge Todo

In this paper, we study the generalized problem that minimizes or maximizes a multi-order complex quadratic form with constant-modulus constraints on all elements of its optimization variable. Such a mathematical problem is commonly…

Signal Processing · Electrical Eng. & Systems 2025-08-28 Chunxuan Shi , Yongzhe Li , Ran Tao

Subspace segmentation or subspace learning is a challenging and complicated task in machine learning. This paper builds a primary frame and solid theoretical bases for the minimal subspace segmentation (MSS) of finite samples. Existence and…

Machine Learning · Computer Science 2019-09-10 Zhenyue Zhang , Yuqing Xia