English
Related papers

Related papers: A Spectral Gradient Projection Method for the Posi…

200 papers

Semidefinite programming (SDP) is a central topic in mathematical optimization with extensive studies on its efficient solvers. In this paper, we present a proof-of-principle sublinear-time algorithm for solving SDPs with low-rank…

Data Structures and Algorithms · Computer Science 2020-08-07 Nai-Hui Chia , Tongyang Li , Han-Hsuan Lin , Chunhao Wang

In 2020, Yamakawa and Okuno proposed a stabilized sequential quadratic semidefinite programming (SQSDP) method for solving, in particular, degenerate nonlinear semidefinite optimization problems. The algorithm is shown to converge globally…

Optimization and Control · Mathematics 2022-04-04 Kosuke Okabe , Yuya Yamakawa , Ellen H. Fukuda

Many recent problems in signal processing and machine learning such as compressed sensing, image restoration, matrix/tensor recovery, and non-negative matrix factorization can be cast as constrained optimization. Projected gradient descent…

Optimization and Control · Mathematics 2022-09-07 Trung Vu , Raviv Raich

We consider both facial reduction, \FRp, and symmetry reduction, \SRp, techniques for semidefinite programming, \SDPp. We show that the two together fit surprisingly well in an alternating direction method of multipliers, \ADMMp, approach.…

Optimization and Control · Mathematics 2022-02-04 Hao Hu , Renata Sotirov , Henry Wolkowicz

In this paper, we propose projected gradient descent (PGD) algorithms for signal estimation from noisy nonlinear measurements. We assume that the unknown $p$-dimensional signal lies near the range of an $L$-Lipschitz continuous generative…

Machine Learning · Statistics 2022-09-22 Zhaoqiang Liu , Jun Han

We present a finite-horizon optimization algorithm that extends the established concept of Dual Dynamic Programming (DDP) in two ways. First, in contrast to the linear costs, dynamics, and constraints of standard DDP, we consider problems…

Optimization and Control · Mathematics 2018-07-17 Marc Hohmann , Joseph Warrington , John Lygeros

Many nonconvex problems in robotics can be relaxed into convex formulations via Semi-Definite Programming (SDP) that can be solved to global optimality. The practical quality of these solutions, however, critically depends on rounding them…

Robotics · Computer Science 2025-10-02 Liangting Wu , Roberto Tron

We propose new quantum algorithms for estimating spectral sums of positive semi-definite (PSD) matrices. The spectral sum of an PSD matrix $A$, for a function $f$, is defined as $ \text{Tr}[f(A)] = \sum_j f(\lambda_j)$, where $\lambda_j$…

Quantum Physics · Physics 2024-06-11 Alessandro Luongo , Changpeng Shao

In this paper, we propose a new efficient method for a sparse Gaussian graphical model with hidden clustering structures by extending a dual spectral projected gradient (DSPG) method proposed by Nakagaki et al.~(2020). We establish the…

Optimization and Control · Mathematics 2024-06-19 Charles Namchaisiri , Tianxiang Liu , Makoto Yamashita

We present semi-decentralized and distributed algorithms, designed via a preconditioned forward-backward operator splitting, for solving large-scale, decomposable semidefinite programs (SDPs). We exploit a chordal aggregate sparsity pattern…

Optimization and Control · Mathematics 2019-11-19 Filippo Fabiani , Sergio Grammatico

In this paper, we propose a parallel shooting algorithm for solving nonlinear model predictive control problems using sequential quadratic programming. This algorithm is built on a two-phase approach where we first test and assess…

Systems and Control · Electrical Eng. & Systems 2023-07-21 P. C. N. Verheijen , M. Haghi , M. Lazar , D. Goswami

This article proposes an efficient numerical method for solving nonlinear partial differential equations (PDEs) based on sparse Gaussian processes (SGPs). Gaussian processes (GPs) have been extensively studied for solving PDEs by…

Numerical Analysis · Mathematics 2023-08-09 Rui Meng , Xianjin Yang

The proximal gradient algorithm has been popularly used for convex optimization. Recently, it has also been extended for nonconvex problems, and the current state-of-the-art is the nonmonotone accelerated proximal gradient algorithm.…

Optimization and Control · Mathematics 2017-05-24 Quanming Yao , James T. Kwok , Fei Gao , Wei Chen , Tie-Yan Liu

The stable principal component pursuit (SPCP) problem is a non-smooth convex optimization problem, the solution of which has been shown both in theory and in practice to enable one to recover the low rank and sparse components of a matrix…

Optimization and Control · Mathematics 2015-03-19 Necdet Serhat Aybat , Donald Goldfarb , Garud Iyengar

The proximal stochastic gradient method (PSGD) is one of the state-of-the-art approaches for stochastic composite-type problems. In contrast to its deterministic counterpart, PSGD has been found to have difficulties with the correct…

Optimization and Control · Mathematics 2026-03-04 Junwen Qiu , Li Jiang , Andre Milzarek

In this paper we investigate the numerical solution of stochastic partial differential equations (SPDEs) for a wider class of stochastic equations. We focus on non-diagonal colored noise instead of the usual space-time white noise. By…

Numerical Analysis · Mathematics 2013-11-12 Dirk Blömker , Minoo Kamrani

Procrustes problems are matrix approximation problems searching for a~transformation of the given dataset to fit another dataset. They find applications in numerous areas, such as factor and multivariate analysis, computer vision,…

Optimization and Control · Mathematics 2023-05-01 Terézia Fulová , Mária Trnovská

A matrix optimization problem over an uncertain linear system on finite horizon (abbreviated as MOPUL) is studied, in which the uncertain transition matrix is regarded as a decision variable. This problem is in general NP-hard. By using the…

Optimization and Control · Mathematics 2023-10-31 Jintao Xu , Shu-Cherng Fang , Wenxun Xing

Recently proposed numerical algorithms for solving high-dimensional nonlinear partial differential equations (PDEs) based on neural networks have shown their remarkable performance. We review some of them and study their convergence…

Analysis of PDEs · Mathematics 2021-09-17 Maximilien Germain , Huyen Pham , Xavier Warin

Semidefinite programs (SDPs) can be solved in polynomial time by interior point methods, but scalability can be an issue. To address this shortcoming, over a decade ago, Burer and Monteiro proposed to solve SDPs with few equality…

Optimization and Control · Mathematics 2018-04-12 Nicolas Boumal , Vladislav Voroninski , Afonso S. Bandeira