English
Related papers

Related papers: Sequential Quadratic Optimization for Nonlinear Op…

200 papers

This paper aims to investigate the distributed stochastic optimization problems on compact embedded submanifolds (in the Euclidean space) for multi-agent network systems. To address the manifold structure, we propose a distributed…

Optimization and Control · Mathematics 2025-10-28 Jishu Zhao , Xi Wang , Jinlong Lei , Shixiang Chen

Adaptive stochastic gradient algorithms in the Euclidean space have attracted much attention lately. Such explorations on Riemannian manifolds, on the other hand, are relatively new, limited, and challenging. This is because of the…

Machine Learning · Computer Science 2019-07-01 Hiroyuki Kasai , Pratik Jawanpuria , Bamdev Mishra

In this paper, we introduce the notion of generalized $\epsilon$-stationarity for a class of nonconvex and nonsmooth composite minimization problems on compact Riemannian submanifold embedded in Euclidean space. To find a generalized…

Optimization and Control · Mathematics 2023-10-31 Zheng Peng , Weihe Wu , Jiang Hu , Kangkang Deng

We solve the Dirichlet problem for fully nonlinear elliptic equations on Riemannian manifolds under essentially optimal structure conditions, especially with no restrictions to the curvature of the underlying manifold and the second…

Analysis of PDEs · Mathematics 2018-08-30 Bo Guan

Least squares form one of the most prominent classes of optimization problems, with numerous applications in scientific computing and data fitting. When such formulations aim at modeling complex systems, the optimization process must…

Optimization and Control · Mathematics 2021-05-31 E. Bergou , Y. Diouane , V. Kungurtsev , C. W. Royer

In this paper, we present two novel manifold inexact augmented Lagrangian methods, \textbf{ManIAL} for deterministic settings and \textbf{StoManIAL} for stochastic settings, solving nonsmooth manifold optimization problems. By using the…

Optimization and Control · Mathematics 2024-04-30 Kangkang Deng , Jiang Hu , Jiayuan Wu , Zaiwen Wen

The prospect of quantum solutions for complicated optimization problems is contingent on mapping the original problem onto a tractable quantum energy landscape, e.g. an Ising-type Hamiltonian. Subsequently, techniques like adiabatic…

Quantum Physics · Physics 2025-10-17 Sebastian Egginger , Kristina Kirova , Sonja Bruckner , Stefan Hillmich , Richard Kueng

We consider the following constrained Rayleigh quotient optimization problem (CRQopt) $$ \min_{x\in \mathbb{R}^n} x^{T}Ax\,\,\mbox{subject to}\,\, x^{T}x=1\,\mbox{and}\,C^{T}x=b, $$ where $A$ is an $n\times n$ real symmetric matrix and $C$…

Numerical Analysis · Mathematics 2019-11-11 Yunshen Zhou , Zhaojun Bai , Ren-Cang Li

We consider online statistical inference of constrained stochastic nonlinear optimization problems. We apply the Stochastic Sequential Quadratic Programming (StoSQP) method to solve these problems, which can be regarded as applying…

Optimization and Control · Mathematics 2025-02-19 Sen Na , Michael W. Mahoney

Nonlinear differential equations model diverse phenomena but are notoriously difficult to solve. While there has been extensive previous work on efficient quantum algorithms for linear differential equations, the linearity of quantum…

In this study, we investigate stochastic optimization on Riemannian manifolds, focusing on the crucial variance reduction mechanism used in both Euclidean and Riemannian settings. Riemannian variance-reduced methods usually involve a…

Machine Learning · Computer Science 2024-03-12 Yury Demidovich , Grigory Malinovsky , Peter Richtárik

Existing methods for solving Riemannian bilevel optimization (RBO) problems require prior knowledge of the problem's first- and second-order information and curvature parameter of the Riemannian manifold to determine step sizes, which poses…

Optimization and Control · Mathematics 2025-10-14 Xu Shi , Rufeng Xiao , Rujun Jiang

A specialized algorithm for quadratic optimization (QO, or, formerly, QP) with disjoint linear constraints is presented. In the considered class of problems, a subset of variables are subject to linear equality constraints, while variables…

Optimization and Control · Mathematics 2019-09-12 Tijana Janjic , Yvonne Ruckstuhl , Philippe L. Toint

In recent years, stochastic variance reduction algorithms have attracted considerable attention for minimizing the average of a large but finite number of loss functions. This paper proposes a novel Riemannian extension of the Euclidean…

Machine Learning · Computer Science 2019-06-03 Hiroyuki Sato , Hiroyuki Kasai , Bamdev Mishra

We study a class of optimization problems on Riemannian manifolds, where the objective function consists of a smooth term and quasi-norm type penalties with exponent $p \in (0, 1]$. The essential difficulty lies in the fact that the…

Optimization and Control · Mathematics 2026-04-21 Lei Wang , Xiaojun Chen

The standard approach to encoding constraints in quantum optimization is the quadratic penalty method. Quadratic penalties introduce additional couplings and energy scales, which can be detrimental to the performance of a quantum optimizer.…

Quantum Physics · Physics 2024-12-17 Puya Mirkarimi , David C. Hoyle , Ross Williams , Nicholas Chancellor

We propose a rank-one Riemannian subspace descent algorithm for computing symmetric positive definite (SPD) solutions to nonlinear matrix equations arising in control theory, dynamic programming, and stochastic filtering. For solution…

Numerical Analysis · Mathematics 2026-01-22 Yogesh Darmwal , Ketan Rajawat

We present a quantum-inspired tensor network algorithm for solving tridiagonal Quadratic Unconstrained Binary Optimization (QUBO) problems and quadratic unconstrained discrete optimization (QUDO) problems. We also solve the more general…

Stochastic variance reduction algorithms have recently become popular for minimizing the average of a large, but finite, number of loss functions. In this paper, we propose a novel Riemannian extension of the Euclidean stochastic variance…

Machine Learning · Computer Science 2017-04-11 Hiroyuki Kasai , Hiroyuki Sato , Bamdev Mishra

Constrained combinatorial optimization problems are frequently reformulated as quadratic unconstrained binary optimization (QUBO) models in order to leverage emerging quantum optimization algorithms such as the Variational Quantum…

Quantum Physics · Physics 2026-04-23 Xin Wei Lee , Hoong Chuin Lau