English
Related papers

Related papers: Solving Trust Region Subproblems Using Riemannian …

200 papers

We extend the classical primal-dual interior point method from the Euclidean setting to the Riemannian one. Our method, named the Riemannian interior point method, is for solving Riemannian constrained optimization problems. We establish…

Optimization and Control · Mathematics 2024-03-06 Zhijian Lai , Akiko Yoshise

Optimization of slow-time transmit sequence endows cognitive radar with the ability to suppress strong clutter in the range-Doppler domain. However, in practice, inaccurate target velocity information or random phase error would induce…

Signal Processing · Electrical Eng. & Systems 2024-04-17 Xinyu Zhang , Weidong Jiang , Xiangfeng Qiu , Yongxiang Liu

Since optimization on Riemannian manifolds relies on the chosen metric, it is appealing to know that how the performance of a Riemannian optimization method varies with different metrics and how to exquisitely construct a metric such that a…

Optimization and Control · Mathematics 2025-02-19 Bin Gao , Renfeng Peng , Ya-xiang Yuan

We consider variants of trust-region and cubic regularization methods for non-convex optimization, in which the Hessian matrix is approximated. Under mild conditions on the inexact Hessian, and using approximate solution of the…

Optimization and Control · Mathematics 2019-05-15 Peng Xu , Fred Roosta , Michael W. Mahoney

Riemannian meta-optimization provides a promising approach to solving non-linear constrained optimization problems, which trains neural networks as optimizers to perform optimization on Riemannian manifolds. However, existing Riemannian…

Machine Learning · Computer Science 2025-02-07 Peilin Yu , Yuwei Wu , Zhi Gao , Xiaomeng Fan , Yunde Jia

We consider optimization problems on manifolds with equality and inequality constraints. A large body of work treats constrained optimization in Euclidean spaces. In this work, we consider extensions of existing algorithms from the…

Optimization and Control · Mathematics 2019-04-26 Changshuo Liu , Nicolas Boumal

This paper considers the regularization continuation method and the trust-region updating strategy for the nonlinearly equality-constrained optimization problem. Namely, it uses the inverse of the regularization quasi-Newton matrix as the…

Optimization and Control · Mathematics 2023-08-07 Xin-long Luo , Hang Xiao , Sen Zhang

Update formulas for the Hessian approximations in quasi-Newton methods such as BFGS can be derived as analytical solutions to certain nearest-matrix problems. In this article, we propose a similar idea for deriving new limited memory…

Optimization and Control · Mathematics 2024-03-06 Erik Berglund , Mikael Johansson

We investigate the problem of recovering a partially observed high-rank matrix whose columns obey a nonlinear structure such as a union of subspaces, an algebraic variety or grouped in clusters. The recovery problem is formulated as the…

Machine Learning · Statistics 2022-12-12 Florentin Goyens , Coralia Cartis , Armin Eftekhari

We develop a trust-region method for efficiently minimizing the sum of a smooth function, a nonsmooth convex function, and the composition of a finite-valued support function with a smooth function. Optimization problems with this structure…

Optimization and Control · Mathematics 2026-04-09 Drew P. Kouri

This paper presents strong worst-case iteration and operation complexity guarantees for Riemannian adaptive regularized Newton methods, a unified framework encompassing both Riemannian adaptive regularization (RAR) methods and Riemannian…

Optimization and Control · Mathematics 2025-05-14 Chenyu Zhang , Rujun Jiang

We consider the problem of recovering a complete (i.e., square and invertible) matrix $\mathbf A_0$, from $\mathbf Y \in \mathbb{R}^{n \times p}$ with $\mathbf Y = \mathbf A_0 \mathbf X_0$, provided $\mathbf X_0$ is sufficiently sparse.…

Information Theory · Computer Science 2017-01-20 Ju Sun , Qing Qu , John Wright

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

Optimization and Control · Mathematics 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

In this paper, we study a few challenging theoretical and numerical issues on the well known trust region policy optimization for deep reinforcement learning. The goal is to find a policy that maximizes the total expected reward when the…

Optimization and Control · Mathematics 2019-11-27 Mingming Zhao , Yongfeng Li , Zaiwen Wen

We propose a novel Riemannian method for solving the Extreme multi-label classification problem that exploits the geometric structure of the sparse low-dimensional local embedding models. A constrained optimization problem is formulated as…

Optimization and Control · Mathematics 2021-10-01 Jayadev Naram , Tanmay Kumar Sinha , Pawan Kumar

In this work, we present a heretofore unseen application of Ising machines to perform trust region-based optimisation with box constraints. This is done by considering a specific form of opto-electronic oscillator-based coherent Ising…

Emerging Technologies · Computer Science 2024-07-09 Sayantan Pramanik , Kaumudibikash Goswami , Sourav Chatterjee , M Girish Chandra

In this paper, we propose and analyze a trust-region model-based algorithm for solving unconstrained stochastic optimization problems. Our framework utilizes random models of an objective function $f(x)$, obtained from stochastic…

Optimization and Control · Mathematics 2016-09-26 Ruobing Chen , Matt Menickelly , Katya Scheinberg

In this letter we model the Haplotype assembly problem (HAP) as a maximization problem over an $(n-1)$-dimensional sphere. Due to nonconvexity of the feasible set, we propose a manifold optimization approach to solve the mentioned…

Optimization and Control · Mathematics 2019-06-11 Mohamad Mahdi Mohades , Mohammad Hossein Kahaei

This paper proposes a general framework of Riemannian adaptive optimization methods. The framework encapsulates several stochastic optimization algorithms on Riemannian manifolds and incorporates the mini-batch strategy that is often used…

Optimization and Control · Mathematics 2025-02-14 Hiroyuki Sakai , Hideaki Iiduka

The goal of tensor completion is to fill in missing entries of a partially known tensor under a low-rank constraint. In this paper, we mainly study low rank third-order tensor completion problems by using Riemannian optimization methods on…

Optimization and Control · Mathematics 2020-11-24 Guang-Jing Song , Xue-Zhong Wang , Michael K. Ng