English
Related papers

Related papers: Riemannian optimal identification method for linea…

200 papers

The joint approximate diagonalization of non-commuting symmetric matrices is an important process in independent component analysis. This problem can be formulated as an optimization problem on the Stiefel manifold that can be solved using…

Optimization and Control · Mathematics 2022-02-28 Hiroyuki Sato

The effectiveness of dimensionality reduction with quadratic manifolds hinges on the choice of a reduced basis and the associated quadratic correction terms. Existing approaches typically rely on subspaces spanned by the leading principal…

Numerical Analysis · Mathematics 2026-05-27 Gavin Paxton , Seunghee Cheon , Rudy Geelen , Shane A. McQuarrie

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

Optimization and Control · Mathematics 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

Low-rank optimization problems with sparse simplex constraints involve variables that must satisfy nonnegativity, sparsity, and sum-to-1 conditions, making their optimization particularly challenging due to the interplay between low-rank…

Optimization and Control · Mathematics 2026-03-24 Flavia Esposito , Andersen Ang

This paper investigates the optimal $H_2$ model order reduction for linear systems with quadratic outputs. In the framework of Galerkin projection, we first formulate the optimal $H_2$ MOR as an unconstrained Riemannian optimization problem…

Optimization and Control · Mathematics 2025-04-16 Xiaolong Wang , Tongtu Tian

Riemannian submanifold optimization with momentum is computationally challenging because, to ensure that the iterates remain on the submanifold, we often need to solve difficult differential equations. Here, we simplify such difficulties…

Machine Learning · Statistics 2024-03-19 Wu Lin , Valentin Duruisseaux , Melvin Leok , Frank Nielsen , Mohammad Emtiyaz Khan , Mark Schmidt

We tackle the problem of system identification, where we select inputs, observe the corresponding outputs from the true system, and optimize the parameters of our model to best fit the data. We propose a practical and computationally…

Systems and Control · Electrical Eng. & Systems 2025-10-02 Alexandros E. Tzikas , Mykel J. Kochenderfer

Proximal methods are known to identify the underlying substructure of nonsmooth optimization problems. Even more, in many interesting situations, the output of a proximity operator comes with its structure at no additional cost, and…

Optimization and Control · Mathematics 2023-02-10 Gilles Bareilles , Franck Iutzeler , Jérôme Malick

This work is concerned with the numerical solution of large-scale symmetric positive definite matrix equations of the form $A_1XB_1^\top + A_2XB_2^\top + \dots + A_\ell X B_\ell^\top = F$, as they arise from discretized partial differential…

Numerical Analysis · Mathematics 2024-12-04 Ivan Bioli , Daniel Kressner , Leonardo Robol

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

By restricting the iterate on a nonlinear manifold, the recently proposed Riemannian optimization methods prove to be both efficient and effective in low rank tensor completion problems. However, existing methods fail to exploit the easily…

Machine Learning · Statistics 2017-02-24 Tengfei Zhou , Hui Qian , Zebang Shen , Congfu Xu

We propose an extremely versatile approach to address a large family of matrix nearness problems, possibly with additional linear constraints. Our method is based on splitting a matrix nearness problem into two nested optimization problems,…

Numerical Analysis · Mathematics 2025-08-14 Miryam Gnazzo , Vanni Noferini , Lauri Nyman , Federico Poloni

In this paper, we develop a new classification method for manifold-valued data in the framework of probabilistic learning vector quantization. In many classification scenarios, the data can be naturally represented by symmetric positive…

Machine Learning · Computer Science 2021-02-02 Fengzhen Tang , Haifeng Feng , Peter Tino , Bailu Si , Daxiong Ji

In probabilistic modeling, parameter estimation is commonly formulated as a minimization problem on a parameter manifold. Optimization in such spaces requires geometry-aware methods that respect the underlying information structure. While…

Computation · Statistics 2025-11-17 Derun Zhou , Keisuke Yano , Mahito Sugiyama

Symmetry in differential equations reveals invariances and offers a powerful means to reduce model complexity. Lie group analysis characterizes these symmetries through infinitesimal generators, which provide a local, linear criterion for…

Numerical Analysis · Mathematics 2025-11-14 Max Kreider , John Harlim , Daning Huang

We present a novel physics-informed system identification method to construct a passive linear time-invariant system. In more detail, for a given quadratic energy functional, measurements of the input, state, and output of a system in the…

Dynamical Systems · Mathematics 2023-02-13 Riccardo Morandin , Jonas Nicodemus , Benjamin Unger

Given a multigrid procedure for linear systems with coefficient matrices $A_n$, we discuss the optimality of a related multigrid procedure with the same smoother and the same projector, when applied to properly related algebraic problems…

Numerical Analysis · Mathematics 2012-11-03 Stefano Serra-Capizzano , Cristina Tablino Possio

Given a square complex matrix $A$, we tackle the problem of finding the nearest matrix with multiple eigenvalues or, equivalently when $A$ had distinct eigenvalues, the nearest defective matrix. To this goal, we extend the general framework…

Numerical Analysis · Mathematics 2026-05-14 Vanni Noferini , Lauri Nyman , Federico Poloni

In this paper, we propose a new global analysis framework for a class of low-rank matrix recovery problems on the Riemannian manifold. We analyze the global behavior for the Riemannian optimization with random initialization. We use the…

Machine Learning · Statistics 2021-04-20 Thomas Y. Hou , Zhenzhen Li , Ziyun Zhang

We propose a novel Riemannian preconditioning approach for the tensor completion problem with rank constraint. A Riemannian metric or inner product is proposed that exploits the least-squares structure of the cost function and takes into…

Numerical Analysis · Computer Science 2016-05-30 Hiroyuki Kasai , Bamdev Mishra