English
Related papers

Related papers: Range Space or Null Space: Least-Squares Methods f…

200 papers

We consider the problem of approximating an unknown function from point evaluations. This problem is a crucial subproblem in many modern (nonlinear) approximation schemes. When obtaining these point evaluations is costly, minimising the…

Numerical Analysis · Mathematics 2025-12-03 Philipp Trunschke , Anthony Nouy

Rank minimization can be converted into tractable surrogate problems, such as Nuclear Norm Minimization (NNM) and Weighted NNM (WNNM). The problems related to NNM, or WNNM, can be solved iteratively by applying a closed-form proximal…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Tae-Hyun Oh , Yasuyuki Matsushita , Yu-Wing Tai , In So Kweon

In this paper we focus on the problem of completion of multidimensional arrays (also referred to as tensors) from limited sampling. Our approach is based on a recently proposed tensor-Singular Value Decomposition (t-SVD) [1]. Using this…

Machine Learning · Computer Science 2015-03-02 Zemin Zhang , Shuchin Aeron

If a dynamic system has active constraints on the state vector and they are known, then taking them into account during modeling is often advantageous. Unfortunately, in the constrained discrete-time state-space estimation, the state…

Systems and Control · Computer Science 2019-04-11 Rodrigo A. Ricco , Bruno O. S. Teixeira

The method of ``Total Least Squares'' is proposed as a more natural way (than ordinary least squares) to approximate the data if both the matrix and and the right-hand side are contaminated by ``errors''. In this tutorial note, we give a…

Rings and Algebras · Mathematics 2025-10-20 P. P. N. de Groen

In this paper, we develop a method for solving the problem of minimizing the $H^2$ error norm between the transfer functions of original and reduced systems on the set of stable matrices and two Euclidean spaces. That is, we develop a…

Optimization and Control · Mathematics 2018-08-03 Kazuhiro Sato

This paper introduces a novel algorithm to approximate the matrix with minimum nuclear norm among all matrices obeying a set of convex constraints. This problem may be understood as the convex relaxation of a rank minimization problem, and…

Optimization and Control · Mathematics 2008-10-21 Jian-Feng Cai , Emmanuel J. Candes , Zuowei Shen

We propose a general random subspace framework for unconstrained nonconvex optimization problems that requires a weak probabilistic assumption on the subspace gradient, which we show to be satisfied by various random matrix ensembles, such…

Optimization and Control · Mathematics 2022-11-21 Coralia Cartis , Jaroslav Fowkes , Zhen Shao

We discuss computational procedures based on descriptor state-space realizations to compute proper range space bases of rational matrices. The main computation is the orthogonal reduction of the system matrix pencil to a special…

Systems and Control · Computer Science 2017-07-05 Andreas Varga

Low-rank approximation of a matrix by means of random sampling has been consistently efficient in its empirical studies by many scientists who applied it with various sparse and structured multipliers, but adequate formal support for this…

Numerical Analysis · Mathematics 2016-06-07 Victor Y. Pan , Liang Zhao

This article focuses on the problem of reconstructing low-rank matrices from underdetermined measurements using alternating optimization strategies. We endeavour to combine an alternating least-squares based estimation strategy with ideas…

Statistics Theory · Mathematics 2014-07-15 Kezhi Li , Martin Sundin , Cristian R. Rojas , Saikat Chatterjee , Magnus Jansson

Range-only (RO) pose estimation involves determining a robot's pose over time by measuring the distance between multiple devices on the robot, known as tags, and devices installed in the environment, known as anchors. The nonconvex nature…

Robotics · Computer Science 2024-01-09 Abhishek Goudar , Frederike Dümbgen , Timothy D. Barfoot , Angela P. Schoellig

We consider the problem of fitting a set of points in Euclidean space by an algebraic hypersurface. We assume that points on a true hypersurface, described by a polynomial equation, are corrupted by zero mean independent Gaussian noise, and…

Computation · Statistics 2015-08-21 Konstantin Usevich , Ivan Markovsky

We give a new framework for solving the fundamental problem of low-rank matrix completion, i.e., approximating a rank-$r$ matrix $\mathbf{M} \in \mathbb{R}^{m \times n}$ (where $m \ge n$) from random observations. First, we provide an…

Machine Learning · Computer Science 2023-08-08 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

This paper explores the distance-based relative state estimation problem in large-scale systems, which is hard to solve effectively due to its high-dimensionality and non-convexity. In this paper, we alleviate this inherent hardness to…

Robotics · Computer Science 2024-06-03 Tianyue Wu , Gongye Zaitian , Qianhao Wang , Fei Gao

We investigate the minimization of a quadratic function over Stiefel manifolds (the set of all orthogonal $r$- frames in $\mathbf{R}^n$), which has applications in high-dimensional semi-supervised classification tasks. To reduce the…

Optimization and Control · Mathematics 2025-08-15 Pengwen Chen , Chung-Kuan Cheng , Chester Holtz

Differentiable systems in this paper means systems of equations that are described by differentiable real functions in real matrix variables. This paper proposes algorithms for finding minimal rank solutions to such systems over (arbitrary…

Optimization and Control · Mathematics 2017-05-30 Thanh Hieu Le

This paper develops a new storage-optimal algorithm that provably solves generic semidefinite programs (SDPs) in standard form. This method is particularly effective for weakly constrained SDPs. The key idea is to formulate an approximate…

Optimization and Control · Mathematics 2020-06-19 Lijun Ding , Alp Yurtsever , Volkan Cevher , Joel A. Tropp , Madeleine Udell

Rank minimization (RM) is a wildly investigated task of finding solutions by exploiting low-rank structure of parameter matrices. Recently, solving RM problem by leveraging non-convex relaxations has received significant attention. It has…

Machine Learning · Computer Science 2018-09-17 Zaiyi Chen

We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank…

Numerical Analysis · Mathematics 2014-07-01 Gil Shabat , Yaniv Shmueli , Amir Averbuch