English
Related papers

Related papers: Image space projection for low-rank signal estimat…

200 papers

Non linear regression models are a standard tool for modeling real phenomena, with several applications in machine learning, ecology, econometry... Estimating the parameters of the model has garnered a lot of attention during many years. We…

Statistics Theory · Mathematics 2020-09-17 Peggy Cénac , Antoine Godichon-Baggioni , Bruno Portier

We consider the problem of finding a low rank symmetric matrix satisfying a system of linear equations, as appears in phase retrieval. In particular, we solve the gauge dual formulation, but use a fast approximation of the spectral…

Optimization and Control · Mathematics 2020-06-02 Ron Estrin , Yifan Sun , Halyun Jeong , Michael Friedlander

In this paper, we propose a new algorithm for recovery of low-rank matrices from compressed linear measurements. The underlying idea of this algorithm is to closely approximate the rank function with a smooth function of singular values,…

Information Theory · Computer Science 2016-11-18 Mohammadreza Malek-Mohammadi , Massoud Babaie-Zadeh , Mikael Skoglund

We consider the problem of recovering an unknown low-rank matrix X with (possibly) non-orthogonal, effectively sparse rank-1 decomposition from measurements y gathered in a linear measurement process A. We propose a variational formulation…

Information Theory · Computer Science 2023-06-13 Johannes Maly

This contribution revisits the classical approximate realization problem, which involves determining matrices of a state-space model based on estimates of a truncated series of Markov parameters. A Hankel matrix built up by these Markov…

Systems and Control · Electrical Eng. & Systems 2025-05-27 Jiabao He , Yueyue Xu , Yue Ju , Cristian R. Rojas , Håkan Hjalmarsson

Layer factorization has emerged as a widely used technique for training memory-efficient neural networks. However, layer factorization methods face several challenges, particularly a lack of robustness during the training process. To…

Numerical Analysis · Mathematics 2025-02-06 Jonas Kusch , Steffen Schotthöfer , Alexandra Walter

In this paper, we consider the estimation of a low Tucker rank tensor from a number of noisy linear measurements. The general problem covers many specific examples arising from applications, including tensor regression, tensor completion,…

Machine Learning · Statistics 2023-07-11 Yuetian Luo , Anru R. Zhang

Low rank approximation of matrices has been well studied in literature. Singular value decomposition, QR decomposition with column pivoting, rank revealing QR factorization (RRQR), Interpolative decomposition etc are classical deterministic…

Numerical Analysis · Mathematics 2016-06-22 N. Kishore Kumar , Jan Shneider

We consider the problem of finding for a given $N$-tuple of polynomials (real or complex) the closest $N$-tuple that has a common divisor of degree at least $d$. Extended weighted Euclidean seminorm of the coefficients is used as a measure…

Optimization and Control · Mathematics 2015-11-05 Konstantin Usevich , Ivan Markovsky

This paper presents a novel adaptive reduced-rank {multi-input multi-output} (MIMO) equalization scheme and algorithms based on alternating optimization design techniques for MIMO spatial multiplexing systems. The proposed reduced-rank…

Information Theory · Computer Science 2013-01-15 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

In this work, we propose a new randomized algorithm for computing a low-rank approximation to a given matrix. Taking an approach different from existing literature, our method first involves a specific biased sampling, with an element being…

Data Structures and Algorithms · Computer Science 2014-10-16 Srinadh Bhojanapalli , Prateek Jain , Sujay Sanghavi

Recently, low-rank matrix recovery theory has been emerging as a significant progress for various image processing problems. Meanwhile, the group sparse coding (GSC) theory has led to great successes in image restoration (IR) problem with…

Image and Video Processing · Electrical Eng. & Systems 2020-05-26 Yunyi Li , Guan Gui , Xiefeng Cheng

We propose a new iteratively reweighted least squares (IRLS) algorithm for the recovery of a matrix $X \in \mathbb{C}^{d_1\times d_2}$ of rank $r \ll\min(d_1,d_2)$ from incomplete linear observations, solving a sequence of low complexity…

Numerical Analysis · Mathematics 2018-02-28 Christian Kümmerle , Juliane Sigl

Inference and simulation in the context of high-dimensional dynamical systems remain computationally challenging problems. Some form of dimensionality reduction is required to make the problem tractable in general. In this paper, we propose…

Machine Learning · Statistics 2024-01-04 Jonathan Schmidt , Philipp Hennig , Jörg Nick , Filip Tronarp

We develop time integration methods in low-rank representation that can adaptively adjust approximation ranks to achieve a prescribed accuracy, while ensuring that these ranks remain proportional to the corresponding best approximation…

Numerical Analysis · Mathematics 2025-07-22 Markus Bachmayr , Matthieu Dolbeault , Polina Sachsenmaier

A weighted regression procedure is proposed for regression type problems where the innovations are heavy-tailed. This method approximates the least absolute regression method in large samples, and the main advantage will be if the sample is…

Computation · Statistics 2018-11-06 J. Martin van Zyl

For three decades, carrier-phase observations have been used to obtain the most accurate location estimates using global navigation satellite systems (GNSS). These estimates are computed by minimizing a nonlinear mixed-integer least-squares…

Signal Processing · Electrical Eng. & Systems 2026-01-01 Ophir Uziel , Efi Fogel , Dan Halperin , Sivan Toledo

We propose a new technique for constructing low-rank approximations of matrices that arise in kernel methods for machine learning. Our approach pairs a novel automatically constructed analytic expansion of the underlying kernel function…

Machine Learning · Computer Science 2022-02-09 John Paul Ryan , Anil Damle

Matrix low rank approximation including the classical PCA and the robust PCA (RPCA) method have been applied to solve the background modeling problem in video analysis. Recently, it has been demonstrated that a special weighted low rank…

Optimization and Control · Mathematics 2017-03-21 Aritra Dutta , Xin Li

Low-rankness plays an important role in traditional machine learning, but is not so popular in deep learning. Most previous low-rank network compression methods compress networks by approximating pre-trained models and re-training. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Kailing Guo , Zhenquan Lin , Canyang Chen , Xiaofen Xing , Fang Liu , Xiangmin Xu