English
Related papers

Related papers: Low-rank signal subspace: parameterization, projec…

200 papers

This is a brief tutorial on the least square estimation technique that is straightforward yet effective for parameter estimation. The tutorial is focused on the linear LSEs instead of nonlinear versions, since most nonlinear LSEs can be…

Systems and Control · Electrical Eng. & Systems 2022-11-29 Qingrui Zhang

The goal of this paper is to find a low-rank approximation for a given tensor. Specifically, we give a computable strategy on calculating the rank of a given tensor, based on approximating the solution to an NP-hard problem. In this paper,…

Numerical Analysis · Mathematics 2016-10-20 Xiaofei Wang , Carmeliza Navasca

This paper provides a least squares formulation for the training of a 2-layer convolutional neural network using quadratic activation functions, a 2-norm loss function, and no regularization term. Using this method, an analytic expression…

Machine Learning · Computer Science 2024-11-18 Zachary Yetman Van Egmond , Luis Rodrigues

This article is an extended version of previous work of the authors [40, 41] on low-rank matrix estimation in the presence of constraints on the factors into which the matrix is factorized. Low-rank matrix factorization is one of the basic…

Statistics Theory · Mathematics 2017-08-28 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

Registration networks have shown great application potentials in medical image analysis. However, supervised training methods have a great demand for large and high-quality labeled datasets, which is time-consuming and sometimes impractical…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Dengqiang Jia , Shangqi Gao , Qunlong Chen , Xinzhe Luo , Xiahai Zhuang

This work proposes a space-time least-squares Petrov-Galerkin (ST-LSPG) projection method for model reduction of nonlinear dynamical systems. In contrast to typical nonlinear model-reduction methods that first apply (Petrov-)Galerkin…

Numerical Analysis · Computer Science 2018-11-14 Youngsoo Choi , Kevin Carlberg

In this paper, we consider the estimation of a low Tucker rank tensor from a number of noisy linear measurements. The general problem covers many specific examples arising from applications, including tensor regression, tensor completion,…

Machine Learning · Statistics 2023-07-11 Yuetian Luo , Anru R. Zhang

Mining natural associations from high-dimensional spatiotemporal signals plays an important role in various fields including biology, climatology, and financial analysis. However, most existing works have mainly studied time-independent…

Social and Information Networks · Computer Science 2020-12-08 Yueliang Liu , Wenbin Guo , Kangyong You , Lei Zhao , Tao Peng , Wenbo Wang

During the last years, low-rank tensor approximation has been established as a new tool in scientific computing to address large-scale linear and multilinear algebra problems, which would be intractable by classical techniques. This survey…

Numerical Analysis · Mathematics 2013-03-01 Lars Grasedyck , Daniel Kressner , Christine Tobler

High-dimensional matrix regression has been studied in various aspects, such as statistical properties, computational efficiency and application to specific instances including multivariate regression, system identification and matrix…

Statistics Theory · Mathematics 2024-03-06 Xin Li , Dongya Wu

In this paper we study the problem of reconstruction of a low-rank matrix observed with additive Gaussian noise. First we show that under mild assumptions (about the prior distribution of the signal matrix) we can restrict our attention to…

Methodology · Statistics 2010-07-26 Andrey Shabalin , Andrew Nobel

A new algorithm for 3D localization in multiplatform radar networks, comprising one transmitter and multiple receivers, is proposed. To take advantage of the monostatic sensor radiation pattern features, ad-hoc constraints are imposed in…

Signal Processing · Electrical Eng. & Systems 2022-04-06 Augusto Aubry , Paolo Braca , Antonio De Maio , Angela Marino

Graphons offer a powerful framework for modeling large-scale networks, yet estimation remains challenging. We propose a novel approach that leverages a low-rank additive representation, yielding both a low-rank connection probability matrix…

Methodology · Statistics 2026-04-14 Xinyuan Fan , Feiyan Ma , Chenlei Leng , Weichi Wu

Although recent deep learning methods, especially generative models, have shown good performance in fast magnetic resonance imaging, there is still much room for improvement in high-dimensional generation. Considering that internal…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Wei Zhang , Zengwei Xiao , Hui Tao , Minghui Zhang , Xiaoling Xu , Qiegen Liu

We propose a new framework for the analysis of low-rank tensors which lies at the intersection of spectral graph theory and signal processing. As a first step, we present a new graph based low-rank decomposition which approximates the…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 Nauman Shahid , Francesco Grassi , Pierre Vandergheynst

We propose a novel adaptive kernel based regression method for complex-valued signals: the generalized complex-valued kernel least-mean-square (gCKLMS). We borrow from the new results on widely linear reproducing kernel Hilbert space…

Machine Learning · Statistics 2019-10-02 Rafael Boloix-Tortosa , Juan José Murillo-Fuentes , Sotirios A. Tsaftaris

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

Structural matrix-variate observations routinely arise in diverse fields such as multi-layer network analysis and brain image clustering. While data of this type have been extensively investigated with fruitful outcomes being delivered, the…

Statistics Theory · Mathematics 2022-01-25 Zhongyuan Lyu , Dong Xia

In this paper, we construct a parameter estimation framework for robust low-rank tensor regression based on a truncation method and Huber loss, specifically focusing on models with random noise having only finite second-order moments.…

Statistics Theory · Mathematics 2025-12-05 Kangqiang Li , Bingqi Liu , Yang Yang , Li Wang

Latest least squares regression (LSR) methods mainly try to learn slack regression targets to replace strict zero-one labels. However, the difference of intra-class targets can also be highlighted when enlarging the distance between…

Computer Vision and Pattern Recognition · Computer Science 2019-10-09 Zhe Chen , Xiao-Jun Wu , Josef Kittler