English
Related papers

Related papers: Tensor Factorization via Matrix Factorization

200 papers

High-dimensional, higher-order tensor data are gaining prominence in a variety of fields, including but not limited to computer vision and network analysis. Tensor factor models, induced from noisy versions of tensor decompositions or…

Methodology · Statistics 2024-12-16 Xu Zhang , Guodong Li , Catherine C. Liu , Jianhua Guo

Matrix factorization methods are important tools in data mining and analysis. They can be used for many tasks, ranging from dimensionality reduction to visualization. In this paper we concentrate on the use of matrix factorizations for…

Machine Learning · Computer Science 2017-07-28 Sanjar Karaev , Pauli Miettinen

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

We present a matrix-factorization algorithm that scales to input matrices with both huge number of rows and columns. Learned factors may be sparse or dense and/or non-negative, which makes our algorithm suitable for dictionary learning,…

Machine Learning · Statistics 2017-11-15 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gael Varoquaux

The problem of decomposing a given covariance matrix as the sum of a positive semi-definite matrix of given rank and a positive semi-definite diagonal matrix, is considered. We present a projection-type algorithm to address this problem.…

Optimization and Control · Mathematics 2018-06-13 Valentina Ciccone , Augusto Ferrante , Mattia Zorzi

We propose an adaptive and provably accurate tensor completion approach based on combining matrix completion techniques (see, e.g., arXiv:0805.4471, arXiv:1407.3619, arXiv:1306.2979) for a small number of slices with a modified noise robust…

Numerical Analysis · Mathematics 2023-07-06 Cullen Haselby , Santhosh Karnik , Mark Iwen

Fault tolerant quantum simulation via the phase estimation algorithm and qubitization has a T-gate count that scales proportionally to the 1-norm of the Hamiltonian, the cost of block encoding the Hamiltonian, and inversely proportionally…

Quantum Physics · Physics 2025-04-14 Hirsh Kamakari , Emil Zak

Tensor factorization models are widely used in many applied fields such as chemometrics, psychometrics, computer vision or communication networks. Real life data collection is often subject to errors, resulting in missing data. Here we…

Signal Processing · Electrical Eng. & Systems 2022-03-23 Amaury Durand , François Roueff , Jean-Marc Jicquel , Nicolas Paul

Tensor regression has shown to be advantageous in learning tasks with multi-directional relatedness. Given massive multiway data, traditional methods are often too slow to operate on or suffer from memory bottleneck. In this paper, we…

Machine Learning · Computer Science 2016-07-12 Rose Yu , Yan Liu

Manifold regularization methods for matrix factorization rely on the cluster assumption, whereby the neighborhood structure of data in the input space is preserved in the factorization space. We argue that using the k-neighborhoods of all…

Machine Learning · Computer Science 2020-10-21 Priya Mani , Carlotta Domeniconi , Igor Griva

In pattern classification, polynomial classifiers are well-studied methods as they are capable of generating complex decision surfaces. Unfortunately, the use of multivariate polynomials is limited to kernels as in support vector machines,…

Machine Learning · Computer Science 2017-11-07 Zhongming Chen , Kim Batselier , Johan A. K. Suykens , Ngai Wong

While convolutional neural networks (CNNs) have become the de facto standard for most image processing and computer vision applications, their deployment on edge devices remains challenging. Tensor decomposition methods provide a means of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Marawan Gamal Abdel Hameed , Ali Mosleh , Marzieh S. Tahaei , Vahid Partovi Nia

The CANDECOMP/PARAFAC (CP) decomposition is a leading method for the analysis of multiway data. The standard alternating least squares algorithm for the CP decomposition (CP-ALS) involves a series of highly overdetermined linear least…

Numerical Analysis · Computer Science 2018-08-23 Casey Battaglino , Grey Ballard , Tamara G. Kolda

Dimensionality reduction techniques play an essential role in data analytics, signal processing and machine learning. Dimensionality reduction is usually performed in a preprocessing stage that is separate from subsequent data analysis,…

Machine Learning · Computer Science 2016-12-21 Bo Yang , Xiao Fu , Nicholas D. Sidiropoulos

Many problems can be formulated as recovering a low-rank tensor. Although an increasingly common task, tensor recovery remains a challenging problem because of the delicacy associated with the decomposition of higher order tensors. To…

Machine Learning · Statistics 2014-05-09 Ming Yuan , Cun-Hui Zhang

Tensors play a central role in many modern machine learning and signal processing applications. In such applications, the target tensor is usually of low rank, i.e., can be expressed as a sum of a small number of rank one tensors. This…

Machine Learning · Statistics 2015-05-18 Parikshit Shah , Nikhil Rao , Gongguo Tang

Squared tensor networks (TNs) and their generalization as parameterized computational graphs -- squared circuits -- have been recently used as expressive distribution estimators in high dimensions. However, the squaring operation introduces…

Machine Learning · Computer Science 2025-01-22 Lorenzo Loconte , Antonio Vergari

Tensor completion is a core machine learning algorithm used in recommender systems and other domains with missing data. While the matrix case is well-understood, theoretical results for tensor problems are limited, particularly when the…

Machine Learning · Statistics 2023-06-13 Kameron Decker Harris , Oscar López , Angus Read , Yizhe Zhu

Traditional NMF-based signal decomposition relies on the factorization of spectral data, which is typically computed by means of short-time frequency transform. In this paper we propose to relax the choice of a pre-fixed transform and learn…

Machine Learning · Computer Science 2017-12-18 Dylan Fagot , Cédric Févotte , Herwig Wendt

Streaming tensor factorization is a powerful tool for processing high-volume and multi-way temporal data in Internet networks, recommender systems and image/video data analysis. Existing streaming tensor factorization algorithms rely on…

Machine Learning · Statistics 2019-01-01 Cole Hawkins , Zheng Zhang