English
Related papers

Related papers: Supervised multiway factorization

200 papers

Tensor factorization arises in many machine learning applications, such knowledge base modeling and parameter estimation in latent variable models. However, numerical methods for tensor factorization have not reached the level of maturity…

Machine Learning · Computer Science 2015-05-20 Volodymyr Kuleshov , Arun Tejasvi Chaganty , Percy Liang

In recent years, low-rank based tensor completion, which is a higher-order extension of matrix completion, has received considerable attention. However, the low-rank assumption is not sufficient for the recovery of visual data, such as…

Computer Vision and Pattern Recognition · Computer Science 2016-09-21 Tatsuya Yokota , Qibin Zhao , Andrzej Cichocki

It has become routine to collect data that are structured as multiway arrays (tensors). There is an enormous literature on low rank and sparse matrix factorizations, but limited consideration of extensions to the tensor case in statistics.…

Methodology · Statistics 2013-06-10 Jing Zhou , Anirban Bhattacharya , Amy Herring , David Dunson

Since many real-world data can be described from multiple views, multi-view learning has attracted considerable attention. Various methods have been proposed and successfully applied to multi-view learning, typically based on matrix…

Machine Learning · Computer Science 2020-12-03 Haonan Huang , Naiyao Liang , Wei Yan , Zuyuan Yang , Weijun Sun

Koopman mode decomposition and tensor component analysis (also known as CANDECOMP/PARAFAC or canonical polyadic decomposition) are two popular approaches of decomposing high dimensional data sets into low dimensional modes that capture the…

Numerical Analysis · Mathematics 2021-05-19 William T. Redman

The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Xiao Fu , Nico Vervliet , Lieven De Lathauwer , Kejun Huang , Nicolas Gillis

Rank-revealing matrix decompositions provide an essential tool in spectral analysis of matrices, including the Singular Value Decomposition (SVD) and related low-rank approximation techniques. QR with Column Pivoting (QRCP) is usually…

Mathematical Software · Computer Science 2020-08-12 Jed A. Duersch , Ming Gu

Single-cell gene expression data are often characterized by large matrices, where the number of cells may be lower than the number of genes of interest. Factorization models have emerged as powerful tools to condense the available…

Methodology · Statistics 2023-05-22 Antonio Canale , Luisa Galtarossa , Davide Risso , Lorenzo Schiavon , Giovanni Toto

Matrix factorisation methods decompose multivariate observations as linear combinations of latent feature vectors. The Indian Buffet Process (IBP) provides a way to model the number of latent features required for a good approximation in…

Machine Learning · Statistics 2017-04-14 Matthew C. Pearce , Simon R. White

Tensor decomposition is a fundamental technique widely applied in signal processing, machine learning, and various other fields. However, traditional tensor decomposition methods encounter limitations when jointly analyzing multi-block…

Machine Learning · Computer Science 2024-06-27 Xiulin Wang , Jing Liu , Fengyu Cong

Optimization problems involving complex variables, when solved, are typically transformed into real variables, often at the expense of convergence rate and interpretability. This paper introduces a novel formalism for a prominent problem in…

Optimization and Control · Mathematics 2025-04-07 Raneem Madani , Abdel Lisser

Higher-order tensors have received increased attention across science and engineering. While most tensor decomposition methods are developed for a single tensor observation, scientific studies often collect side information, in the form of…

Methodology · Statistics 2021-10-29 Jiaxin Hu , Chanwoo Lee , Miaoyan Wang

Observations in various applications are frequently represented as a time series of multidimensional arrays, called tensor time series, preserving the inherent multidimensional structure. In this paper, we present a factor model approach,…

Methodology · Statistics 2024-04-22 Yuefeng Han , Dan Yang , Cun-Hui Zhang , Rong Chen

Tensor decompositions are promising tools for big data analytics as they bring multiple modes and aspects of data to a unified framework, which allows us to discover complex internal structures and correlations of data. Unfortunately most…

Numerical Analysis · Computer Science 2014-12-30 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

Recovering a low-rank matrix from highly corrupted measurements arises in compressed sensing of structured high-dimensional signals (e.g., videos and hyperspectral images among others). Robust principal component analysis (RPCA), solved via…

Optimization and Control · Mathematics 2022-06-28 Vahan Hovhannisyan , Yannis Panagakis , Panos Parpas , Stefanos Zafeiriou

Motivated by Tucker tensor decomposition, this paper imposes low-rank structures to the column and row spaces of coefficient matrices in a multivariate infinite-order vector autoregression (VAR), which leads to a supervised factor model…

Methodology · Statistics 2023-12-04 Feiqing Huang , Kexin Lu , Guodong Li

Consider traffic data (i.e., triplets in the form of source-destination-timestamp) that grow over time. Tensors (i.e., multi-dimensional arrays) with a time mode are widely used for modeling and analyzing such multi-aspect data streams. In…

Machine Learning · Computer Science 2021-03-03 Taehyung Kwon , Inkyu Park , Dongjin Lee , Kijung Shin

Given two views of data, we consider the problem of finding the features of one view which can be most faithfully inferred from the other. We find that these are also the most correlated variables in the sense of deep canonical correlation…

Machine Learning · Computer Science 2020-03-25 Cédric Bény

Recovering matrices from compressive and grossly corrupted observations is a fundamental problem in robust statistics, with rich applications in computer vision and machine learning. In theory, under certain conditions, this problem can be…

Optimization and Control · Mathematics 2017-05-31 Cun Mu , Yuqian Zhang , John Wright , Donald Goldfarb

A multi-way factor analysis model is introduced for tensor-variate data of any order. Each data item is represented as a (sparse) sum of Kruskal decompositions, a Kruskal-factor analysis (KFA). KFA is nonparametric and can infer both the…

Machine Learning · Statistics 2017-03-07 Andrew Stevens , Yunchen Pu , Yannan Sun , Greg Spell , Lawrence Carin