English
Related papers

Related papers: Application Performance Modeling via Tensor Comple…

200 papers

We propose two provably accurate methods for low CP-rank tensor completion - one using adaptive sampling and one using nonadaptive sampling. Both of our algorithms combine matrix completion techniques for a small number of slices along with…

Numerical Analysis · Mathematics 2024-03-18 Cullen Haselby , Mark Iwen , Santhosh Karnik , Rongrong Wang

This paper introduces a new multivariate convolutional sparse coding based on tensor algebra with a general model enforcing both element-wise sparsity and low-rankness of the activations tensors. By using the CP decomposition, this model…

Machine Learning · Statistics 2019-08-12 Pierre Humbert , Julien Audiffren , Laurent Oudre , Nicolas Vayatis

The CP decomposition for high dimensional non-orthogonal spiked tensors is an important problem with broad applications across many disciplines. However, previous works with theoretical guarantee typically assume restrictive incoherence…

Machine Learning · Statistics 2022-09-20 Yuefeng Han , Cun-Hui Zhang

We address the computational barrier of deploying advanced deep learning segmentation models in clinical settings by studying the efficacy of network compression through tensor decomposition. We propose a post-training Tucker factorization…

Image and Video Processing · Electrical Eng. & Systems 2024-04-19 Tobias Weber , Jakob Dexl , David Rügamer , Michael Ingrisch

Canonical Polyadic (CP) tensor decomposition is a fundamental technique for analyzing high-dimensional tensor data. While the Alternating Least Squares (ALS) algorithm is widely used for computing CP decomposition due to its simplicity and…

Methodology · Statistics 2025-05-30 Runshi Tang , Julien Chhor , Olga Klopp , Anru R. Zhang

Simulating quantum algorithms on classical computers is challenging when the system size, i.e., the number of qubits used in the quantum algorithm, is moderately large. However, some quantum algorithms and the corresponding quantum circuits…

Computational Engineering, Finance, and Science · Computer Science 2021-04-26 Linjian Ma , Chao Yang

We propose an end-to-end trainable framework that processes large-scale visual data tensors by looking at a fraction of their entries only. Our method combines a neural network encoder with a tensor train decomposition to learn a low-rank…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Mikhail Usvyatsov , Anastasia Makarova , Rafael Ballester-Ripoll , Maxim Rakhuba , Andreas Krause , Konrad Schindler

Low-rank tensor decomposition and completion have attracted significant interest from academia given the ubiquity of tensor data. However, the low-rank structure is a global property, which will not be fulfilled when the data presents…

Machine Learning · Computer Science 2019-12-13 Ziyue Li , Nurettin Dorukhan Sergin , Hao Yan , Chen Zhang , Fugee Tsung

Accurate hardware performance models are critical to efficient code generation. They can be used by compilers to make heuristic decisions, by superoptimizers as a minimization objective, or by autotuners to find an optimal configuration for…

Modern neural networks have revolutionized the fields of computer vision (CV) and Natural Language Processing (NLP). They are widely used for solving complex CV tasks and NLP tasks such as image classification, image generation, and machine…

Machine Learning · Computer Science 2023-07-25 Xingyi Liu , Keshab K. Parhi

Compressed sensing extends from the recovery of sparse vectors from undersampled measurements via efficient algorithms to the recovery of matrices of low rank from incomplete information. Here we consider a further extension to the…

Numerical Analysis · Mathematics 2014-11-04 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

Coupled tensor decomposition reveals the joint data structure by incorporating priori knowledge that come from the latent coupled factors. The tensor ring (TR) decomposition is invariant under the permutation of tensors with different mode…

Machine Learning · Computer Science 2020-11-10 Huyan Huang , Yipeng Liu , Ce Zhu

We study tensor completion (TC) through the lens of low-rank tensor decomposition (TD). Many TD algorithms use fast alternating minimization methods to solve highly structured linear regression problems at each step (e.g., for CP, Tucker,…

Data Structures and Algorithms · Computer Science 2025-08-13 Mehrdad Ghadiri , Matthew Fahrbach , Yunbum Kook , Ali Jadbabaie

Robust tensor CP decomposition involves decomposing a tensor into low rank and sparse components. We propose a novel non-convex iterative algorithm with guaranteed recovery. It alternates between low-rank CP decomposition through gradient…

Machine Learning · Computer Science 2016-04-28 Animashree Anandkumar , Prateek Jain , Yang Shi , U. N. Niranjan

There is growing interest to extend low-rank matrix decompositions to multi-way arrays, or tensors. One fundamental low-rank tensor decomposition is the canonical polyadic decomposition (CPD). The challenge of fitting a low-rank,…

Numerical Analysis · Mathematics 2024-07-15 Jeremy M. Myers , Daniel M. Dunlavy

Tensor decomposition is one of the well-known approaches to reduce the latency time and number of parameters of a pre-trained model. However, in this paper, we propose an approach to use tensor decomposition to reduce training time of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Mostafa Elhoushi , Ye Henry Tian , Zihao Chen , Farhan Shafiq , Joey Yiwei Li

Low-rank tensor approximation approaches have become an important tool in the scientific computing community. The aim is to enable the simulation and analysis of high-dimensional problems which cannot be solved using conventional methods…

Numerical Analysis · Mathematics 2019-02-26 Patrick Gelß , Stefan Klus , Sebastian Matera , Christof Schütte

Tensor decompositions are powerful tools for large data analytics as they jointly model multiple aspects of data into one framework and enable the discovery of the latent structures and higher-order correlations within the data. One of the…

Machine Learning · Computer Science 2018-07-05 Ekta Gujral , Ravdeep Pasricha , Tianxiong Yang , Evangelos E. Papalexakis

In recent years, low-rank based tensor completion, which is a higher-order extension of matrix completion, has received considerable attention. However, the low-rank assumption is not sufficient for the recovery of visual data, such as…

Computer Vision and Pattern Recognition · Computer Science 2016-09-21 Tatsuya Yokota , Qibin Zhao , Andrzej Cichocki

In this paper, the canonical polyadic (CP) decomposition of tensors that corresponds to matrix multiplications is studied. Finding the rank of these tensors and computing the decompositions is a fundamental problem of algebraic complexity…

Computational Complexity · Computer Science 2021-04-13 Petr Tichavsky