English
Related papers

Related papers: Mode-wise Tensor Decompositions: Multi-dimensional…

200 papers

In this work, we introduce an interior-point method that employs tensor decompositions to efficiently represent and manipulate the variables and constraints of semidefinite programs, targeting problems where the solutions may not be…

Optimization and Control · Mathematics 2025-09-16 Frederik Kelbel , Sergey Dolgov , Dante Kalise , Alessandra Russo

This paper presents a memory efficient, first-order method for low multi-linear rank approximation of high-order, high-dimensional tensors. In our method, we exploit the second-order information of the cost function and the constraints to…

Optimization and Control · Mathematics 2024-03-22 Mohammad Hamed , Reshad Hosseini

We consider the problem of low-rank decomposition of incomplete multiway tensors. Since many real-world data lie on an intrinsically low dimensional subspace, tensor low-rank decomposition with missing entries has applications in many data…

Numerical Analysis · Computer Science 2016-08-24 Linxiao Yang , Jun Fang , Hongbin Li , Bing Zeng

The paper considers function-valued tensors, viewed as multidimensional arrays with entries in an abstract Hilbert space. Despite the absence of the algebraic structure of a field, the geometric inner-product structure suffices to introduce…

Numerical Analysis · Mathematics 2025-12-01 Stanislav Budzinskiy , Vladimir Kazeev , Maxim Olshanskii

Part 2 of this monograph builds on the introduction to tensor networks and their operations presented in Part 1. It focuses on tensor network models for super-compressed higher-order representation of data/parameters and related cost…

Numerical Analysis · Computer Science 2017-08-31 A. Cichocki , A-H. Phan , Q. Zhao , N. Lee , I. V. Oseledets , M. Sugiyama , D. Mandic

Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as principal component…

Machine Learning · Computer Science 2020-07-09 Koji Maruhashi , Heewon Park , Rui Yamaguchi , Satoru Miyano

Many idealized problems in signal processing, machine learning and statistics can be reduced to the problem of finding the symmetric canonical decomposition of an underlying symmetric and orthogonally decomposable (SOD) tensor. Drawing…

Numerical Analysis · Computer Science 2017-05-31 Cun Mu , Daniel Hsu , Donald Goldfarb

Low rank tensor representation underpins much of recent progress in tensor completion. In real applications, however, this approach is confronted with two challenging problems, namely (1) tensor rank determination; (2) handling real tensor…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Lei Zhang , Wei Wei , Qinfeng Shi , Chunhua Shen , Anton van den Hengel , Yanning Zhang

For the antisymmetric tensors the paper examines a low-rank approximation which is represented via only three vectors. We describe a suitable low-rank format and propose an alternating least squares structure-preserving algorithm for…

Numerical Analysis · Mathematics 2024-11-08 Erna Begovic , Lana Perisa

Tensor-based modulation (TBM) has been proposed in the context of unsourced random access for massive uplink communication. In this modulation, transmitters encode data as rank-1 tensors, with factors from a discrete vector constellation.…

Information Theory · Computer Science 2021-11-04 Alexis Decurninge , Ingmar Land , Maxime Guillaud

In this paper, we present a method to certify the approximation quality of a low rank tensor to a given third order symmetric tensor. Under mild assumptions, best low rank approximation is attained if a control parameter is zero or…

Optimization and Control · Mathematics 2023-07-21 Shenglong Hu , Defeng Sun , Kim-Chuan Toh

The goal of this paper is to find a low-rank approximation for a given tensor. Specifically, we give a computable strategy on calculating the rank of a given tensor, based on approximating the solution to an NP-hard problem. In this paper,…

Numerical Analysis · Mathematics 2016-10-20 Xiaofei Wang , Carmeliza Navasca

The tensor rank decomposition is a useful tool for the geometric interpretation of the tensors in the canonical tensor model (CTM) of quantum gravity. In order to understand the stability of this interpretation, it is important to be able…

General Relativity and Quantum Cosmology · Physics 2021-07-22 Dennis Obster , Naoki Sasakura

Nearest-neighbor search in large vector databases is crucial for various machine learning applications. This paper introduces a novel method using tensor-train (TT) low-rank tensor decomposition to efficiently represent point clouds and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Georgii Novikov , Alexander Gneushev , Alexey Kadeishvili , Ivan Oseledets

The CUR decomposition provides an approximation of a matrix $X$ that has low reconstruction error and that is sparse in the sense that the resulting approximation lies in the span of only a few columns of $X$. In this regard, it appears to…

Data Structures and Algorithms · Computer Science 2010-11-02 Jacob Bien , Ya Xu , Michael W. Mahoney

The CANDECOMP/PARAFAC (CP) tensor decomposition is a popular dimensionality-reduction method for multiway data. Dimensionality reduction is often sought after since many high-dimensional tensors have low intrinsic rank relative to the…

Numerical Analysis · Computer Science 2020-03-16 N. Benjamin Erichson , Krithika Manohar , Steven L. Brunton , J. Nathan Kutz

Traditional tensor decomposition methods, e.g., two dimensional principal component analysis and two dimensional singular value decomposition, that minimize mean square errors, are sensitive to outliers. To overcome this problem, in this…

Computer Vision and Pattern Recognition · Computer Science 2020-12-30 Miaohua Zhang , Yongsheng Gao , Changming Sun , Michael Blumenstein

Tensor ring (TR) decomposition is an efficient approach to discover the hidden low-rank patterns for higher-order tensors, and streaming tensors are becoming highly prevalent in real-world applications. In this paper, we investigate how to…

Numerical Analysis · Mathematics 2023-07-04 Yajie Yu , Hanyu Li

In this paper we propose new techniques to sample arbitrary third-order tensors, with an objective of speeding up tensor algorithms that have recently gained popularity in machine learning. Our main contribution is a new way to select, in a…

Machine Learning · Statistics 2015-02-23 Srinadh Bhojanapalli , Sujay Sanghavi

We consider relative error low rank approximation of $tensors$ with respect to the Frobenius norm: given an order-$q$ tensor $A \in \mathbb{R}^{\prod_{i=1}^q n_i}$, output a rank-$k$ tensor $B$ for which $\|A-B\|_F^2 \leq (1+\epsilon)$OPT,…

Data Structures and Algorithms · Computer Science 2018-04-02 Zhao Song , David P. Woodruff , Peilin Zhong