English
Related papers

Related papers: Solving Tensor Structured Problems with Computatio…

200 papers

We define and solve classes of sparse matrix problems that arise in multilevel modeling and data analysis. The classes are indexed by the number of nested units, with two-level problems corresponding to the common situation in which data on…

Statistics Theory · Mathematics 2020-03-13 Tui H. Nolan , Matt P. Wand

Matrix multiplication is a fundamental computation in many scientific disciplines. In this paper, we show that novel fast matrix multiplication algorithms can significantly outperform vendor implementations of the classical algorithm and…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-08 Austin R. Benson , Grey Ballard

Recent results by Harrow et. al. and by Ta-Shma, suggest that quantum computers may have an exponential advantage in solving a wealth of linear algebraic problems, over classical algorithms. Building on the quantum intuition of these…

Quantum Physics · Physics 2017-04-07 Michael Ben-Or , Lior Eldar

We introduce a new, quadratically convergent algorithm for finding maximum absolute value entries of tensors represented in the canonical format. The computational complexity of the algorithm is linear in the dimension of the tensor. We…

Numerical Analysis · Mathematics 2017-09-13 Matthew J Reynolds , Gregory Beylkin , Alireza Doostan

Tensor decomposition methods have proven effective in various applications, including compression and acceleration of neural networks. At the same time, the problem of determining optimal decomposition ranks, which present the crucial…

Machine Learning · Computer Science 2023-04-05 Maxim Kodryan , Dmitry Kropotov , Dmitry Vetrov

We develop a tensor network technique that can solve universal reversible classical computational problems, formulated as vertex models on a square lattice [Nat. Commun. 8, 15303 (2017)]. By encoding the truth table of each vertex…

Statistical Mechanics · Physics 2018-03-09 Zhi-Cheng Yang , Stefanos Kourtis , Claudio Chamon , Eduardo R. Mucciolo , Andrei E. Ruckenstein

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

Numerical Analysis · Computer Science 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

We derive a set of causal deep neural networks whose architectures are a consequence of tensor (multilinear) factor analysis, a framework that facilitates causal inference. Forward causal questions are addressed with a neural network…

Machine Learning · Computer Science 2025-06-17 M. Alex O. Vasilescu

Tensor Network States are ans\"atze for the efficient description of quantum many-body systems. Their success for one dimensional problems, together with the fact that they do not suffer from the sign problem and can address the simulation…

High Energy Physics - Lattice · Physics 2022-09-21 Mari Carmen Bañuls , Krzysztof Cichy , J. Ignacio Cirac , Karl Jansen , Stefan Kühn

In this study, we introduce a novel family of tensor networks, termed constrained matrix product states (MPS), designed to incorporate exactly arbitrary discrete linear constraints, including inequalities, into sparse block structures.…

Numerical Analysis · Mathematics 2025-07-10 Javier Lopez-Piqueres , Jing Chen

Higher order tensor inversion is possible for even order. We have shown that a tensor group endowed with the Einstein (contracted) product is isomorphic to the general linear group of degree $n$. With the isomorphic group structures, we…

Numerical Analysis · Mathematics 2011-09-20 Michael Brazell , Na Li , Carmeliza Navasca , Christino Tamon

In recent years, a class of dictionaries have been proposed for multidimensional (tensor) data representation that exploit the structure of tensor data by imposing a Kronecker structure on the dictionary underlying the data. In this work, a…

Machine Learning · Statistics 2017-11-15 Mohsen Ghassemi , Zahra Shakeri , Anand D. Sarwate , Waheed U. Bajwa

Modeling with multidimensional arrays, or tensors, often presents a problem due to high dimensionality. In addition, these structures typically exhibit inherent sparsity, requiring the use of regularization methods to properly characterize…

Methodology · Statistics 2022-10-10 Daniel Spencer , Rajarshi Guhaniyogi , Russell Shinohara , Raquel Prado

Tensor completion refers to the task of estimating the missing data from an incomplete measurement or observation, which is a core problem frequently arising from the areas of big data analysis, computer vision, and network engineering. Due…

Machine Learning · Computer Science 2021-05-21 Chenjian Pan , Chen Ling , Hongjin He , Liqun Qi , Yanwei Xu

Robust tensor CP decomposition involves decomposing a tensor into low rank and sparse components. We propose a novel non-convex iterative algorithm with guaranteed recovery. It alternates between low-rank CP decomposition through gradient…

Machine Learning · Computer Science 2016-04-28 Animashree Anandkumar , Prateek Jain , Yang Shi , U. N. Niranjan

We develop algebraic methods for computations with tensor data. We give 3 applications: extracting features that are invariant under the orthogonal symmetries in each of the modes, approximation of the tensor spectral norm, and…

Representation Theory · Mathematics 2021-01-19 Neriman Tokcan , Jonathan Gryak , Kayvan Najarian , Harm Derksen

The problem of partitioning a large and sparse tensor is considered, where the tensor consists of a sequence of adjacency matrices. Theory is developed that is a generalization of spectral graph partitioning. A best rank-$(2,2,\lambda)$…

Numerical Analysis · Mathematics 2020-12-17 Lars Eldén , Maryam Dehghan

Document structure analysis, such as zone segmentation and table recognition, is a complex problem in document processing and is an active area of research. The recent success of deep learning in solving various computer vision and machine…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Shah Rukh Qasim , Hassan Mahmood , Faisal Shafait

We compare alternative computing strategies for solving the constrained lasso problem. As its name suggests, the constrained lasso extends the widely-used lasso to handle linear constraints, which allow the user to incorporate prior…

Machine Learning · Statistics 2016-11-08 Brian R. Gaines , Hua Zhou

Tensor decompositions are promising tools for big data analytics as they bring multiple modes and aspects of data to a unified framework, which allows us to discover complex internal structures and correlations of data. Unfortunately most…

Numerical Analysis · Computer Science 2014-12-30 Guoxu Zhou , Andrzej Cichocki , Shengli Xie