English
Related papers

Related papers: Using Matrix-Free Tensor-Network Optimizations to …

200 papers

Tensor networks developed in the context of condensed matter physics try to approximate order-$N$ tensors with a reduced number of degrees of freedom that is only polynomial in $N$ and arranged as a network of partially contracted smaller…

Machine Learning · Computer Science 2025-01-07 Hao Chen , Thomas Barthel

Approximation of a tensor network by approximating (e.g., factorizing) one or more of its constituent tensors can be improved by canceling the leading-order error due to the constituents' approximation. The utility of such robust…

Chemical Physics · Physics 2024-07-30 Karl Pierce , Varun Rishi , Edward F. Valeev

Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of…

Machine Learning · Statistics 2017-08-03 Masaaki Imaizumi , Takanori Maehara , Kohei Hayashi

Data compression is a popular technique for improving the efficiency of data processing workloads such as SQL queries and more recently, machine learning (ML) with classical batch gradient methods. But the efficacy of such ideas for…

Machine Learning · Computer Science 2019-01-23 Fengan Li , Lingjiao Chen , Yijing Zeng , Arun Kumar , Jeffrey F. Naughton , Jignesh M. Patel , Xi Wu

Recently, coupled tensor decomposition has been widely used in data fusion of a hyperspectral image (HSI) and a multispectral image (MSI) for hyperspectral super-resolution (HSR). However, exsiting works often ignore the inherent…

Signal Processing · Electrical Eng. & Systems 2025-01-28 Xi-Yuan Liu , Xiao-Feng Gong , Lei Wang , Wei Feng , Qiu-Hua Lin

In tensor completion tasks, the traditional low-rank tensor decomposition models suffer from the laborious model selection problem due to their high model sensitivity. In particular, for tensor ring (TR) decomposition, the number of model…

Machine Learning · Computer Science 2018-12-03 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

Many real-world datasets are represented as tensors, i.e., multi-dimensional arrays of numerical values. Storing them without compression often requires substantial space, which grows exponentially with the order. While many tensor…

Machine Learning · Computer Science 2023-09-21 Taehyung Kwon , Jihoon Ko , Jinhong Jung , Kijung Shin

Exact recovery of tensor decomposition (TD) methods is a desirable property in both unsupervised learning and scientific data analysis. The numerical defects of TD methods, however, limit their practical applications on real-world data. As…

Machine Learning · Computer Science 2020-01-30 Chao Li , Mohammad Emtiyaz Khan , Zhun Sun , Gang Niu , Bo Han , Shengli Xie , Qibin Zhao

The tensor-train (TT) decomposition expresses a tensor in a data-sparse format used in molecular simulations, high-order correlation functions, and optimization. In this paper, we propose four parallelizable algorithms that compute the TT…

Numerical Analysis · Mathematics 2021-11-23 Tianyi Shi , Maximilian Ruth , Alex Townsend

Tensor decompositions are promising tools for big data analytics as they bring multiple modes and aspects of data to a unified framework, which allows us to discover complex internal structures and correlations of data. Unfortunately most…

Numerical Analysis · Computer Science 2014-12-30 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

In the present work, a method is proposed in order to compute a Canonical Polyadic (CP) approximation of a given tensor. It is based on a greedy method and an adaptation of the TT-SVD method. The proposed approach can be straightforwardly…

Numerical Analysis · Mathematics 2020-11-20 Virginie Ehrlacher , Maria Fuente Ruiz , Damiano Lombardi

In this work, we develop an optimization framework for problems whose solutions are well-approximated by Hierarchical Tucker (HT) tensors, an efficient structured tensor format based on recursive subspace factorizations. By exploiting the…

Numerical Analysis · Mathematics 2014-05-12 Curt Da Silva , Felix J. Herrmann

We introduce a new method to approximate Euclidean correlation functions by exponential sums. The Truncated Hankel Correlator (THC) method builds a Hankel matrix from the full correlator data available and truncates the eigenspectrum of…

High Energy Physics - Lattice · Physics 2025-10-20 Johann Ostmeyer , Carsten Urbach

The impact of applying state-of-the-art tensor factorization techniques to modern nuclear Hamiltonians derived from chiral effective field theory is investigated. Subsequently, the error induced by the tensor decomposition of the input…

Nuclear Theory · Physics 2019-03-27 Alexander Tichai , Roman Schutski , Gustavo E. Scuseria , Thomas Duguet

We study the least-squares (LS) functional of the canonical polyadic (CP) tensor decomposition. Our approach is based on the elimination of one factor matrix which results in a reduced functional. The reduced functional is reformulated into…

Numerical Analysis · Mathematics 2011-09-20 Stefan Kindermann , Carmeliza Navasca

Motivated by a flurry of recent work on efficient tensor decomposition algorithms, we show that the celebrated moment matrix extension algorithm of Brachat, Comon, Mourrain, and Tsigaridas for symmetric tensor canonical polyadic (CP)…

Algebraic Geometry · Mathematics 2025-07-01 Bobby Shi , Julia Lindberg , Joe Kileel

We consider $N$-way data arrays and low-rank tensor factorizations where the time mode is coded as a sparse linear combination of temporal elements from an over-complete library. Our method, Shape Constrained Tensor Decomposition (SCTD) is…

Machine Learning · Statistics 2016-08-17 Bethany Lusch , Eric C. Chi , J. Nathan Kutz

There is a significant expansion in both volume and range of applications along with the concomitant increase in the variety of data sources. These ever-expanding trends have highlighted the necessity for more versatile analysis tools that…

Numerical Analysis · Mathematics 2021-09-09 Ilya Kisil , Giuseppe G. Calvi , Kriton Konstantinidis , Yao Lei Xu , Danilo P. Mandic

Markov Decision Process (MDP) is the underlying model for optimal planning for decision-theoretic agents in stochastic environments. Although much research focuses on solving MDP problems both in tabular form or using factored…

Artificial Intelligence · Computer Science 2021-03-02 Daniela Kuinchtner , Afonso Sales , Felipe Meneguzzi

We consider the rank-reduced coupled-cluster theory with single and double excitations (RR-CCSD) introduced recently [Parrish \emph{et al.}, J. Chem. Phys. {\bf 150}, 164118 (2019)]. The main feature of this method is the decomposed form of…

Chemical Physics · Physics 2022-02-21 Michał Lesiuk