English
Related papers

Related papers: Using Matrix-Free Tensor-Network Optimizations to …

200 papers

We investigate a novel approach to approximate tensor-network contraction via the exact, matrix-free decomposition of full tensor-networks. We study this method as a means to eliminate the propagation of error in the approximation of…

Chemical Physics · Physics 2025-06-23 Karl Pierce

One method of representing a high-rank tensor as a (hyper-)product of lower-rank tensors is the tensor hypercontraction (THC) method of Hohenstein et al. This strategy has been found to be useful for reducing the polynomial scaling of…

Chemical Physics · Physics 2025-03-26 Avdhoot Datar , Devin A. Matthews

The Canonical Polyadic decomposition (CPD) is a convenient and intuitive tool for tensor factorization; however, for higher-order tensors, it often exhibits high computational cost and permutation of tensor entries, these undesirable…

Numerical Analysis · Computer Science 2018-09-05 Anh-Huy Phan , Andrzej Cichocki , Ivan Oseledets , Salman Ahmadi Asl , Giuseppe Calvi , Danilo Mandic

We present a systematically improvable tensor hypercontraction (THC) factorization based on interpolative separable density fitting (ISDF). We illustrate algorithmic details to achieve this within the framework of Becke's atom-centered…

Chemical Physics · Physics 2020-01-15 Joonho Lee , Lin Lin , Martin Head-Gordon

We develop a quartic-scaling implementation of coupled-cluster singles and doubles based on low-rank tensor hypercontraction (THC) factorizations of both the electron repulsion integrals (ERIs) and the doubles amplitudes. This extends our…

Chemical Physics · Physics 2024-06-19 Edward G. Hohenstein , B. Scott Fales , Robert M. Parrish , Todd J. Martinez

Accurate and fast treatment of electron-electron interactions remains a central challenge in electronic structure theory because post-Hartree-Fock methods often suffered from the computational cost for 4-index electron repulsion integrals…

Chemical Physics · Physics 2025-12-05 Yueyang Zhang , Xuewei Xiong , Wei Wu , Peifeng Su

Wavefunction-based quantum methods are some of the most accurate tools for predicting and analyzing the electronic structure of molecules, in particular for accounting for dynamical electron correlation. However, most methods of including…

Chemical Physics · Physics 2026-03-02 Ishna Satyarth , Eric C. Larson , Devin A. Matthews

There is growing interest to extend low-rank matrix decompositions to multi-way arrays, or tensors. One fundamental low-rank tensor decomposition is the canonical polyadic decomposition (CPD). The challenge of fitting a low-rank,…

Numerical Analysis · Mathematics 2024-07-15 Jeremy M. Myers , Daniel M. Dunlavy

Canonical Polyadic (or CANDECOMP/PARAFAC, CP) decompositions (CPD) are widely applied to analyze high order tensors. Existing CPD methods use alternating least square (ALS) iterations and hence need to unfold tensors to each of the $N$…

Numerical Analysis · Computer Science 2013-06-27 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

The extension of least-squares tensor hypercontracted second- and third-order M{\o}ller-Plessett perturbation theory (LS-THC-MP2 and LS-THC-MP3) to open-shell systems is an important development due to the scaling reduction afforded by THC…

Chemical Physics · Physics 2025-03-26 Tingting Zhao , Megan Simons , Devin A. Matthews

Canonical polyadic decomposition (CPD) is at the core of fast matrix multiplication, a computational problem with widespread implications across several seemingly unrelated problems in computer science. Much recent progress in this field…

Computational Complexity · Computer Science 2025-11-11 Jason Yang

Hybrid density functional theory (DFT) remains intractable for large periodic systems due to the demanding computational cost of exact exchange. We apply the tensor hypercontraction (THC) (or interpolative separable density fitting)…

Computational Physics · Physics 2023-10-13 Adam Rettig , Joonho Lee , Martin Head-Gordon

We incorporate a canonical polyadic decomposition (CPD) based low-level solver as a means to accelerate the environment-level solver for the recently developed MPCC embedding framework. Using CPD, we both factorize the three dominant…

Chemical Physics · Physics 2026-02-19 Karl Pierce , Muhammad Talha Aziz , Avijit Shee , Fabian M. Faulstich

The tensor rank decomposition, also known as canonical polyadic(CP) or simply tensor decomposition, has a long history in multilinear algebra. However, computing a rank decomposition becomes particularly challenging when the rank lies…

Optimization and Control · Mathematics 2025-11-11 Zequn Zheng , Hongchao Zhang , Guangming Zhou

A new algorithm of the canonical polyadic decomposition (CPD) presented here. It features lower computational complexity and memory usage than the available state of the art implementations. We begin with some examples of CPD applications…

Numerical Analysis · Mathematics 2021-10-13 Felipe Bottega Diniz

Deep neural networks (DNNs) are the de facto standard for essential use cases, such as image classification, computer vision, and natural language processing. As DNNs and datasets get larger, they require distributed training on…

Machine Learning · Computer Science 2024-03-07 Minghao Li , Ran Ben Basat , Shay Vargaftik , ChonLam Lao , Kevin Xu , Michael Mitzenmacher , Minlan Yu

This work considers the problem of computing the canonical polyadic decomposition (CPD) of large tensors. Prior works mostly leverage data sparsity to handle this problem, which is not suitable for handling dense tensors that often arise in…

Signal Processing · Electrical Eng. & Systems 2020-03-26 Xiao Fu , Shahana Ibrahim , Hoi-To Wai , Cheng Gao , Kejun Huang

A rising problem in the compression of Deep Neural Networks is how to reduce the number of parameters in convolutional kernels and the complexity of these layers by low-rank tensor approximation. Canonical polyadic tensor decomposition…

Machine Learning · Computer Science 2022-03-08 Anh-Huy Phan , Konstantin Sobolev , Dmitry Ermilov , Igor Vorona , Nikolay Kozyrskiy , Petr Tichavsky , Andrzej Cichocki

Tensors decompositions are a class of tools for analysing datasets of high dimensionality and variety in a natural manner, with the Canonical Polyadic Decomposition (CPD) being a main pillar. While the notion of CPD is closely intertwined…

Signal Processing · Electrical Eng. & Systems 2019-11-15 Giuseppe G. Calvi , Bruno Scalzo Dees , Danilo P. Mandic

In general, algorithms for order-3 CANDECOMP/-PARAFAC (CP), also coined canonical polyadic decomposition (CPD), are easily to implement and can be extended to higher order CPD. Unfortunately, the algorithms become computationally demanding,…

Numerical Analysis · Mathematics 2017-04-26 Anh Huy Phan , Petr Tichavsky , Andrzej Cichocki
‹ Prev 1 2 3 10 Next ›