English
Related papers

Related papers: A Fast Implementation for the Canonical Polyadic D…

200 papers

We study tensor completion (TC) through the lens of low-rank tensor decomposition (TD). Many TD algorithms use fast alternating minimization methods to solve highly structured linear regression problems at each step (e.g., for CP, Tucker,…

Data Structures and Algorithms · Computer Science 2025-08-13 Mehrdad Ghadiri , Matthew Fahrbach , Yunbum Kook , Ali Jadbabaie

We present a fast algorithm for approximate Canonical Correlation Analysis (CCA). Given a pair of tall-and-thin matrices, the proposed algorithm first employs a randomized dimensionality reduction transform to reduce the size of the input…

Data Structures and Algorithms · Computer Science 2013-05-03 Haim Avron , Christos Boutsidis , Sivan Toledo , Anastasios Zouzias

Multi-way data analysis has become an essential tool for capturing underlying structures in higher-order datasets stored in tensor $\mathcal{X} \in \mathbb{R} ^{I_1 \times \dots \times I_N} $. $CANDECOMP/PARAFAC$ (CP) decomposition has been…

Machine Learning · Computer Science 2020-03-20 Ali Anaissi , Basem Suleiman , Seid Miad Zandavi

We propose new algorithms for computing triangular decompositions of polynomial systems incrementally. With respect to previous works, our improvements are based on a {\em weakened} notion of a polynomial GCD modulo a regular chain, which…

Symbolic Computation · Computer Science 2011-04-06 Changbo Chen , Marc Moreno Maza

This paper presents a canonical polyadic (CP) tensor decomposition that addresses unaligned observations. The mode with unaligned observations is represented using functions in a reproducing kernel Hilbert space (RKHS). We introduce a…

Machine Learning · Statistics 2025-08-12 Runshi Tang , Tamara Kolda , Anru R. Zhang

We introduce a new, quadratically convergent algorithm for finding maximum absolute value entries of tensors represented in the canonical format. The computational complexity of the algorithm is linear in the dimension of the tensor. We…

Numerical Analysis · Mathematics 2017-09-13 Matthew J Reynolds , Gregory Beylkin , Alireza Doostan

This paper introduces a new method for minimizing matrix-smooth non-convex objectives through the use of novel Compressed Gradient Descent (CGD) algorithms enhanced with a matrix-valued stepsize. The proposed algorithms are theoretically…

Optimization and Control · Mathematics 2024-04-23 Hanmin Li , Avetik Karagulyan , Peter Richtárik

CP decomposition (CPD) is prevalent in chemometrics, signal processing, data mining and many more fields. While many algorithms have been proposed to compute the CPD, alternating least squares (ALS) remains one of the most widely used…

Machine Learning · Computer Science 2022-05-12 Navjot Singh , Edgar Solomonik

Cylindrical Algebraic Decomposition (CAD) has long been one of the most important algorithms within Symbolic Computation, as a tool to perform quantifier elimination in first order logic over the reals. More recently it is finding…

Symbolic Computation · Computer Science 2020-03-23 Matthew England , Russell Bradford , James H. Davenport

As a generalization of the two-dimensional Fourier transform (2D FT) and 2D fractional Fourier transform, the 2D nonseparable linear canonical transform (2D NsLCT) is useful in optics, signal and image processing. To reduce the digital…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Soo-Chang Pei , Shih-Gu Huang

Tensor Train~(TT) decomposition is widely used in the machine learning and quantum physics communities as a popular tool to efficiently compress high-dimensional tensor data. In this paper, we propose an efficient algorithm to accelerate…

Data Structures and Algorithms · Computer Science 2024-06-07 Vivek Bharadwaj , Beheshteh T. Rakhshan , Osman Asif Malik , Guillaume Rabusseau

Convolutional neural networks show outstanding results in a variety of computer vision tasks. However, a neural network architecture design usually faces a trade-off between model performance and computational/memory complexity. For some…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Pavel Kaloshin

Deep neural networks (DNNs) frequently contain far more weights, represented at a higher precision, than are required for the specific task which they are trained to perform. Consequently, they can often be compressed using techniques such…

Machine Learning · Computer Science 2020-12-03 Vinu Joseph , Saurav Muralidharan , Animesh Garg , Michael Garland , Ganesh Gopalakrishnan

This paper presents a novel end-to-end Learned Point Cloud Geometry Compression (a.k.a., Learned-PCGC) framework, to efficiently compress the point cloud geometry (PCG) using deep neural networks (DNN) based variational autoencoders (VAE).…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jianqiang Wang , Hao Zhu , Zhan Ma , Tong Chen , Haojie Liu , Qiu Shen

Tensor computations are increasingly prevalent numerical techniques in data science, but pose unique challenges for high-performance implementation. We provide novel algorithms and systems infrastructure which enable efficient parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-26 Navjot Singh , Zecheng Zhang , Xiaoxiao Wu , Naijing Zhang , Siyuan Zhang , Edgar Solomonik

As state of the art neural networks (NNs) continue to grow in size, their resource-efficient implementation becomes ever more important. In this paper, we introduce a compression scheme that reduces the number of computations required for…

Machine Learning · Computer Science 2025-04-25 Hans Rosenberger , Rodrigo Fischer , Johanna S. Fröhlich , Ali Bereyhi , Ralf R. Müller

This paper proposes a domain decomposition subspace neural network method for efficiently solving linear and nonlinear partial differential equations. By combining the principles of domain decomposition and subspace neural networks, the…

Numerical Analysis · Mathematics 2025-05-28 Zhenxing Fu , Hongliang Liu , Zhiqiang Sheng , Baixue Xing

In this work, we propose a decoupled support vector regression (SVR) approach for direct canonical polyadic decomposition (CPD) of a potential energy surface (PES) through a set of discrete training energy data. This approach, denoted by…

Chemical Physics · Physics 2024-11-01 Zekai Miao , Xingyu Zhang , Qingfei Song , Qingyong Meng

Tensor decompositions are a fundamental tool in scientific computing and data analysis. In many applications -- such as simulation data on irregular grids, surrogate modeling for parameterized PDEs, or spectroscopic measurements -- the data…

Numerical Analysis · Mathematics 2026-03-27 Johannes J. Brust , Tamara G. Kolda

We find conditions that guarantee that a decomposition of a generic third-order tensor in a minimal number of rank-$1$ tensors (canonical polyadic decomposition (CPD)) is unique up to permutation of rank-$1$ tensors. Then we consider the…

Algebraic Geometry · Mathematics 2016-07-20 Ignat Domanov , Lieven De Lathauwer