English
Related papers

Related papers: Efficient Nonparametric Tensor Decomposition for B…

200 papers

Compressed sensing extends from the recovery of sparse vectors from undersampled measurements via efficient algorithms to the recovery of matrices of low rank from incomplete information. Here we consider a further extension to the…

Numerical Analysis · Mathematics 2014-11-04 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

The tensor-train (TT) decomposition expresses a tensor in a data-sparse format used in molecular simulations, high-order correlation functions, and optimization. In this paper, we propose four parallelizable algorithms that compute the TT…

Numerical Analysis · Mathematics 2021-11-23 Tianyi Shi , Maximilian Ruth , Alex Townsend

Non-conjugate Gaussian processes (NCGPs) define a flexible probabilistic framework to model categorical, ordinal and continuous data, and are widely used in practice. However, exact inference in NCGPs is prohibitively expensive for large…

Machine Learning · Computer Science 2025-04-18 Lukas Tatzel , Jonathan Wenger , Frank Schneider , Philipp Hennig

Tensor ring (TR) decomposition is a simple but effective tensor network for analyzing and interpreting latent patterns of tensors. In this work, we propose a doubly randomized optimization framework for computing TR decomposition. It can be…

Numerical Analysis · Mathematics 2023-03-30 Yajie Yu , Hanyu Li , Jingchun Zhou

Efficient modelling of feature interactions underpins supervised learning for non-sequential tasks, characterized by a lack of inherent ordering of features (variables). The brute force approach of learning a parameter for each interaction…

Machine Learning · Computer Science 2021-03-31 Alexandros Haliassos , Kriton Konstantinidis , Danilo P. Mandic

Numerous Graph Neural Networks (GNNs) have been developed to tackle the challenge of Knowledge Graph Embedding (KGE). However, many of these approaches overlook the crucial role of relation information and inadequately integrate it with…

Machine Learning · Computer Science 2024-09-24 Peyman Baghershahi , Reshad Hosseini , Hadi Moradi

Capturing the composition patterns of relations is a vital task in knowledge graph completion. It also serves as a fundamental step towards multi-hop reasoning over learned knowledge. Previously, several rotation-based translational methods…

Artificial Intelligence · Computer Science 2022-01-12 Haonan Lu , Hailin Hu , Xiaodong Lin

This paper presents a method for approximate Gaussian process (GP) regression with tensor networks (TNs). A parametric approximation of a GP uses a linear combination of basis functions, where the accuracy of the approximation depends on…

Machine Learning · Statistics 2023-11-01 Clara Menzen , Eva Memmel , Kim Batselier , Manon Kok

A novel tensor decomposition framework, termed Tensor Star (TS) decomposition, is proposed which represents a new type of tensor network decomposition based on tensor contractions. This is achieved by connecting the core tensors in a ring…

Image and Video Processing · Electrical Eng. & Systems 2024-09-10 Wuyang Zhou , Yu-Bang Zheng , Qibin Zhao , Danilo Mandic

Gaussian processes (GPs) can provide a principled approach to uncertainty quantification with easy-to-interpret kernel hyperparameters, such as the lengthscale, which controls the correlation distance of function values. However, selecting…

In this work, we present a new approach for the distributed computation of the PARAFAC decomposition of a third-order tensor across a network of collaborating nodes. We are interested in the case where the overall data gathered across the…

Numerical Analysis · Computer Science 2014-06-09 Alain Y. Kibangou , André L. F. de Almeida

In scientific fields such as quantum computing, physics, chemistry, and machine learning, high dimensional data are typically represented using sparse tensors. Tensor contraction is a popular operation on tensors to exploit meaning or alter…

Data Structures and Algorithms · Computer Science 2024-10-15 Andrew Ensinger , Gabriel Kulp , Victor Agostinelli , Dennis Lyakhov , Lizhong Chen

Many critical EDA problems suffer from the curse of dimensionality, i.e. the very fast-scaling computational burden produced by large number of parameters and/or unknown variables. This phenomenon may be caused by multiple spatial or…

Numerical Analysis · Computer Science 2016-11-18 Zheng Zhang , Kim Batselier , Haotian Liu , Luca Daniel , Ngai Wong

In tensor completion tasks, the traditional low-rank tensor decomposition models suffer from the laborious model selection problem due to their high model sensitivity. In particular, for tensor ring (TR) decomposition, the number of model…

Machine Learning · Computer Science 2018-12-03 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

This paper proposes a novel formulation of the tensor completion problem to impute missing entries of data represented by tensors. The formulation is introduced in terms of tensor train (TT) rank which can effectively capture global…

Numerical Analysis · Computer Science 2016-01-07 Ho N. Phien , Hoang D. Tuan , Johann A. Bengua , Minh N. Do

Sparse tensor operations are increasingly important in diverse applications such as social networks, deep learning, diagnosis, crime, and review analysis. However, a major obstacle in sparse tensor research is the lack of large-scale sparse…

Mathematical Software · Computer Science 2025-12-19 Tugba Torun , Ameer Taweel , Didem Unat

The so-called block-term decomposition (BTD) tensor model has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of \emph{blocks} of rank higher than one, a…

Numerical Analysis · Mathematics 2021-04-21 Athanasios A. Rontogiannis , Eleftherios Kofidis , Paris V. Giampouras

Many datasets are in the form of tables of binned data. Performing regression on these data usually involves either reading off bin heights, ignoring data from neighbouring bins or interpolating between bins thus over or underestimating the…

Machine Learning · Statistics 2019-05-21 Michael Thomas Smith , Mauricio A Alvarez , Neil D Lawrence

To address the scalability limitations of Gaussian process (GP) regression, several approximation techniques have been proposed. One such method is based on tensor networks, which utilizes an exponential number of basis functions without…

Machine Learning · Statistics 2025-12-03 Albert Saiapin , Kim Batselier

Tensor networks establish an adaptable framework for the emulation of quantum circuits. By partitioning exponentially large registers and gates into smaller tensors, this unlocks fast transformations through tensor algebra, and grants fine…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-13 Jakub Adamski , Oliver Thomson Brown