English
Related papers

Related papers: Tensor Network-Constrained Kernel Machines as Gaus…

200 papers

An increasing amount of collected data are high-dimensional multi-way arrays (tensors), and it is crucial for efficient learning algorithms to exploit this tensorial structure as much as possible. The ever-present curse of dimensionality…

Machine Learning · Computer Science 2021-08-04 Kirandeep Kour , Sergey Dolgov , Martin Stoll , Peter Benner

This paper presents an approach for constrained Gaussian Process (GP) regression where we assume that a set of linear transformations of the process are bounded. It is motivated by machine learning applications for high-consequence…

Machine Learning · Statistics 2019-09-12 Christian Agrell

Applying Gaussian processes (GPs) to very large datasets remains a challenge due to limited computational scalability. Matrix structures, such as the Kronecker product, can accelerate operations significantly, but their application commonly…

Tensor robust principal component analysis (TRPCA) is a fundamental model in machine learning and computer vision. Recently, tensor train (TT) decomposition has been verified effective to capture the global low-rank correlation for tensor…

Machine Learning · Computer Science 2022-03-14 Yuning Qiu , Guoxu Zhou , Zhenhao Huang , Qibin Zhao , Shengli Xie

We apply Gaussian processes (GP) in order to impose constraints on teleparallel gravity and its $f(T)$ extensions. We use available $H(z)$ observations from (i) cosmic chronometers data (CC); (ii) Supernova Type Ia (SN) data from the…

General Relativity and Quantum Cosmology · Physics 2021-02-03 Rebecca Briffa , Salvatore Capozziello , Jackson Levi Said , Jurgen Mifsud , Emmanuel N. Saridakis

Gaussian Processes (GPs) are widely recognized as powerful non-parametric models for regression and classification. Traditional GP frameworks predominantly operate under the assumption that the inputs are either accurately known or subject…

Systems and Control · Electrical Eng. & Systems 2025-10-14 Muzaffar Qureshi , Tochukwu Elijah Ogri , Zachary I. Bell , Wanjiku A. Makumi , Rushikesh Kamalapurkar

Low-rank tensor regression, a new model class that learns high-order correlation from data, has recently received considerable attention. At the same time, Gaussian processes (GP) are well-studied machine learning models for structure…

Machine Learning · Computer Science 2017-11-01 Rose Yu , Guangyu Li , Yan Liu

In numerous applications, binary reactions or event counts are observed and stored within high-order tensors. Tensor decompositions (TDs) serve as a powerful tool to handle such high-dimensional and sparse data. However, many traditional…

Machine Learning · Computer Science 2024-01-17 Zerui Tao , Toshihisa Tanaka , Qibin Zhao

In this paper we review basic and emerging models and associated algorithms for large-scale tensor networks, especially Tensor Train (TT) decompositions using novel mathematical and graphical representations. We discus the concept of…

Numerical Analysis · Computer Science 2014-08-25 Andrzej Cichocki

In this paper, we focus on the fixed TT-rank and precision problems of finding an approximation of the tensor train (TT) decomposition of a tensor. Note that the TT-SVD and TT-cross are two well-known algorithms for these two problems.…

Numerical Analysis · Mathematics 2025-02-11 Maolin Che , Yimin Wei , Hong Yan

Tensor rank learning for canonical polyadic decomposition (CPD) has long been deemed as an essential yet challenging problem. In particular, since the tensor rank controls the complexity of the CPD model, its inaccurate learning would cause…

Machine Learning · Computer Science 2022-03-30 Lei Cheng , Zhongtao Chen , Qingjiang Shi , Yik-Chung Wu , Sergios Theodoridis

A new algorithm of the canonical polyadic decomposition (CPD) presented here. It features lower computational complexity and memory usage than the available state of the art implementations. We begin with some examples of CPD applications…

Numerical Analysis · Mathematics 2021-10-13 Felipe Bottega Diniz

Bayesian model updating based on Gaussian Process (GP) models has received attention in recent years, which incorporates kernel-based GPs to provide enhanced fidelity response predictions. Although most kernel functions provide high fitting…

Gaussian processes (GPs) are powerful and widely used probabilistic regression models, but their effectiveness in practice is often limited by the choice of kernel function. This kernel function is typically handcrafted from a small set of…

Machine Learning · Computer Science 2026-02-13 Jihao Andreas Lin , Sebastian Ament , Louis C. Tiao , David Eriksson , Maximilian Balandat , Eytan Bakshy

In recent years, the application of tensors has become more widespread in fields that involve data analytics and numerical computation. Due to the explosive growth of data, low-rank tensor decompositions have become a powerful tool to…

Numerical Analysis · Mathematics 2020-11-03 Lingjie Li , Wenjian Yu , Kim Batselier

In the framework of tensor spaces, we consider orthogonalization kernels to generate an orthogonal basis of a tensor subspace from a set of linearly independent tensors. In particular, we experimentally study the loss of orthogonality of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-17 Olivier Coulaud , Luc Giraud , Martina Iannacito

In this paper, we consider the tensor completion problem representing the solution in the tensor train (TT) format. It is assumed that tensor is high-dimensional, and tensor values are generated by an unknown smooth function. The assumption…

Numerical Analysis · Mathematics 2020-08-27 Yermek Kapushev , Ivan Oseledets , Evgeny Burnaev

Capsule Networks attempt to represent patterns in images in a way that preserves hierarchical spatial relationships. Additionally, research has demonstrated that these techniques may be robust against adversarial perturbations. We present…

Machine Learning · Statistics 2019-06-10 Taylor Killian , Justin Goodwin , Olivia Brown , Sung-Hyun Son

While the great capability of Transformers significantly boosts prediction accuracy, it could also yield overconfident predictions and require calibrated uncertainty estimation, which can be commonly tackled by Gaussian processes (GPs).…

Machine Learning · Computer Science 2024-05-29 Yingyi Chen , Qinghua Tao , Francesco Tonin , Johan A. K. Suykens

We introduce new Gaussian Process (GP) high-order approximations to linear operations that are frequently used in various numerical methods. Our method employs the kernel-based GP regression modeling, a non-parametric Bayesian approach to…

Computational Physics · Physics 2025-06-09 Christopher DeGrendele , Dongwook Lee