English
Related papers

Related papers: Tensor train-Karhunen-Lo\`eve expansion for contin…

200 papers

The convergence of many numerical optimization techniques is highly dependent on the initial guess given to the solver. To address this issue, we propose a novel approach that utilizes tensor methods to initialize existing optimization…

Robotics · Computer Science 2023-11-23 Suhan Shetty , Teguh Lembono , Tobias Loew , Sylvain Calinon

Low-rank tensors appear to be prosperous in many applications. However, the sets of bounded-rank tensors are non-smooth and non-convex algebraic varieties, rendering the low-rank optimization problems to be challenging. To this end, we…

Optimization and Control · Mathematics 2024-11-22 Bin Gao , Renfeng Peng , Ya-xiang Yuan

The numerical approximation of partial differential equations (PDEs) poses formidable challenges in high dimensions since classical grid-based methods suffer from the so-called curse of dimensionality. Recent attempts rely on a combination…

Machine Learning · Computer Science 2023-07-31 Lorenz Richter , Leon Sallandt , Nikolas Nüsken

We describe a simple, black-box compression format for tensors with a multiscale structure. By representing the tensor as a sum of compressed tensors defined on increasingly coarse grids, we capture low-rank structures on each grid-scale,…

Numerical Analysis · Mathematics 2020-08-18 Oscar Mickelin , Sertac Karaman

This paper studies a tensor-structured linear regression model with a scalar response variable and tensor-structured predictors, such that the regression parameters form a tensor of order $d$ (i.e., a $d$-fold multiway array) in…

Machine Learning · Computer Science 2020-11-26 Talal Ahmed , Haroon Raja , Waheed U. Bajwa

Higher-order tensors have received increased attention across science and engineering. While most tensor decomposition methods are developed for a single tensor observation, scientific studies often collect side information, in the form of…

Methodology · Statistics 2021-10-29 Jiaxin Hu , Chanwoo Lee , Miaoyan Wang

The optimization algorithms for solving multi-parameter inverse problem for the mathematical model of parabolic equations arising in social networks, epidemiology and economy are investigated. The data fitting is formulated as optimization…

Optimization and Control · Mathematics 2019-06-13 Kabanikhin Sergey , Krivorotko Olga , Zhang Shuhua , Kashtanova Victoriya , Wang Yufang

The goal of tensor completion is to fill in missing entries of a partially known tensor under a low-rank constraint. In this paper, we mainly study low rank third-order tensor completion problems by using Riemannian optimization methods on…

Optimization and Control · Mathematics 2020-11-24 Guang-Jing Song , Xue-Zhong Wang , Michael K. Ng

In this paper, we propose a method for the approximation of the solution of high-dimensional weakly coercive problems formulated in tensor spaces using low-rank approximation formats. The method can be seen as a perturbation of a minimal…

Numerical Analysis · Mathematics 2015-02-13 Marie Billaud-Friess , Anthony Nouy , Olivier Zahm

Tensors or {\em multi-way arrays} are functions of three or more indices $(i,j,k,\cdots)$ -- similar to matrices (two-way arrays), which are functions of two indices $(r,c)$ for (row,column). Tensors have a rich history, stretching over…

Tensor factorization is a powerful tool to analyse multi-way data. Compared with traditional multi-linear methods, nonlinear tensor factorization models are capable of capturing more complex relationships in the data. However, they are…

Machine Learning · Computer Science 2016-05-24 Shandian Zhe , Kai Zhang , Pengyuan Wang , Kuang-chih Lee , Zenglin Xu , Yuan Qi , Zoubin Ghahramani

Part 2 of this monograph builds on the introduction to tensor networks and their operations presented in Part 1. It focuses on tensor network models for super-compressed higher-order representation of data/parameters and related cost…

Numerical Analysis · Computer Science 2017-08-31 A. Cichocki , A-H. Phan , Q. Zhao , N. Lee , I. V. Oseledets , M. Sugiyama , D. Mandic

High-order clustering aims to identify heterogeneous substructures in multiway datasets that arise commonly in neuroimaging, genomics, social network studies, etc. The non-convex and discontinuous nature of this problem pose significant…

Methodology · Statistics 2022-10-11 Rungang Han , Yuetian Luo , Miaoyan Wang , Anru R. Zhang

We propose a modular framework for multi-relational learning via tensor decomposition. In our learning setting, the training data contains multiple types of relationships among a set of objects, which we represent by a sparse three-mode…

Machine Learning · Computer Science 2013-06-04 Ben London , Theodoros Rekatsinas , Bert Huang , Lise Getoor

In this paper, we introduce a method for multivariate function approximation using function evaluations, Chebyshev polynomials, and tensor-based compression techniques via the Tucker format. We develop novel randomized techniques to…

Numerical Analysis · Mathematics 2021-07-29 Arvind K. Saibaba , Rachel Minster , Misha E. Kilmer

Tensors, or multi-linear forms, are important objects in a variety of areas from analytics, to combinatorics, to computational complexity theory. Notions of tensor rank aim to quantify the "complexity" of these forms, and are thus also…

Computational Complexity · Computer Science 2023-06-16 Mandar Juvekar , Arian Nadjimzadah

In this paper, we introduce a sketching algorithm for constructing a tensor train representation of a probability density from its samples. Our method deviates from the standard recursive SVD-based procedure for constructing a tensor train.…

Numerical Analysis · Mathematics 2023-06-27 YH. Hur , J. G. Hoskins , M. Lindsey , E. M. Stoudenmire , Y. Khoo

We present a new algorithm for recovering paths from their third-order signature tensors, an inverse problem in rough analysis. Our algorithm provides the exact solution to this learning problem and improves upon current approaches by an…

Rings and Algebras · Mathematics 2025-12-17 Leonard Schmitz

In this paper, we present a novel method for co-clustering, an unsupervised learning approach that aims at discovering homogeneous groups of data instances and features by grouping them simultaneously. The proposed method uses the entropy…

Machine Learning · Statistics 2017-05-22 Charlotte Laclau , Ievgen Redko , Basarab Matei , Younès Bennani , Vincent Brault

This paper lies in the intersection of several fields: number theory, lattice theory, multilinear algebra, and scientific computing. We adapt existing solution algorithms for tensor eigenvalue problems to the tensor-train framework. As an…

Numerical Analysis · Mathematics 2017-10-05 Harri Hakula , Pauliina Ilmonen , Vesa Kaarnioja