English
Related papers

Related papers: Solving Tensor Low Cycle Rank Approximation

200 papers

We present a new rank-adaptive tensor method to compute the numerical solution of high-dimensional nonlinear PDEs. The method combines functional tensor train (FTT) series expansions, operator splitting time integration, and a new…

Numerical Analysis · Mathematics 2021-04-27 Alec Dektor , Abram Rodgers , Daniele Venturi

We show that a generic tensor $T\in \mathbb{F}^{n\times n\times \dots\times n}$ of order $k$ and CP rank $d$ can be uniquely recovered from $n\log n+dn\log \log n +o(n\log \log n) $ uniformly random entries with high probability if $d$ and…

Combinatorics · Mathematics 2024-08-08 Hiroki Hamaguchi , Shin-ichi Tanigawa

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

Numerical Analysis · Computer Science 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

Probabilistic context-free grammars (PCFGs) with neural parameterization have been shown to be effective in unsupervised phrase-structure grammar induction. However, due to the cubic computational complexity of PCFG representation and…

Computation and Language · Computer Science 2021-04-29 Songlin Yang , Yanpeng Zhao , Kewei Tu

We investigate structural complexity measures on digraphs, in particular the cycle rank. This concept is intimately related to a classical topic in formal language theory, namely the star height of regular languages. We explore this…

Discrete Mathematics · Computer Science 2013-04-17 Hermann Gruber

Low-rank tensor approximation error bounds are proposed for the case of noisy input data that depend on low-rank representation type, rank and the dimensionality of the tensor. The bounds show that high-dimensional low-rank structured…

Numerical Analysis · Mathematics 2024-12-16 Sergey Petrov , Nikolai Zamarashkin

In this short paper we bridge two seemingly unrelated sparse approximation topics: continuous sparse coding and low-rank approximations. We show that for a specific choice of continuous dictionary, linear systems with nuclear-norm…

Information Theory · Computer Science 2020-09-15 Clement Elvira , Jeremy E. Cohen , Cedric Herzet , Remi Gribonval

Tensor network contractions are widely used in statistical physics, quantum computing, and computer science. We introduce a method to efficiently approximate tensor network contractions using low-rank approximations, where each intermediate…

Quantum Physics · Physics 2025-01-01 Linjian Ma , Matthew Fishman , Miles Stoudenmire , Edgar Solomonik

We address prediction problems on tabular categorical data, where each instance is defined by multiple categorical attributes, each taking values from a finite set. These attributes are often referred to as fields, and their categorical…

The concept of tensor rank, introduced in the twenties, has been popularized at the beginning of the seventies. This has allowed to carry out Factor Analysis on arrays with more than two indices. The generic rank may be seen as an upper…

Other Computer Science · Computer Science 2008-02-19 P. Comon , J. ten Berge

We consider a framework for the construction of iterative schemes for operator equations that combine low-rank approximation in tensor formats and adaptive approximation in a basis. Under fairly general assumptions, we obtain a rigorous…

Numerical Analysis · Mathematics 2014-03-17 Markus Bachmayr , Wolfgang Dahmen

A major challenge to the problem of community question answering is the lexical and semantic gap between the sentence representations. Some solutions to minimize this gap includes the introduction of extra parameters to deep models or…

Computation and Language · Computer Science 2018-01-23 Gaurav Bhatt , Shivam Sharma , Balasubramanian Raman

The so-called block-term decomposition (BTD) tensor model, especially in its rank-$(L_r,L_r,1)$ version, has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of…

Methodology · Statistics 2022-05-04 Paris V. Giampouras , Athanasios A. Rontogiannis , Eleftherios Kofidis

The results of Strassen and Raz show that good enough tensor rank lower bounds have implications for algebraic circuit/formula lower bounds. We explore tensor rank lower and upper bounds, focusing on explicit tensors. For odd d, we…

Computational Complexity · Computer Science 2012-03-05 Boris Alexeev , Michael Forbes , Jacob Tsimerman

There has been an increased interest in multimodal language processing including multimodal dialog, question answering, sentiment analysis, and speech recognition. However, naturally occurring multimodal data is often imperfect as a result…

Machine Learning · Computer Science 2019-07-03 Paul Pu Liang , Zhun Liu , Yao-Hung Hubert Tsai , Qibin Zhao , Ruslan Salakhutdinov , Louis-Philippe Morency

The block tensor of trifocal tensors provides crucial geometric information on the three-view geometry of a scene. The underlying synchronization problem seeks to recover camera poses (locations and orientations up to a global…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Daniel Miao , Gilad Lerman , Joe Kileel

In this paper, we introduce a new tensor decomposition for third order tensors, which decomposes a third order tensor to three third order low rank tensors in a balanced way. We call such a decomposition the triple decomposition, and the…

Numerical Analysis · Mathematics 2020-03-03 Liqun Qi , Yannan Chen , Mayank Bakshi , Xinzhen Zhang

The goals of this work are two-fold: firstly, to propose a new theoretical framework for representing random fields on a large class of multidimensional geometrical domain in the tensor train format; secondly, to develop a new algorithm…

Numerical Analysis · Mathematics 2020-05-26 Ling-Ze Bu , Wei Zhao , Wei Wang

We consider the task of low-multilinear-rank functional regression, i.e., learning a low-rank parametric representation of functions from scattered real-valued data. Our first contribution is the development and analysis of an efficient…

Computation · Statistics 2018-09-26 Alex A. Gorodetsky , John D. Jakeman

Recently, there has been a growing interest in efficient numerical algorithms based on tensor networks and low-rank techniques to approximate high-dimensional functions and solutions to high-dimensional PDEs. In this paper, we propose a new…

Numerical Analysis · Mathematics 2023-08-16 Alec Dektor , Daniele Venturi