English
Related papers

Related papers: Fast multidimensional convolution in low-rank form…

200 papers

Despite their simple intuition, convolutions are more tedious to analyze than dense layers, which complicates the transfer of theoretical and algorithmic ideas to convolutions. We simplify convolutions by viewing them as tensor networks…

Machine Learning · Computer Science 2024-10-25 Felix Dangel

We propose a fast algorithm for mode rank truncation of the result of a bilinear operation on 3-tensors given in the Tucker or canonical form. If the arguments and the result have mode sizes n and mode ranks r, the computation costs $O(nr^3…

Numerical Analysis · Mathematics 2012-02-07 Dmitry Savostyanov , Eugene Tyrtyshnikov , Nikolay Zamarashkin

Recently, low-rank tensor completion has become increasingly attractive in recovering incomplete visual data. Considering a color image or video as a three-dimensional (3D) tensor, existing studies have put forward several definitions of…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Shengke Xue , Wenyuan Qiu , Fan Liu , Xinyu Jin

This paper proposes a novel formulation of the tensor completion problem to impute missing entries of data represented by tensors. The formulation is introduced in terms of tensor train (TT) rank which can effectively capture global…

Numerical Analysis · Computer Science 2016-01-07 Ho N. Phien , Hoang D. Tuan , Johann A. Bengua , Minh N. Do

The (efficient and parsimonious) decomposition of higher-order tensors is a fundamental problem with numerous applications in a variety of fields. Several methods have been proposed in the literature to that end, with the Tucker and PARAFAC…

General Mathematics · Mathematics 2024-06-28 Sergio Rozada , Antonio G. Marques

In this paper, we present a new adaptive rank approximation technique for computing solutions to the high-dimensional linear kinetic transport equation. The approach we propose is based on a macro-micro decomposition of the kinetic model in…

Numerical Analysis · Mathematics 2025-09-09 William A. Sands , Wei Guo , Jing-Mei Qiu , Tao Xiong

Tensor train decomposition is a powerful tool for dealing with high-dimensional, large-scale tensor data, which is not suffering from the curse of dimensionality. To accelerate the calculation of the auxiliary unfolding matrix, some…

Numerical Analysis · Mathematics 2023-08-08 Gaohang Yu , Jinhong Feng , Zhongming Chen , Xiaohao Cai , Liqun Qi

We propose a novel approach for hyperspectral super-resolution, that is based on low-rank tensor approximation for a coupled low-rank multilinear (Tucker) model. We show that the correct recovery holds for a wide range of multilinear ranks.…

Signal Processing · Electrical Eng. & Systems 2020-01-22 Clémence Prévost , Konstantin Usevich , Pierre Comon , David Brie

The main aim of this paper is to develop a new algorithm for computing nonnegative low rank tensor approximation for nonnegative tensors that arise in many multi-dimensional imaging applications. Nonnegativity is one of the important…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Tai-Xiang Jiang , Michael K. Ng , Junjun Pan , Guangjing Song

Tensor methods have emerged as a powerful paradigm for consistent learning of many latent variable models such as topic models, independent component analysis and dictionary learning. Model parameters are estimated via CP decomposition of…

Machine Learning · Computer Science 2015-06-22 Furong Huang , Animashree Anandkumar

This work is concerned with approximating a trivariate function defined on a tensor-product domain via function evaluations. Combining tensorized Chebyshev interpolation with a Tucker decomposition of low multilinear rank yields function…

Numerical Analysis · Mathematics 2023-01-24 Sergey Dolgov , Daniel Kressner , Christoph Strössner

Motion planning and control problems are embedded and essential in almost all robotics applications. These problems are often formulated as stochastic optimal control problems and solved using dynamic programming algorithms. Unfortunately,…

Robotics · Computer Science 2018-01-12 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

We present a brief survey on the modern tensor numerical methods for multidimensional stationary and time-dependent partial differential equations (PDEs). The guiding principle of the tensor approach is the rank-structured separable…

Numerical Analysis · Mathematics 2014-08-19 Boris N. Khoromskij

In this paper we propose efficient randomized fixed-precision techniques for low tubal rank approximation of tensors. The proposed methods are faster and more efficient than the existing fixed-precision algorithms for approximating the…

Numerical Analysis · Mathematics 2025-05-22 Salman Ahmadi-Asl , Naeim Rezaeian , Cesar F. Caiafa , Andre L. F. de Almeidad

We address prediction problems on tabular categorical data, where each instance is defined by multiple categorical attributes, each taking values from a finite set. These attributes are often referred to as fields, and their categorical…

This work studies the combinatorial optimization problem of finding an optimal core tensor shape, also called multilinear rank, for a size-constrained Tucker decomposition. We give an algorithm with provable approximation guarantees for its…

Data Structures and Algorithms · Computer Science 2024-06-19 Mehrdad Ghadiri , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

We propose a new algorithm for the computation of a singular value decomposition (SVD) low-rank approximation of a matrix in the Matrix Product Operator (MPO) format, also called the Tensor Train Matrix format. Our tensor network randomized…

Numerical Analysis · Mathematics 2017-07-26 Kim Batselier , Wenjian Yu , Luca Daniel , Ngai Wong

Approximating higher-order tensors by the Tucker format has been applied in many fields such as psychometrics, chemometrics, signal processing, pattern classification, and so on. In this paper, we propose some new Tucker-like approximations…

Numerical Analysis · Mathematics 2023-01-18 Ze-Jia Xie , Xiao-Qing Jin , Zhi Zhao

Learning neural fields has been an active topic in deep learning research, focusing, among other issues, on finding more compact and easy-to-fit representations. In this paper, we introduce a novel low-rank representation termed Tensor…

Machine Learning · Computer Science 2022-10-03 Anton Obukhov , Mikhail Usvyatsov , Christos Sakaridis , Konrad Schindler , Luc Van Gool

The problem of recovering a low $n$-rank tensor is an extension of sparse recovery problem from the low dimensional space (matrix space) to the high dimensional space (tensor space) and has many applications in computer vision and graphics…

Optimization and Control · Mathematics 2014-04-09 Min Zhang , Lei Yang , Zheng-Hai Huang