English
Related papers

Related papers: Low-Rank Tensors for Multi-Dimensional Markov Mode…

200 papers

Tensor decomposition is a mathematically supported technique for data compression. It consists of applying some kind of a Low Rank Decomposition technique on the tensors or matrices in order to reduce the redundancy of the data. However, it…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Austin Wen , Yang Liu

In this paper, we study the problem of low-rank tensor learning, where only a few of training samples are observed and the underlying tensor has a low-rank structure. The existing methods are based on the sum of nuclear norms of unfolding…

Machine Learning · Computer Science 2024-10-25 Sijia Xia , Michael K. Ng , Xiongjun Zhang

We consider a novel algorithm, for the completion of partially observed low-rank tensors, as a generalization of matrix completion. The proposed low-rank tensor completion (TC) method builds on the conventional nuclear norm (NN)…

Machine Learning · Statistics 2026-05-06 Niclas Führling , Getuar Rexhepi , Giuseppe Thadeu Freitas de Abreu

Multimodal research is an emerging field of artificial intelligence, and one of the main research problems in this field is multimodal fusion. The fusion of multimodal data is the process of integrating multiple unimodal representations…

Artificial Intelligence · Computer Science 2018-06-04 Zhun Liu , Ying Shen , Varun Bharadhwaj Lakshminarasimhan , Paul Pu Liang , Amir Zadeh , Louis-Philippe Morency

In low-rank tensor completion tasks, due to the underlying multiple large-scale singular value decomposition (SVD) operations and rank selection problem of the traditional methods, they suffer from high computational cost and high…

Numerical Analysis · Computer Science 2018-05-23 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

Multitask learning (MTL) can utilize the relatedness between multiple tasks for performance improvement. The advent of multimodal data allows tasks to be referenced by multiple indices. High-order tensors are capable of providing efficient…

Machine Learning · Computer Science 2023-08-23 Jiani Liu , Qinghua Tao , Ce Zhu , Yipeng Liu , Johan A. K. Suykens

We provide evidence that randomized low-rank factorization is a powerful tool for the determination of the ground state properties of low-dimensional lattice Hamiltonians through tensor network techniques. In particular, we show that…

In this study, we consider the numerical solution of large systems of linear equations obtained from the stochastic Galerkin formulation of stochastic partial differential equations. We propose an iterative algorithm that exploits the…

Numerical Analysis · Mathematics 2016-05-18 Kookjin Lee , Howard C. Elman

The numerical solution of kinetic equations is challenging due to the high dimensionality of the underlying phase space. In this paper, we develop a dynamical low-rank method based on the projector-splitting integrator in tensor-train (TT)…

Numerical Analysis · Mathematics 2026-03-31 Geshuo Wang , Jingwei Hu

Engineering and applied sciences use models of increasing complexity to simulate the behaviour of manufactured and physical systems. Propagation of uncertainties from the input to a response quantity of interest through such models may…

Computation · Statistics 2016-06-29 K. Konakli , B. Sudret

Time-dependent kinetic models are ubiquitous in computational science and engineering. The underlying integro-differential equations in these models are high-dimensional, comprised of a six--dimensional phase space, making simulations of…

Numerical Analysis · Mathematics 2025-06-23 Lukas Einkemmer , Katharina Kormann , Jonas Kusch , Ryan G. McClarren , Jing-Mei Qiu

Using the matrix product state (MPS) representation of the recently proposed tensor ring decompositions, in this paper we propose a tensor completion algorithm, which is an alternating minimization algorithm that alternates over the factors…

Machine Learning · Computer Science 2017-07-27 Wenqi Wang , Vaneet Aggarwal , Shuchin Aeron

Tensor train (TT) factorization and corresponding TT rank, which can well express the low-rankness and mode correlations of higher-order tensors, have attracted much attention in recent years. However, TT factorization based methods are…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Gaohang Yu , Shaochun Wan , Liqun Qi , Yanwei Xu

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

Higher-order low-rank tensors naturally arise in many applications including hyperspectral data recovery, video inpainting, seismic data recon- struction, and so on. We propose a new model to recover a low-rank tensor by simultaneously…

Numerical Analysis · Computer Science 2015-07-07 Yangyang Xu , Ruru Hao , Wotao Yin , Zhixun Su

Multiway data often naturally occurs in a tensorial format which can be approximately represented by a low-rank tensor decomposition. This is useful because complexity can be significantly reduced and the treatment of large-scale data sets…

Machine Learning · Computer Science 2021-08-10 Clara Menzen , Manon Kok , Kim Batselier

Tensor completion is a challenging problem with various applications. Many related models based on the low-rank prior of the tensor have been proposed. However, the low-rank prior may not be enough to recover the original tensor from the…

Numerical Analysis · Mathematics 2019-11-20 Ping-Ping Wang , Liang Li , Guang-Hui Cheng

This paper studies the estimation of low-rank Markov chains from empirical trajectories. We propose a non-convex estimator based on rank-constrained likelihood maximization. Statistical upper bounds are provided for the Kullback-Leiber…

Machine Learning · Statistics 2018-07-20 Xudong Li , Mengdi Wang , Anru Zhang

In the realm of tensor optimization, the low-rank Tucker decomposition is crucial for reducing the number of parameters and for saving storage. We explore the geometry of Tucker tensor varieties -- the set of tensors with bounded Tucker…

Optimization and Control · Mathematics 2024-07-16 Bin Gao , Renfeng Peng , Ya-xiang Yuan

The low-rank tensor approximation is very promising for the compression of deep neural networks. We propose a new simple and efficient iterative approach, which alternates low-rank factorization with a smart rank selection and fine-tuning.…

Machine Learning · Computer Science 2019-11-18 Julia Gusak , Maksym Kholiavchenko , Evgeny Ponomarev , Larisa Markeeva , Ivan Oseledets , Andrzej Cichocki