English
Related papers

Related papers: TenExp: Mixture-of-Experts-Based Tensor Decomposit…

200 papers

Tensors in the form of multilinear arrays are ubiquitous in data science applications. Captured real-world data, including video, hyperspectral images, and discretized physical systems, naturally occur as tensors and often come with…

Machine Learning · Computer Science 2023-03-13 Jonathan Gryak , Kayvan Najarian , Harm Derksen

Global discrete optimization is notoriously difficult due to the lack of gradient information and the curse of dimensionality, making exhaustive search infeasible. Tensor cross approximation is an efficient technique to approximate…

Computation · Statistics 2025-02-19 Sergey Dolgov , Dmitry Savostyanov

In numerous applications, binary reactions or event counts are observed and stored within high-order tensors. Tensor decompositions (TDs) serve as a powerful tool to handle such high-dimensional and sparse data. However, many traditional…

Machine Learning · Computer Science 2024-01-17 Zerui Tao , Toshihisa Tanaka , Qibin Zhao

This work addresses the problem of learning sparse representations of tensor data using structured dictionary learning. It proposes learning a mixture of separable dictionaries to better capture the structure of tensor data by generalizing…

Machine Learning · Computer Science 2020-06-16 Mohsen Ghassemi , Zahra Shakeri , Anand D. Sarwate , Waheed U. Bajwa

How can we accurately complete tensors by learning relationships of dimensions along each mode? Tensor completion, a widely studied problem, is to predict missing entries in incomplete tensors. Tensor decomposition methods, fundamental…

Machine Learning · Computer Science 2025-03-28 Dawon Ahn , Evangelos E. Papalexakis

We propose a set of convex low rank inducing norms for a coupled matrices and tensors (hereafter coupled tensors), which shares information between matrices and tensors through common modes. More specifically, we propose a mixture of the…

Machine Learning · Statistics 2018-06-15 Kishan Wimalawarne , Makoto Yamada , Hiroshi Mamitsuka

Tensors naturally model many real world processes which generate multi-aspect data. Such processes appear in many different research disciplines, e.g, chemometrics, computer vision, psychometrics and neuroimaging analysis. Tensor…

Data Structures and Algorithms · Computer Science 2009-09-29 Charalampos E. Tsourakakis

Tensor network methods are a conceptually elegant framework for encoding complicated datasets, where high-order tensors are approximated as networks of low-order tensors. In practice, however, the numeric implementation of tensor network…

Quantum Physics · Physics 2019-11-07 Glen Evenbly

High-dimensional data arise naturally in many areas of science and engineering, including machine learning, signal processing, computational physics, and statistics. Such data are often represented as tensors, multi-dimensional…

Machine Learning · Computer Science 2026-05-19 Beheshteh T. Rakhshan , Guillaume Rabusseau

This work studies the problem of high-dimensional data (referred to as tensors) completion from partially observed samplings. We consider that a tensor is a superposition of multiple low-rank components. In particular, each component can be…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Chang Nie , Huan Wang , Zhihui Lai

Tensor decomposition is a powerful tool for extracting physically meaningful latent factors from multi-dimensional nonnegative data, and has been an increasing interest in a variety of fields such as image processing, machine learning, and…

Machine Learning · Computer Science 2024-12-03 Xiongjun Zhang , Michael K. Ng

We propose a novel sparse tensor decomposition method, namely Tensor Truncated Power (TTP) method, that incorporates variable selection into the estimation of decomposition components. The sparsity is achieved via an efficient truncation…

Machine Learning · Statistics 2016-05-04 Will Wei Sun , Junwei Lu , Han Liu , Guang Cheng

Because tensor data appear more and more frequently in various scientific researches and real-world applications, analyzing the relationship between tensor features and the univariate outcome becomes an elementary task in many fields. To…

Machine Learning · Computer Science 2019-12-04 Jiaqi Zhang , Beilun Wang

We study the low-rank phase retrieval problem, where the objective is to recover a sequence of signals (typically images) given the magnitude of linear measurements of those signals. Existing solutions involve recovering a matrix…

Image and Video Processing · Electrical Eng. & Systems 2022-02-18 Soo Min Kwon , Xin Li , Anand D. Sarwate

Most currently used tensor regression models for high-dimensional data are based on Tucker decomposition, which has good properties but loses its efficiency in compressing tensors very quickly as the order of tensors increases, say greater…

Methodology · Statistics 2024-03-20 Yuefeng Si , Yingying Zhang , Yuxi Cai , Chunling Liu , Guodong Li

Tensors, or multidimensional arrays, are data structures that can naturally represent visual data of multiple dimensions. Inherently able to efficiently capture structured, latent semantic spaces and high-order interactions, tensors have a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Yannis Panagakis , Jean Kossaifi , Grigorios G. Chrysos , James Oldfield , Mihalis A. Nicolaou , Anima Anandkumar , Stefanos Zafeiriou

High-performance tensor programs are crucial to guarantee efficient execution of deep neural networks. However, obtaining performant tensor programs for different operators on various hardware platforms is notoriously challenging.…

Tensor completion is a natural higher-order generalization of matrix completion where the goal is to recover a low-rank tensor from sparse observations of its entries. Existing algorithms are either heuristic without provable guarantees,…

Data Structures and Algorithms · Computer Science 2023-07-14 Allen Liu , Ankur Moitra

Tensor train decomposition is widely used in machine learning and quantum physics due to its concise representation of high-dimensional tensors, overcoming the curse of dimensionality. Cross approximation-originally developed for…

Machine Learning · Computer Science 2023-06-27 Zhen Qin , Alexander Lidiak , Zhexuan Gong , Gongguo Tang , Michael B. Wakin , Zhihui Zhu

We consider the problem of automatically decomposing operations over tensors or arrays so that they can be executed in parallel on multiple devices. We address two, closely-linked questions. First, what programming abstraction should…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-04 Daniel Bourgeois , Zhimin Ding , Dimitrije Jankov , Jiehui Li , Mahmoud Sleem , Yuxin Tang , Jiawen Yao , Xinyu Yao , Chris Jermaine