中文
相关论文

相关论文: TenExp: Mixture-of-Experts-Based Tensor Decomposit…

200 篇论文

We discuss how recently discovered techniques and tools from compressed sensing can be used in tensor decompositions, with a view towards modeling signals from multiple arrays of multiple sensors. We show that with appropriate bounds on a…

数值分析 · 数学 2015-05-18 Lek-Heng Lim , Pierre Comon

This paper studies a tensor-structured linear regression model with a scalar response variable and tensor-structured predictors, such that the regression parameters form a tensor of order $d$ (i.e., a $d$-fold multiway array) in…

机器学习 · 计算机科学 2020-11-26 Talal Ahmed , Haroon Raja , Waheed U. Bajwa

A tensor network is a diagram that specifies a way to "multiply" a collection of tensors together to produce another tensor (or matrix). Many existing algorithms for tensor problems (such as tensor decomposition and tensor PCA), although…

数据结构与算法 · 计算机科学 2018-11-05 Ankur Moitra , Alexander S. Wein

Tensor completion refers to the problem of recovering the missing, corrupted or unobserved entries in data represented by tensors. In this paper, we tackle the tensor completion problem in the scenario in which multiple tensor acquisitions…

信号处理 · 电气工程与系统科学 2023-12-07 Iain Rolland , Sivasakthy Selvakumaran , Andrea Marinoni

Complex networks have now become integral parts of modern information infrastructures. This paper proposes a user-centric method for detecting anomalies in heterogeneous information networks, in which nodes and/or edges might be from…

社会与信息网络 · 计算机科学 2018-10-22 Vahid Ranjbar , Mostafa Salehi , Pegah Jandaghi , Mahdi Jalili

Tucker decomposition is a powerful tensor model to handle multi-aspect data. It demonstrates the low-rank property by decomposing the grid-structured data as interactions between a core tensor and a set of object representations (factors).…

机器学习 · 计算机科学 2024-03-20 Shikai Fang , Xin Yu , Zheng Wang , Shibo Li , Mike Kirby , Shandian Zhe

Tensors, especially higher-order tensors, are typically represented in low-rank formats to preserve the main information of the high-dimensional data while saving memory space. In practice, only a small fraction elements in high-dimensional…

数值分析 · 数学 2025-11-12 Chuanfu Xiao , Jiaxin Zeng

Density-based clustering aims to find groups of similar objects (i.e., clusters) in a given dataset. Applications include, e.g., process mining and anomaly detection. It comes with two user parameters ({\epsilon}, MinPts) that determine the…

Tensor network (TN) representation is a powerful technique for computer vision and machine learning. TN structure search (TN-SS) aims to search for a customized structure to achieve a compact representation, which is a challenging NP-hard…

机器学习 · 计算机科学 2024-04-15 Yu-Bang Zheng , Xi-Le Zhao , Junhua Zeng , Chao Li , Qibin Zhao , Heng-Chao Li , Ting-Zhu Huang

Tensor network contractions are widely used in statistical physics, quantum computing, and computer science. We introduce a method to efficiently approximate tensor network contractions using low-rank approximations, where each intermediate…

量子物理 · 物理学 2025-01-01 Linjian Ma , Matthew Fishman , Miles Stoudenmire , Edgar Solomonik

We consider rank-one non-symmetric tensor estimation and derive simple formulas for the mutual information. We start by the order 2 problem, namely matrix factorization. We treat it completely in a simpler fashion than previous proofs using…

信息论 · 计算机科学 2018-11-28 Jean Barbier , Nicolas Macris , Léo Miolane

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

数值分析 · 计算机科学 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of…

机器学习 · 统计学 2017-08-03 Masaaki Imaizumi , Takanori Maehara , Kohei Hayashi

Tensor decompositions have been successfully applied to compress neural networks. The compression algorithms using tensor decompositions commonly minimize the approximation error on the weights. Recent work assumes the approximation error…

机器学习 · 计算机科学 2023-08-07 Jetze T. Schuurmans , Kim Batselier , Julian F. P. Kooij

Tensor computations, with matrix multiplication being the primary operation, serve as the fundamental basis for data analysis, physics, machine learning, and deep learning. As the scale and complexity of data continue to grow rapidly, the…

硬件体系结构 · 计算机科学 2024-10-24 Qizhe Wu , Yuchen Gui , Zhichen Zeng , Xiaotian Wang , Huawen Liang , Xi Jin

Tensor decompositions such as the canonical format and the tensor train format have been widely utilized to reduce storage costs and operational complexities for high-dimensional data, achieving linear scaling with the input dimension…

数值分析 · 数学 2020-02-11 Oscar Mickelin , Sertac Karaman

Modern neural networks have revolutionized the fields of computer vision (CV) and Natural Language Processing (NLP). They are widely used for solving complex CV tasks and NLP tasks such as image classification, image generation, and machine…

机器学习 · 计算机科学 2023-07-25 Xingyi Liu , Keshab K. Parhi

In general, algorithms for order-3 CANDECOMP/-PARAFAC (CP), also coined canonical polyadic decomposition (CPD), are easily to implement and can be extended to higher order CPD. Unfortunately, the algorithms become computationally demanding,…

数值分析 · 数学 2017-04-26 Anh Huy Phan , Petr Tichavsky , Andrzej Cichocki

In recent years, a class of dictionaries have been proposed for multidimensional (tensor) data representation that exploit the structure of tensor data by imposing a Kronecker structure on the dictionary underlying the data. In this work, a…

机器学习 · 统计学 2017-11-15 Mohsen Ghassemi , Zahra Shakeri , Anand D. Sarwate , Waheed U. Bajwa

In this era of big data, data analytics and machine learning, it is imperative to find ways to compress large data sets such that intrinsic features necessary for subsequent analysis are not lost. The traditional workhorse for data…

数值分析 · 数学 2020-01-03 Misha Kilmer , Lior Horesh , Haim Avron , Elizabeth Newman