中文
相关论文

相关论文: Fast and Guaranteed Tensor Decomposition via Sketc…

200 篇论文

The Canonical Polyadic decomposition (CPD) is a convenient and intuitive tool for tensor factorization; however, for higher-order tensors, it often exhibits high computational cost and permutation of tensor entries, these undesirable…

数值分析 · 计算机科学 2018-09-05 Anh-Huy Phan , Andrzej Cichocki , Ivan Oseledets , Salman Ahmadi Asl , Giuseppe Calvi , Danilo Mandic

We present an incremental, scalable and efficient dimension reduction technique for tensors that is based on sparse random linear coding. Data is stored in a compactified representation with fixed size, which makes memory requirements low…

数据结构与算法 · 计算机科学 2017-03-16 Fredrik Sandin , Blerim Emruli , Magnus Sahlgren

Higher-order tensors have received increased attention across science and engineering. While most tensor decomposition methods are developed for a single tensor observation, scientific studies often collect side information, in the form of…

统计方法学 · 统计学 2021-10-29 Jiaxin Hu , Chanwoo Lee , Miaoyan Wang

This work considers a computationally and statistically efficient parameter estimation method for a wide class of latent variable models---including Gaussian mixture models, hidden Markov models, and latent Dirichlet allocation---which…

机器学习 · 计算机科学 2014-11-17 Anima Anandkumar , Rong Ge , Daniel Hsu , Sham M. Kakade , Matus Telgarsky

In this paper we propose new techniques to sample arbitrary third-order tensors, with an objective of speeding up tensor algorithms that have recently gained popularity in machine learning. Our main contribution is a new way to select, in a…

机器学习 · 统计学 2015-02-23 Srinadh Bhojanapalli , Sujay Sanghavi

In this paper, we propose a general framework for solving high-dimensional partial differential equations with tensor networks. Our approach uses Monte-Carlo simulations to update the solution and re-estimates the new solution from samples…

数值分析 · 数学 2025-12-12 Yian Chen , Yuehaw Khoo , Ziang Yu

We consider the problem of constructing a canonical polyadic (CP) decomposition for a tensor network, rather than a single tensor. We illustrate how it is possible to reduce the complexity of constructing an approximate CP representation of…

化学物理 · 物理学 2024-07-30 Karl Pierce , Edward F Valeev

Channel pruning and tensor decomposition have received extensive attention in convolutional neural network compression. However, these two techniques are traditionally deployed in an isolated manner, leading to significant accuracy drop…

计算机视觉与模式识别 · 计算机科学 2021-05-25 Yuchao Li , Shaohui Lin , Jianzhuang Liu , Qixiang Ye , Mengdi Wang , Fei Chao , Fan Yang , Jincheng Ma , Qi Tian , Rongrong Ji

The proposed article aims at offering a comprehensive tutorial for the computational aspects of structured matrix and tensor factorization. Unlike existing tutorials that mainly focus on {\it algorithmic procedures} for a small set of…

信号处理 · 电气工程与系统科学 2023-07-19 Xiao Fu , Nico Vervliet , Lieven De Lathauwer , Kejun Huang , Nicolas Gillis

A new paradigm for large-scale spectrum occupancy learning based on long short-term memory (LSTM) recurrent neural networks is proposed. Studies have shown that spectrum usage is a highly correlated time series. Moreover, there is a…

信号处理 · 电气工程与系统科学 2019-05-14 Mohsen Joneidi , Ismail Alkhouri , Nazanin Rahnavard

In this paper, a numerical method is proposed for canonical polyadic (CP) decomposition of small size tensors. The focus is primarily on decomposition of tensors that correspond to small matrix multiplications. Here, rank of the tensors is…

数值分析 · 数学 2016-03-07 Petr Tichavsky , Anh Huy Phan , Andrzej Cichocki

Alternating least squares is the most widely used algorithm for CP tensor decomposition. However, alternating least squares may exhibit slow or no convergence, especially when high accuracy is required. An alternative approach is to regard…

数值分析 · 数学 2020-06-11 Navjot Singh , Linjian Ma , Hongru Yang , Edgar Solomonik

We show how to develop sampling-based alternating least squares (ALS) algorithms for decomposition of tensors into any tensor network (TN) format. Provided the TN format satisfies certain mild assumptions, resulting algorithms will have…

数值分析 · 数学 2022-10-11 Osman Asif Malik , Vivek Bharadwaj , Riley Murray

In this paper, we suggest a new method for a given tensor to find CP decompositions using a less number of rank $1$ tensors. The main ingredient is the Least Absolute Shrinkage and Selection Operator (LASSO) by considering the decomposition…

交换代数 · 数学 2023-05-24 Taehyeong Kim , Jeong-Hoon Ju , Yeongrak Kim

In this paper, we develop a novel procedure for low-rank tensor regression, namely \emph{\underline{I}mportance \underline{S}ketching \underline{L}ow-rank \underline{E}stimation for \underline{T}ensors} (ISLET). The central idea behind…

机器学习 · 统计学 2020-05-11 Anru Zhang , Yuetian Luo , Garvesh Raskutti , Ming Yuan

Mining massive spatio-temporal data can help a variety of real-world applications such as city capacity planning, event management, and social network analysis. The tensor representation can be used to capture the correlation between space…

机器学习 · 计算机科学 2020-06-23 Jing Ma , Qiuchen Zhang , Joyce C. Ho , Li Xiong

The tensor rank decomposition, also known as canonical polyadic(CP) or simply tensor decomposition, has a long history in multilinear algebra. However, computing a rank decomposition becomes particularly challenging when the rank lies…

最优化与控制 · 数学 2025-11-11 Zequn Zheng , Hongchao Zhang , Guangming Zhou

With the continuous increase in the number and resolution of video surveillance cameras, the burden of transmitting and storing surveillance video is growing. Traditional communication methods based on Shannon's theory are facing…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Baoping Cheng , Yukun Zhang , Liming Wang , Xiaoyan Xie , Tao Fu , Dongkun Wang , Xiaoming Tao

An increasing number of data science and machine learning problems rely on computation with tensors, which better capture the multi-way relationships and interactions of data than matrices. When tapping into this critical advantage, a key…

机器学习 · 统计学 2023-02-23 Harry Dong , Tian Tong , Cong Ma , Yuejie Chi

We propose two provably accurate methods for low CP-rank tensor completion - one using adaptive sampling and one using nonadaptive sampling. Both of our algorithms combine matrix completion techniques for a small number of slices along with…

数值分析 · 数学 2024-03-18 Cullen Haselby , Mark Iwen , Santhosh Karnik , Rongrong Wang