中文
相关论文

相关论文: Rank regularization and Bayesian inference for ten…

200 篇论文

To efficiently express tensor data using the Tucker format, a critical task is to minimize the multilinear rank such that the model would not be over-flexible and lead to overfitting. Due to the lack of rank minimization tools in tensor,…

信号处理 · 电气工程与系统科学 2024-09-11 Xueke Tong , Hancheng Zhu , Lei Cheng , Yik-Chung Wu

The PARAFAC tensor decomposition has enjoyed an increasing success in exploratory multi-aspect data mining scenarios. A major challenge remains the estimation of the number of latent factors (i.e., the rank) of the decomposition, which…

机器学习 · 统计学 2017-09-06 Ishmam Zabir , Evangelos E. Papalexakis

Nonparametric extension of tensor regression is proposed. Nonlinearity in a high-dimensional tensor space is broken into simple local functions by incorporating low-rank tensor decomposition. Compared to naive nonparametric approaches, our…

机器学习 · 统计学 2016-03-09 Masaaki Imaizumi , Kohei Hayashi

The so-called block-term decomposition (BTD) tensor model, especially in its rank-$(L_r,L_r,1)$ version, has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of…

统计方法学 · 统计学 2022-05-04 Paris V. Giampouras , Athanasios A. Rontogiannis , Eleftherios Kofidis

In this paper, we provide local and global convergence guarantees for recovering CP (Candecomp/Parafac) tensor decomposition. The main step of the proposed algorithm is a simple alternating rank-$1$ update which is the alternating version…

机器学习 · 计算机科学 2015-03-05 Animashree Anandkumar , Rong Ge , Majid Janzamin

Tensor decomposition methods allow us to learn the parameters of latent variable models through decomposition of low-order moments of data. A significant limitation of these algorithms is that there exists no general method to regularize…

机器学习 · 统计学 2019-05-28 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

We establish non-asymptotic efficiency guarantees for tensor decomposition-based inference in count data models. Under a Poisson framework, we consider two related goals: (i) parametric inference, the estimation of the full distributional…

Tensors, also known as multidimensional arrays, are useful data structures in machine learning and statistics. In recent years, Bayesian methods have emerged as a popular direction for analyzing tensor-valued data since they provide a…

统计方法学 · 统计学 2024-02-02 Yiyao Shi , Weining Shen

Bayesian matrix completion has been studied based on a low-rank matrix factorization formulation with promising results. However, little work has been done on Bayesian matrix completion based on the more direct spectral regularization…

数值分析 · 计算机科学 2016-05-31 Yang Song , Jun Zhu

This study aims to solve the over-reliance on the rank estimation strategy in the standard tensor factorization-based tensor recovery and the problem of a large computational cost in the standard t-SVD-based tensor recovery. To this end, we…

机器学习 · 计算机科学 2023-05-22 Jingjing Zheng , Wenzhe Wang , Xiaoqin Zhang , Xianta Jiang

There has been an increased interest in multimodal language processing including multimodal dialog, question answering, sentiment analysis, and speech recognition. However, naturally occurring multimodal data is often imperfect as a result…

Vector autoregressions (VARs) are popular model for analyzing multivariate economic time series. However, VARs can be over-parameterized if the numbers of variables and lags are moderately large. Tensor VAR, a recent solution to…

统计方法学 · 统计学 2024-09-13 Yiyong Luo , Jim E. Griffin

Tensor completion estimates missing components by exploiting the low-rank structure of multi-way data. The recently proposed methods based on tensor train (TT) and tensor ring (TR) show better performance in image recovery than classical…

机器学习 · 计算机科学 2020-04-24 Huyan Huang , Yipeng Liu , Ce Zhu

This paper proposes a novel approach to tensor completion, which recovers missing entries of data represented by tensors. The approach is based on the tensor train (TT) rank, which is able to capture hidden information from tensors thanks…

数值分析 · 计算机科学 2017-04-26 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

While post-training model compression can greatly reduce the inference cost of a deep neural network, uncompressed training still consumes a huge amount of hardware resources, run-time and energy. It is highly desirable to directly train a…

机器学习 · 计算机科学 2021-10-05 Cole Hawkins , Xing Liu , Zheng Zhang

Recently, fundamental conditions on the sampling patterns have been obtained for finite completability of low-rank matrices or tensors given the corresponding ranks. In this paper, we consider the scenario where the rank is not given and we…

机器学习 · 计算机科学 2017-11-03 Morteza Ashraphijuo , Xiaodong Wang , Vaneet Aggarwal

Tensor decomposition is an important technique for capturing the high-order interactions among multiway data. Multi-linear tensor composition methods, such as the Tucker decomposition and the CANDECOMP/PARAFAC (CP), assume that the complex…

机器学习 · 统计学 2016-11-04 Bin Liu , Zenglin Xu , Yingming Li

The (efficient and parsimonious) decomposition of higher-order tensors is a fundamental problem with numerous applications in a variety of fields. Several methods have been proposed in the literature to that end, with the Tucker and PARAFAC…

综合数学 · 数学 2024-06-28 Sergio Rozada , Antonio G. Marques

We propose a numerical method to obtain an adequate value for the upper bound on the rank for the tensor completion problem on the variety of third-order tensors of bounded tensor-train rank. The method is inspired by the parametrization of…

最优化与控制 · 数学 2024-09-10 Charlotte Vermeylen , Guillaume Olikier , P. -A. Absil , Marc Van Barel

This paper is concerned with the low Tucker-rank tensor completion problem, which is about reconstructing a tensor $ T \in\mathbb{R}^{n\times n \times n}$ of low multilinear rank from partially observed entries. Riemannian optimization…

最优化与控制 · 数学 2023-08-03 Haifeng Wang , Jinchi Chen , Ke Wei