中文
相关论文

相关论文: The AL$\ell_0$CORE Tensor Decomposition for Sparse…

200 篇论文

With distributed machine learning being a prominent technique for large-scale machine learning tasks, communication complexity has become a major bottleneck for speeding up training and scaling up machine numbers. In this paper, we propose…

机器学习 · 计算机科学 2023-09-26 Pengyun Yue , Hanzhen Zhao , Cong Fang , Di He , Liwei Wang , Zhouchen Lin , Song-chun Zhu

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

数值分析 · 计算机科学 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

Given an order-$d$ tensor $\tensor A \in \R^{n \times n \times...\times n}$, we present a simple, element-wise sparsification algorithm that zeroes out all sufficiently small elements of $\tensor A$, keeps all sufficiently large elements of…

数值分析 · 数学 2015-02-05 Nam H. Nguyen , Petros Drineas , Trac D. Tran

Tensor networks have in recent years emerged as the powerful tools for solving the large-scale optimization problems. One of the most popular tensor network is tensor train (TT) decomposition that acts as the building blocks for the…

数值分析 · 计算机科学 2016-06-20 Qibin Zhao , Guoxu Zhou , Shengli Xie , Liqing Zhang , Andrzej Cichocki

In the realm of tensor optimization, the low-rank Tucker decomposition is crucial for reducing the number of parameters and for saving storage. We explore the geometry of Tucker tensor varieties -- the set of tensors with bounded Tucker…

最优化与控制 · 数学 2024-07-16 Bin Gao , Renfeng Peng , Ya-xiang Yuan

Tensor completion and robust principal component analysis have been widely used in machine learning while the key problem relies on the minimization of a tensor rank that is very challenging. A common way to tackle this difficulty is to…

机器学习 · 计算机科学 2021-05-26 Tao Li , Jinwen Ma

We consider the problem of recovering a partially sparse solution of an underdetermined system of linear equations by minimizing the $\ell_1$-norm of the part of the solution vector which is known to be sparse. Such a problem is closely…

信息论 · 计算机科学 2013-04-11 Afonso S. Bandeira , Katya Scheinberg , Luis Nunes Vicente

Modern technological advances have enabled an unprecedented amount of structured data with complex temporal dependence, urging the need for new methods to efficiently model and forecast high-dimensional tensor-valued time series. This paper…

统计方法学 · 统计学 2023-09-28 Di Wang , Yao Zheng , Guodong Li

Recent work by Dhulipala et al. \cite{DLRSSY22} initiated the study of the $k$-core decomposition problem under differential privacy via a connection between low round/depth distributed/parallel graph algorithms and private algorithms with…

数据结构与算法 · 计算机科学 2024-03-01 Laxman Dhulipala , George Z. Li , Quanquan C. Liu

Recently, convolutional auto-encoders (CAE) were introduced for image coding. They achieved performance improvements over the state-of-the-art JPEG2000 method. However, these performances were obtained using massive CAEs featuring a large…

图像与视频处理 · 电气工程与系统科学 2022-09-13 Cyprien Gille , Frédéric Guyard , Marc Antonini , Michel Barlaud

Stochastic Alternating Least Squares (SALS) is a method that approximates the canonical decomposition of averages of sampled random tensors. Its simplicity and efficient memory usage make SALS an ideal tool for decomposing tensors in an…

数值分析 · 数学 2020-04-28 Yanzhao Cao , Somak Das , Luke Oeding , Hans-Werner van Wyk

This paper proposes a novel formulation of the tensor completion problem to impute missing entries of data represented by tensors. The formulation is introduced in terms of tensor train (TT) rank which can effectively capture global…

数值分析 · 计算机科学 2016-01-07 Ho N. Phien , Hoang D. Tuan , Johann A. Bengua , Minh N. Do

Factor Analysis is a widely used modeling technique for stationary time series which achieves dimensionality reduction by revealing a hidden low-rank plus sparse structure of the covariance matrix. Such an idea of parsimonious modeling has…

最优化与控制 · 数学 2025-01-30 Linyang Wang , Bin Zhu , Wanquan Liu

Tensors serve as a crucial tool in the representation and analysis of complex, multi-dimensional data. As data volumes continue to expand, there is an increasing demand for developing optimization algorithms that can directly operate on…

最优化与控制 · 数学 2024-05-15 Katherine Henneberger , Jing Qin

We present a scalable Bayesian model for low-rank factorization of massive tensors with binary observations. The proposed model has the following key properties: (1) in contrast to the models based on the logistic or probit likelihood,…

机器学习 · 统计学 2015-08-19 Changwei Hu , Piyush Rai , Lawrence Carin

Tensors are a fundamental operation in distributed computing, \emph{e.g.,} machine learning, that are commonly distributed into multiple parallel tasks for large datasets. Stragglers and other failures can severely impact the overall…

信息论 · 计算机科学 2024-10-30 Pedro Soto

A pruned variant of polar coding is reinvented for all binary erasure channels. For small $\varepsilon>0$, we construct codes with block length $\varepsilon^{-5}$, code rate $\text{Capacity}-\varepsilon$, error probability $\varepsilon$,…

信息论 · 计算机科学 2018-12-20 Hsin-Po Wang , Iwan Duursma

The CUR decomposition is a technique for low-rank approximation that selects small subsets of the columns and rows of a given matrix to use as bases for its column and rowspaces. It has recently attracted much interest, as it has several…

数值分析 · 数学 2022-06-06 Yijun Dong , Per-Gunnar Martinsson

The (efficient and parsimonious) decomposition of higher-order tensors is a fundamental problem with numerous applications in a variety of fields. Several methods have been proposed in the literature to that end, with the Tucker and PARAFAC…

综合数学 · 数学 2024-06-28 Sergio Rozada , Antonio G. Marques

Sparse clustering, which aims to find a proper partition of an extremely high-dimensional data set with redundant noise features, has been attracted more and more interests in recent years. The existing studies commonly solve the problem in…

机器学习 · 统计学 2019-02-25 Xiangyu Chang , Yu Wang , Rongjian Li , Zongben Xu