中文
相关论文

相关论文: A Block-Randomized Stochastic Method with Importan…

200 篇论文

We introduce two generalizations to the paradigm of using Random Khatri-Rao Product (RKRP) codes for distributed matrix multiplication. We first introduce a class of codes called Sparse Random Khatri-Rao Product (SRKRP) codes which have…

信息论 · 计算机科学 2022-05-13 Ruowan Ji , Anoosheh Heidarzadeh , Krishna R. Narayanan

In recent years, low-rank based tensor completion, which is a higher-order extension of matrix completion, has received considerable attention. However, the low-rank assumption is not sufficient for the recovery of visual data, such as…

计算机视觉与模式识别 · 计算机科学 2016-09-21 Tatsuya Yokota , Qibin Zhao , Andrzej Cichocki

Low-rank tensor decompositions (TDs) provide an effective framework for multiway data analysis. Traditional TD methods rely on predefined structural assumptions, such as CP or Tucker decompositions. From a probabilistic perspective, these…

机器学习 · 计算机科学 2025-06-30 Zhengyun Cheng , Changhao Wang , Guanwen Zhang , Yi Xu , Wei Zhou , Xiangyang Ji

Recovering low-rank and sparse matrices from incomplete or corrupted observations is an important problem in machine learning, statistics, bioinformatics, computer vision, as well as signal and image processing. In theory, this problem can…

机器学习 · 计算机科学 2014-09-04 Fanhua Shang , Yuanyuan Liu , Hanghang Tong , James Cheng , Hong Cheng

General multivariate distributions are notoriously expensive to sample from, particularly the high-dimensional posterior distributions in PDE-constrained inverse problems. This paper develops a sampler for arbitrary continuous multivariate…

数值分析 · 数学 2019-07-05 Sergey Dolgov , Karim Anaya-Izquierdo , Colin Fox , Robert Scheichl

The CUR decomposition is a technique for low-rank approximation that selects small subsets of the columns and rows of a given matrix to use as bases for its column and rowspaces. It has recently attracted much interest, as it has several…

数值分析 · 数学 2022-06-06 Yijun Dong , Per-Gunnar Martinsson

In CANDECOMP/PARAFAC tensor decomposition, degeneracy often occurs in some difficult scenarios, e.g., when the rank exceeds the tensor dimension, or when the loading components are highly collinear in several or all modes, or when CPD does…

数值分析 · 计算机科学 2017-09-26 Anh-Huy Phan , Petr Tichavský , Andrzej Cichocki

Stochastic gradient descent (SGD) on a low-rank factorization is commonly employed to speed up matrix problems including matrix completion, subspace tracking, and SDP relaxation. In this paper, we exhibit a step size scheme for SGD on a…

机器学习 · 计算机科学 2015-02-11 Christopher De Sa , Kunle Olukotun , Christopher Ré

Purpose: Slice-to-volume registration and super-resolution reconstruction (SVR-SRR) is commonly used to generate 3D volumes of the fetal brain from 2D stacks of slices acquired in multiple orientations. A critical initial step in this…

图像与视频处理 · 电气工程与系统科学 2023-07-03 Haoan Xu , Wen Shi , Jiwei Sun , Tianshu Zheng , Cong Sun , Sun Yi , Guangbin Wang , Dan Wu

We introduce the Subspace Power Method (SPM) for calculating the CP decomposition of low-rank real symmetric tensors. This algorithm calculates one new CP component at a time, alternating between applying the shifted symmetric higher-order…

数值分析 · 数学 2025-04-08 Joe Kileel , João M. Pereira

In biomedical research and other fields, it is now common to generate high content data that are both multi-source and multi-way. Multi-source data are collected from different high-throughput technologies while multi-way data are collected…

机器学习 · 统计学 2025-02-28 Zhiyu Kang , Raghavendra B. Rao , Eric F. Lock

Low-rank Tucker and CP tensor decompositions are powerful tools in data analytics. The widely used alternating least squares (ALS) method, which solves a sequence of over-determined least squares subproblems, is costly for large and sparse…

数值分析 · 数学 2021-08-26 Linjian Ma , Edgar Solomonik

This paper focuses on solving large-scale, ill-conditioned, and overdetermined sparse least squares problems that arise from numerical partial differential equations (PDEs), mainly from the random feature method. To address these…

数值分析 · 数学 2024-09-25 Jingrun Chen , Longze Tan

We consider the problem of recovering low-rank matrices from random rank-one measurements, which spans numerous applications including covariance sketching, phase retrieval, quantum state tomography, and learning shallow polynomial neural…

信息论 · 计算机科学 2018-12-04 Yuanxin Li , Cong Ma , Yuxin Chen , Yuejie Chi

We study how to estimate a nearly low-rank Toeplitz covariance matrix $T$ from compressed measurements. Recent work of Qiao and Pal addresses this problem by combining sparse rulers (sparse linear arrays) with frequency finding (sparse…

数据结构与算法 · 计算机科学 2019-11-20 Hannah Lawrence , Jerry Li , Cameron Musco , Christopher Musco

Koopman mode decomposition and tensor component analysis (also known as CANDECOMP/PARAFAC or canonical polyadic decomposition) are two popular approaches of decomposing high dimensional data sets into low dimensional modes that capture the…

数值分析 · 数学 2021-05-19 William T. Redman

This article is an extended version of previous work of the authors [40, 41] on low-rank matrix estimation in the presence of constraints on the factors into which the matrix is factorized. Low-rank matrix factorization is one of the basic…

统计理论 · 数学 2017-08-28 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

We introduce a mini-batch stochastic variance-reduced algorithm to solve finite-sum scale invariant problems which cover several examples in machine learning and statistics such as principal component analysis (PCA) and estimation of…

最优化与控制 · 数学 2023-04-25 Cheolmin Kim , Youngseok Kim , Diego Klabjan

We propose a new method for low-rank approximation of Moore-Penrose pseudoinverses (MPPs) of large-scale matrices using tensor networks. The computed pseudoinverses can be useful for solving or preconditioning of large-scale overdetermined…

数值分析 · 数学 2016-07-06 Namgil Lee , Andrzej Cichocki

For the problem of reconstructing a low-rank matrix from a few linear measurements, two classes of algorithms have been widely studied in the literature: convex approaches based on nuclear norm minimization, and non-convex approaches that…

机器学习 · 统计学 2025-07-29 Dominik Stöger , Yizhe Zhu