English
Related papers

Related papers: Randomized Compression of Rank-Structured Matrices…

200 papers

We introduce an explainable generative model by applying sparse operation on the feature maps of the generator network. Meaningful hierarchical representations are obtained using the proposed generative model with sparse activations. The…

Machine Learning · Computer Science 2019-02-01 Xianglei Xing , Song-Chun Zhu , Ying Nian Wu

Matrix completion is a widely used technique for image inpainting and personalized recommender system, etc. In this work, we focus on accelerating the matrix completion using faster randomized singular value decomposition (rSVD). Firstly,…

Machine Learning · Computer Science 2018-10-17 Xu Feng , Wenjian Yu , Yaohang Li

In this paper, we study randomized reduction methods, which reduce high-dimensional features into low-dimensional space by randomized methods (e.g., random projection, random hashing), for large-scale high-dimensional classification.…

Machine Learning · Computer Science 2015-07-21 Tianbao Yang , Lijun Zhang , Rong Jin , Shenghuo Zhu

In this work, we present a random forest framework that learns the weights, shapes, and sparsities of feature representations for real-time semantic segmentation. Typical filters (kernels) have predetermined shapes and sparsities and learn…

Computer Vision and Pattern Recognition · Computer Science 2019-06-26 Byeongkeun Kang , Truong Q. Nguyen

Existing methods of vector autoregressive model for multivariate time series analysis make use of low-rank matrix approximation or Tucker decomposition to reduce the dimension of the over-parameterization issue. In this paper, we propose a…

Statistics Theory · Mathematics 2026-01-05 Sijia Xia , Michael K. Ng , Xiongjun Zhang

We present and analyze an algorithm designed for addressing vector-valued regression problems involving possibly infinite-dimensional input and output spaces. The algorithm is a randomized adaptation of reduced rank regression, a technique…

Machine Learning · Computer Science 2024-01-01 Giacomo Turri , Vladimir Kostic , Pietro Novelli , Massimiliano Pontil

This paper introduces a dynamic, error-bounded hierarchical matrix (H-matrix) compression method tailored for Physics-Informed Neural Networks (PINNs). The proposed approach reduces the computational complexity and memory demands of…

Machine Learning · Computer Science 2024-09-26 John Mango , Ronald Katende

This paper, broadly speaking, covers the use of randomness in two main areas: low-rank approximation and kernel methods. Low-rank approximation is very important in numerical linear algebra. Many applications depend on matrix decomposition…

Numerical Analysis · Mathematics 2020-08-12 Rishi Advani , Madison Crim , Sean O'Hagan

By exploiting the random sampling techniques, this paper derives an efficient randomized algorithm for computing a generalized CUR decomposition, which provides low-rank approximations of both matrices simultaneously in terms of some of…

Numerical Analysis · Mathematics 2023-04-07 Zhengbang Cao , Yimin Wei , Pengpeng Xie

This paper describes efficient algorithms for computing rank-revealing factorizations of matrices that are too large to fit in RAM, and must instead be stored on slow external memory devices such as solid-state or spinning disk hard drives…

Mathematical Software · Computer Science 2020-03-05 Nathan Heavner , Per-Gunnar Martinsson , Gregorio Quintana-Ortí

Many applications in scientific computing and data science require the computation of a rank-revealing factorization of a large matrix. In many of these instances the classical algorithms for computing the singular value decomposition are…

Numerical Analysis · Mathematics 2018-12-17 Abinand Gopal , Per-Gunnar Martinsson

In this paper, we propose a hierarchical random compression method (HRCM) for kernel matrices in fast kernel summations. The HRCM combines the hierarchical framework of the H-matrix and a randomized sampling technique of the column and row…

Numerical Analysis · Mathematics 2018-03-15 Duan Chen , Wei Cai

We propose a hierarchical tensor-network approach for approximating high-dimensional probability density via empirical distribution. This leverages randomized singular value decomposition (SVD) techniques and involves solving linear…

Numerical Analysis · Mathematics 2026-01-13 Yifan Peng , Yian Chen , E. Miles Stoudenmire , Yuehaw Khoo

We present a novel method for graph partitioning, based on reinforcement learning and graph convolutional neural networks. Our approach is to recursively partition coarser representations of a given graph. The neural network is implemented…

Machine Learning · Computer Science 2021-06-30 Alice Gatti , Zhixiong Hu , Tess Smidt , Esmond G. Ng , Pieter Ghysels

Boundary integral equations lead to dense system matrices when discretized, yet they are data-sparse. Using the $\mathcal{H}$-matrix format, this sparsity is exploited to achieve $\mathcal{O}(N\log N)$ complexity for storage and…

Numerical Analysis · Mathematics 2025-05-22 Kobe Bruyninckx , Daan Huybrechs , Karl Meerbergen

This paper presents an efficient algorithm for the approximation of the rank-one convex hull in the context of nonlinear solid mechanics. It is based on hierarchical rank-one sequences and simultaneously provides first and second derivative…

Computational Engineering, Finance, and Science · Computer Science 2024-05-28 Maximilian Köhler , Timo Neumeier , Malte. A. Peter , Daniel Peterseim , Daniel Balzani

For the high dimensional data representation, nonnegative tensor ring (NTR) decomposition equipped with manifold learning has become a promising model to exploit the multi-dimensional structure and extract the feature from tensor data.…

Machine Learning · Computer Science 2021-09-07 Xinhai Zhao , Yuyuan Yu , Guoxu Zhou , Qibin Zhao , Weijun Sun

This paper addresses the problem of approximate MAP-MRF inference in general graphical models. Following [36], we consider a family of linear programming relaxations of the problem where each relaxation is specified by a set of nested pairs…

Computer Vision and Pattern Recognition · Computer Science 2015-03-20 Vladimir Kolmogorov , Thomas Schoenemann

We propose a method to reconstruct and cluster incomplete high-dimensional data lying in a union of low-dimensional subspaces. Exploring the sparse representation model, we jointly estimate the missing data while imposing the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 João Carvalho , Manuel Marques , João P. Costeira

We consider the problem of estimation of a low-rank matrix from a limited number of noisy rank-one projections. In particular, we propose two fast, non-convex \emph{proper} algorithms for matrix recovery and support them with rigorous…

Machine Learning · Statistics 2017-05-23 Mohammadreza Soltani , Chinmay Hegde