English
Related papers

Related papers: Adaptive Voronoi-based Column Selection Methods fo…

200 papers

The randomized singular value decomposition proposed in [27] has certainly become one of the most well-established randomization-based algorithms in numerical linear algebra. The key ingredient of the entire procedure is the computation of…

Numerical Analysis · Mathematics 2025-08-01 Davide Palitta , Sascha Portaro

Tensor decomposition methods are widely used for model compression and fast inference in convolutional neural networks (CNNs). Although many decompositions are conceivable, only CP decomposition and a few others have been applied in…

Machine Learning · Computer Science 2019-11-28 Kohei Hayashi , Taiki Yamaguchi , Yohei Sugawara , Shin-ichi Maeda

The singular value decomposition (SVD) is not only a classical theory in matrix computation and analysis, but also is a powerful tool in machine learning and modern data analysis. In this tutorial we first study the basic notion of SVD and…

Machine Learning · Computer Science 2015-10-30 Zhihua Zhang

Spatial statistical analysis of multivariate volumetric data can be challenging due to scale, complexity, and occlusion. Advances in topological segmentation, feature extraction, and statistical summarization have helped overcome the…

Methodology · Statistics 2022-08-16 Tyson Neuroth , Martin Rieth , Konduri Aditya , Myoungkyu Lee , Jacqueline H Chen , Kwan-Liu Ma

Certain classes of CUR algorithms, also referred to as cross or pseudoskeleton algorithms, are widely used for low-rank matrix approximation when direct access to all matrix entries is costly. Their key advantage lies in constructing a…

Numerical Analysis · Mathematics 2025-10-02 Grishma Palkar , Hessam Babaee

High-dimensional image data often require dimensionality reduction before further analysis. This paper provides a purely analytical comparison of two linear techniques-Principal Component Analysis (PCA) and Singular Value Decomposition…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Michael Gyimadu , Gregory Bell , Ph. D

This article discusses a useful tool in dimensionality reduction and low-rank matrix approximation called the CUR decomposition. Various viewpoints of this method in the literature are synergized and are compared and contrasted; included in…

Numerical Analysis · Mathematics 2019-04-04 Keaton Hamm , Longxiu Huang

The problem of simultaneous column and row subset selection is addressed in this paper. The column space and row space of a matrix are spanned by its left and right singular vectors, respectively. However, the singular vectors are not…

Machine Learning · Computer Science 2021-06-15 Ashkan Esmaeili , Mohsen Joneidi , Mehrdad Salimitari , Umar Khalid , Nazanin Rahnavard

We consider the problem of matrix column subset selection, which selects a subset of columns from an input matrix such that the input can be well approximated by the span of the selected columns. Column subset selection has been applied to…

Machine Learning · Statistics 2018-01-26 Yining Wang , Aarti Singh

The manuscript describes efficient algorithms for the computation of the CUR and ID decompositions. The methods used are based on simple modifications to the classical truncated pivoted QR decomposition, which means that highly optimized…

Numerical Analysis · Mathematics 2016-10-20 Sergey Voronin , Per-Gunnar Martinsson

Variational Data Assimilation (DA) has been broadly used in engineering problems for field reconstruction and prediction by performing a weighted combination of multiple sources of noisy data. In recent years, the integration of deep…

Machine Learning · Computer Science 2023-10-26 Sibo Cheng , Che Liu , Yike Guo , Rossella Arcucci

Very deep convolutional neural networks (CNNs) have been firmly established as the primary methods for many computer vision tasks. However, most state-of-the-art CNNs are large, which results in high inference latency. Recently, depth-wise…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yihui He , Jianing Qian , Jianren Wang , Cindy X. Le , Congrui Hetang , Qi Lyu , Wenping Wang , Tianwei Yue

We develop a novel deep learning technique, termed Deep Orthogonal Decomposition (DOD), for dimensionality reduction and reduced order modeling of parameter dependent partial differential equations. The approach consists in the construction…

Numerical Analysis · Mathematics 2024-05-15 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino , Jan S. Hesthaven

This work investigates the accuracy and numerical stability of CUR decompositions with oversampling. The CUR decomposition approximates a matrix using a subset of columns and rows of the matrix. When the number of columns and the rows are…

Numerical Analysis · Mathematics 2025-04-01 Taejun Park , Yuji Nakatsukasa

The long runtime of high-fidelity partial differential equation (PDE) solvers makes them unsuitable for time-critical applications. We propose to accelerate PDE solvers using reduced-order modeling (ROM). Whereas prior ROM approaches reduce…

Support Vector Machines (SVMs) are an important tool for performing classification on scattered data, where one usually has to deal with many data points in high-dimensional spaces. We propose solving SVMs in primal form using feature maps…

Machine Learning · Computer Science 2024-09-05 Kseniya Akhalaya , Franziska Nestler , Daniel Potts

CUR decompositions approximate a matrix using selected columns, rows, and their intersection. Classical CUR theory provides exactness results for low-rank matrices and perturbation bounds controlled by the size of the noise. In this work we…

Numerical Analysis · Mathematics 2026-05-14 Longxiu Huang

This work studies reduced order modeling (ROM) approaches to speed up the solution of variational data assimilation problems with large scale nonlinear dynamical models. It is shown that a key requirement for a successful reduced order…

Systems and Control · Computer Science 2015-05-20 Răzvan Ştefănescu , Adrian Sandu , Ionel Michael Navon

An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few…

Methodology · Statistics 2021-09-28 Di Bo , Hoon Hwangbo , Vinit Sharma , Corey Arndt , Stephanie C. TerMaath

In this work, a cut high-dimensional model representation (cut-HDMR) expansion based on multiple anchors is constructed via the clustering method. Specifically, a set of random input realizations is drawn from the parameter space and…

Numerical Analysis · Mathematics 2025-02-07 Meixin Xiong , Liuhong Chen , Ju Ming , Xingchen Pan , Xinyu Yan