English
Related papers

Related papers: A Distributed and Incremental SVD Algorithm for Ag…

200 papers

Differential network is an important tool to capture the changes of conditional correlations under two sample cases. In this paper, we introduce a fast iterative algorithm to recover the differential network for high-dimensional data. The…

Computation · Statistics 2019-01-23 Zhou Tang , Zhangsheng Yu , Cheng Wang

Spectral embedding based on the Singular Value Decomposition (SVD) is a widely used "preprocessing" step in many learning tasks, typically leading to dimensionality reduction by projecting onto a number of dominant singular vectors and…

Machine Learning · Statistics 2015-09-29 Dinesh Ramasamy , Upamanyu Madhow

This paper develops a spatially resolved perturbation theory for singular vectors under high-dimensional separable noise and applies it to data-driven matrix recovery. In the asymptotic regime where the matrix dimensions are proportional…

Spectral Theory · Mathematics 2026-03-16 Pei-Chun Su

In this paper a two-sided, parallel Kogbetliantz-type algorithm for the hyperbolic singular value decomposition (HSVD) of real and complex square matrices is developed, with a single assumption that the input matrix, of order $n$, admits…

Numerical Analysis · Mathematics 2022-05-10 Vedran Novaković , Sanja Singer

In this paper, we propose a new sampling strategy for hyperspectral signals that is based on dictionary learning and singular value decomposition (SVD). Specifically, we first learn a sparsifying dictionary from training spectral data using…

Computer Vision and Pattern Recognition · Computer Science 2015-12-04 Mingrui Yang , Frank de Hoog , Yuqi Fan , Wen Hu

We propose a randomized algorithm for training Support vector machines(SVMs) on large datasets. By using ideas from Random projections we show that the combinatorial dimension of SVMs is $O({log} n)$ with high probability. This estimate of…

Machine Learning · Computer Science 2009-09-22 Vinay Jethava , Krishnan Suresh , Chiranjib Bhattacharyya , Ramesh Hariharan

In high-dimensional data processing and data analysis related to dual quaternion statistics, generalized singular value decomposition (GSVD) of a dual quaternion matrix pair is an essential numerical linear algebra tool for an elegant…

Numerical Analysis · Mathematics 2025-11-05 Sitao Ling , Wenxuan Ma , Musheng Wei

Modern data sets, such as those in healthcare and e-commerce, are often derived from many individuals or systems but have insufficient data from each source alone to separately estimate individual, often high-dimensional, model parameters.…

Machine Learning · Computer Science 2024-11-14 Maryann Rui , Thibaut Horel , Munther Dahleh

This paper addresses the problem of efficiently classifying high-dimensional data over decentralized networks. Penalized support vector machines (SVMs) are widely used for high-dimensional classification tasks. However, the double…

Machine Learning · Statistics 2025-03-11 Canyi Chen , Nan Qiao , Liping Zhu

Given multiple time series data, how can we efficiently find latent patterns in an arbitrary time range? Singular value decomposition (SVD) is a crucial tool to discover hidden factors in multiple time series data, and has been used in many…

Numerical Analysis · Computer Science 2018-12-21 Jun-Gi Jang , Dongjin Choi , Jinhong Jung , U Kang

This paper focus on recovering multi-dimensional data called tensor from randomly corrupted incomplete observation. Inspired by reweighted $l_1$ norm minimization for sparsity enhancement, this paper proposes a reweighted singular value…

Computer Vision and Pattern Recognition · Computer Science 2017-07-11 Baburaj M. , Sudhish N. George

Computing the top eigenvectors of a matrix is a problem of fundamental interest to various fields. While the majority of the literature has focused on analyzing the reconstruction error of low-rank matrices associated with the retrieved…

Machine Learning · Computer Science 2022-02-17 Ruo-Chun Tzeng , Po-An Wang , Florian Adriaens , Aristides Gionis , Chi-Jen Lu

The structure-preserving doubling algorithm (SDA) is a fairly efficient method for solving problems closely related to Hamiltonian (or Hamiltonian-like) matrices, such as computing the required solutions to algebraic Riccati equations.…

Numerical Analysis · Mathematics 2020-05-19 Zhen-Chen Guo , Eric King-Wah Chu , Xin Liang , Wen-Wei Lin

Truncated Singular Value Decomposition (SVD) calculates the closest rank-$k$ approximation of a given input matrix. Selecting the appropriate rank $k$ defines a critical model order choice in most applications of SVD. To obtain a principled…

Information Theory · Computer Science 2013-01-08 Mario Frank , Joachim M. Buhmann

A popular heuristic method for improving clustering results is to apply dimensionality reduction before running clustering algorithms. It has been observed that spectral-based dimensionality reduction tools, such as PCA or SVD, improve the…

Machine Learning · Computer Science 2023-09-28 Xinyu Mao , Jiapeng Zhang

We address the problem of data-driven pattern identification and outlier detection in time series. To this end, we use singular value decomposition (SVD) which is a well-known technique to compute a low-rank approximation for an arbitrary…

Methodology · Statistics 2019-03-12 Abdolrahman Khoshrou , Eric J. Pauwels

Deep Neural Networks (DNNs) have encountered an emerging deployment challenge due to large and expensive memory and computation requirements. In this paper, we present a new Adaptive-Rank Singular Value Decomposition (ARSVD) method that…

Machine Learning · Computer Science 2025-05-13 Kalyan Cherukuri , Aarav Lala

We present improved methods of using structured SVMs in a large-scale hierarchical classification problem, that is when labels are leaves, or sets of leaves, in a tree or a DAG. We examine the need to normalize both the regularization and…

Machine Learning · Computer Science 2016-03-07 Heejin Choi , Yutaka Sasaki , Nathan Srebro

Singular value decomposition (SVD) is a standard matrix factorization technique that produces optimal low-rank approximations of matrices. It has diverse applications, including machine learning, data science and signal processing. However,…

Mathematical Software · Computer Science 2019-07-16 Vadim Demchik , Miroslav Bačák , Stefan Bordag

Can one recover a matrix efficiently from only matrix-vector products? If so, how many are needed? This paper describes algorithms to recover matrices with known structures, such as tridiagonal, Toeplitz, Toeplitz-like, and hierarchical…

Numerical Analysis · Mathematics 2023-05-31 Diana Halikias , Alex Townsend