English
Related papers

Related papers: Large-Scale System Identification Using a Randomiz…

200 papers

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

This work studies the linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). Searching this approximation in a data-driven approach is formalised as attempting to solve a low-rank…

Machine Learning · Statistics 2021-08-23 Patrick Héas , Cédric Herzet

In this paper, we analyze the finite sample complexity of stochastic system identification using modern tools from machine learning and statistics. An unknown discrete-time linear system evolves over time under Gaussian noise without…

Machine Learning · Computer Science 2019-03-22 Anastasios Tsiamis , George J. Pappas

Analyzing complex experimental data with multiple parameters is challenging. We propose using Singular Value Decomposition (SVD) as an effective solution. This method, demonstrated through real experimental data analysis, surpasses…

Data Analysis, Statistics and Probability · Physics 2024-07-24 Judith F. Stein , Aviad Frydman , Richard Berkovits

We demonstrate an implementation for an approximate rank-k SVD factorization, combining well-known randomized projection techniques with previously known paralel solutions in order to compute steps of the random projection based SVD…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-04 Burak Bayramli

Signal decomposition (SD) approaches aim to decompose non-stationary signals into their constituent amplitude- and frequency-modulated components. This represents an important preprocessing step in many practical signal processing…

Signal Processing · Electrical Eng. & Systems 2022-09-05 Thomas Eriksen , Naveed ur Rehman

We address the problem of data-driven pattern identification and outlier detection in time series. To this end, we use singular value decomposition (SVD) which is a well-known technique to compute a low-rank approximation for an arbitrary…

Methodology · Statistics 2019-03-12 Abdolrahman Khoshrou , Eric J. Pauwels

Singular value decomposition (SVD) is the mathematical basis of principal component analysis (PCA). Together, SVD and PCA are one of the most widely used mathematical formalism/decomposition in machine learning, data mining, pattern…

Machine Learning · Computer Science 2018-04-17 Shuai Zheng , Chris Ding , Feiping Nie

In this paper, we present a fast implementation of the Singular Value Thresholding (SVT) algorithm for matrix completion. A rank-revealing randomized singular value decomposition (R3SVD) algorithm is used to adaptively carry out partial…

Numerical Analysis · Computer Science 2017-04-20 Yaohang Li , Wenjian Yu

The probabilistic topic model imposes a low-rank structure on the expectation of the corpus matrix. Therefore, singular value decomposition (SVD) is a natural tool of dimension reduction. We propose an SVD-based method for estimating a…

Methodology · Statistics 2022-08-31 Zheng Tracy Ke , Minzhe Wang

In this paper, we provide novel algorithms with identifiability guarantees for simplex-structured matrix factorization (SSMF), a generalization of nonnegative matrix factorization. Current state-of-the-art algorithms that provide…

Machine Learning · Computer Science 2021-05-12 Maryam Abdolali , Nicolas Gillis

We present a new computational approach to approximating a large, noisy data table by a low-rank matrix with sparse singular vectors. The approximation is obtained from thresholded subspace iterations that produce the singular vectors…

Methodology · Statistics 2011-12-13 Dan Yang , Zongming Ma , Andreas Buja

Given multiple time series data, how can we efficiently find latent patterns in an arbitrary time range? Singular value decomposition (SVD) is a crucial tool to discover hidden factors in multiple time series data, and has been used in many…

Numerical Analysis · Computer Science 2018-12-21 Jun-Gi Jang , Dongjin Choi , Jinhong Jung , U Kang

In order to compute fast approximations to the singular value decompositions (SVD) of very large matrices, randomized sketching algorithms have become a leading approach. However, a key practical difficulty of sketching an SVD is that the…

Machine Learning · Statistics 2020-03-12 Miles E. Lopes , N. Benjamin Erichson , Michael W. Mahoney

We develop an Iterative version of the Singular Value Decomposition (ISVD) that jointly analyzes a finite number of data matrices to identify signals that correlate among the rows of matrices. It will be illustrated how the supervised…

Optimization and Control · Mathematics 2016-12-01 Mohsen Rakhshan

Support Vector Data Description (SVDD) is a popular one-class classifiers for anomaly and novelty detection. But despite its effectiveness, SVDD does not scale well with data size. To avoid prohibitive training times, sampling methods…

Machine Learning · Computer Science 2020-09-30 Adrian Englhardt , Holger Trittenbach , Daniel Kottke , Bernhard Sick , Klemens Böhm

In this paper, we present a Rank Revealing Randomized Singular Value Decomposition (R3SVD) algorithm to incrementally construct a low-rank approximation of a potentially large matrix while adaptively estimating the appropriate rank that can…

Numerical Analysis · Computer Science 2016-05-27 Hao Ji , Wenjian Yu , Yaohang Li

This technical note reviews sate-of-the-art algorithms for linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). While repeating several parts of our article "low-rank dynamic mode…

Machine Learning · Statistics 2021-08-23 Patrick Heas , Cedric Herzet

Memristor crossbars enable vector-matrix multiplication (VMM), and are promising for low-power applications. However, it can be difficult to write the memristor conductance values exactly. To improve the accuracy of VMM, we propose a scheme…

Signal Processing · Electrical Eng. & Systems 2025-10-07 Binyu Lu , Matthias Frey , Stark Draper , Jingge Zhu

Truncated singular value decomposition (SVD), also known as the best low-rank matrix approximation, has been successfully applied to many domains such as biology, healthcare, and others, where high-dimensional datasets are prevalent. To…

Optimization and Control · Mathematics 2022-08-09 Yongchun Li , Weijun Xie