English
Related papers

Related papers: Cross-over in non-standard random-matrix spectral …

200 papers

Singular Value Decomposition (SVD) constitutes a bridge between the linear algebra concepts and multi-layer neural networks---it is their linear analogy. Besides of this insight, it can be used as a good initial guess for the network…

Machine Learning · Computer Science 2019-09-16 Bernhard Bermeitinger , Tomas Hrycej , Siegfried Handschuh

Singular Value Decomposition can be considered as an effective method for Signal Processing/especially data compression. In this short paper we investigate the application of SVD to predict data equation from data. The method is similar to…

Chaotic Dynamics · Physics 2007-05-23 Prabhakar G. Vaidya , P. S. Sajini Anand

In cosmological perturbation theory it is convenient to use the scalar, vector, tensor (SVT) basis as defined according to how these components transform under 3-dimensional rotations. In attempting to solve the fluctuation equations that…

General Relativity and Quantum Cosmology · Physics 2021-04-14 Matthew G. Phelps , Asanka Amarasinghe , Philip D. Mannheim

The singular value decomposition (SVD) is a popular matrix factorization that has been used widely in applications ever since an efficient algorithm for its computation was developed in the 1970s. In recent years, the SVD has become even…

Numerical Analysis · Mathematics 2012-03-13 Carla D. Martin , Mason A. Porter

Time-series forecasting often faces challenges due to data volatility, which can lead to inaccurate predictions. Variational Mode Decomposition (VMD) has emerged as a promising technique to mitigate volatility by decomposing data into…

Machine Learning · Computer Science 2024-09-05 Hafizh Raihan Kurnia Putra , Novanto Yudistira , Tirana Noor Fatyanosa

Building on the abstract Generalized Singular Value Decomposition (GSVD) theory of Brown et al. [2025], we prove that most modern neural architectures admit a generalized SVD representation in which they are left-invertible before a final…

Machine Learning · Computer Science 2026-05-11 Brian Charles Brown , Robert Bridges , David Grimsman , Mauricio Munoz , Sean Warnick

This paper aims to develop a simple procedure to reduce and control the condition number of random matrices, and investigate the effect on the persistent homology (PH) of point clouds of well- and ill-conditioned matrices. For a square…

Algebraic Topology · Mathematics 2023-02-23 Jehan Ghafuri , Sabah Jassim

In spherical surface wave tomography, one measures the integrals of a function defined on the sphere along great circle arcs. This forms a generalization of the Funk--Radon transform, which assigns to a function its integrals along full…

Numerical Analysis · Mathematics 2018-08-13 Ralf Hielscher , Daniel Potts , Michael Quellmalz

Singular value decomposition (SVD) is a standard matrix factorization technique that produces optimal low-rank approximations of matrices. It has diverse applications, including machine learning, data science and signal processing. However,…

Mathematical Software · Computer Science 2019-07-16 Vadim Demchik , Miroslav Bačák , Stefan Bordag

When solving finite-sum minimization problems, two common alternatives to stochastic gradient descent (SGD) with theoretical benefits are random reshuffling (SGD-RR) and shuffle-once (SGD-SO), in which functions are sampled in cycles…

Optimization and Control · Mathematics 2022-06-02 Carles Domingo-Enrich

Traditional directed graph signal processing generally depends on fixed representation matrices, whose rigid structures limit the model's ability to adapt to complex graph topologies. To address this issue, this study employed the unified…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Guoyun Xie , Zhichao Zhang

We investigate the properties of sparse matrix ensembles with particular regard for the spectral ergodicity hypothesis, which claims the identity of ensemble and spectral averages of spectral correlators. An apparent violation of the…

Condensed Matter · Physics 2009-10-31 A. D. Jackson , C. Mejia-Monasterio , T. Rupp , M. Saltzer , T. Wilke

Linear transformation techniques such as singular value decomposition (SVD) have been used widely to gain insight into the qualitative dynamics of data generated by dynamical systems. There have been several reports in the past that had…

Chaotic Dynamics · Physics 2007-05-23 Radhakrishnan Nagarajan

In signal processing and identification, generalized singular value decomposition (GSVD), related to a sequence of matrices in product/quotient form are essential numerical linear algebra tools. On behalf of the growing demand for efficient…

Numerical Analysis · Mathematics 2025-11-13 Sitao Ling , Wenxuan Ma , Musheng Wei

Sparse random mode decomposition (SRMD) is a novel algorithm that constructs a random time-frequency feature space to sparsely approximate spectrograms, effectively separating modes. However, it fails to distinguish adjacent or overlapped…

Signal Processing · Electrical Eng. & Systems 2025-01-28 Chen Luo , Tao Chen , Lei Xie , Hongye Su

The singular value decomposition (SVD) allows to write a matrix as a product of a left singular vectors matrix, a nonnegative singular values diagonal matrix and a right singular vectors matrix. Among the applications of the SVD are the…

Numerical Analysis · Mathematics 2025-12-09 Doulaye Dembele

We propose new algorithms for singular value decomposition (SVD) of very large-scale matrices based on a low-rank tensor approximation technique called the tensor train (TT) format. The proposed algorithms can compute several dominant…

Numerical Analysis · Mathematics 2016-02-11 Namgil Lee , Andrzej Cichocki

This work analyzes singular-value spectra of weight matrices in pretrained transformer models to understand how information is stored at both ends of the spectrum. Using Random Matrix Theory (RMT) as a zero information hypothesis, we…

Machine Learning · Computer Science 2025-11-07 Max Staats , Matthias Thamm , Bernd Rosenow

The Singular Value Decomposition (SVD) is one of the most important matrix factorizations, enjoying a wide variety of applications across numerous application domains. In statistics and data analysis, the common applications of SVD such as…

Mathematical Software · Computer Science 2020-09-03 Drew Schmidt

In this article we present some statistical applications of the functional singular value decomposition (FSVD). This tool allows us to decompose the sample mean of a bivariate stochastic process into components that are functions of…

Methodology · Statistics 2012-12-03 Daniel Gervini