English
Related papers

Related papers: An SVD-like Decomposition of Bounded-Input Bounded…

200 papers

The singular value decomposition (SVD) is not only a classical theory in matrix computation and analysis, but also is a powerful tool in machine learning and modern data analysis. In this tutorial we first study the basic notion of SVD and…

Machine Learning · Computer Science 2015-10-30 Zhihua Zhang

Singular Value Decomposition (SVD) constitutes a bridge between the linear algebra concepts and multi-layer neural networks---it is their linear analogy. Besides of this insight, it can be used as a good initial guess for the network…

Machine Learning · Computer Science 2019-09-16 Bernhard Bermeitinger , Tomas Hrycej , Siegfried Handschuh

A well known result from functional analysis states that any compact operator between Hilbert spaces admits a singular value decomposition (SVD). This decomposition is a powerful tool that is the workhorse of many methods both in…

Functional Analysis · Mathematics 2022-03-25 Mazen Ali , Anthony Nouy

Building on the abstract Generalized Singular Value Decomposition (GSVD) theory of Brown et al. [2025], we prove that most modern neural architectures admit a generalized SVD representation in which they are left-invertible before a final…

Machine Learning · Computer Science 2026-05-11 Brian Charles Brown , Robert Bridges , David Grimsman , Mauricio Munoz , Sean Warnick

Singular value decomposition (SVD) is one of the most popular compression methods that approximate a target matrix with smaller matrices. However, standard SVD treats the parameters within the matrix with equal importance, which is a simple…

Computation and Language · Computer Science 2022-12-19 Ting Hua , Yen-Chang Hsu , Felicity Wang , Qian Lou , Yilin Shen , Hongxia Jin

Singular value decomposition (SVD) has a crucial role in model order reduction. It is often utilized in the offline stage to compute basis functions that project the high-dimensional nonlinear problem into a low-dimensionsl model which is,…

Numerical Analysis · Mathematics 2016-11-09 Alessandro Alla , J. Nathan Kutz

By singular value decomposition (SVD) of a numerically singular Hessian matrix and a numerically singular system of linear equations for the experimental data (accumulated in the respective ${\chi ^2}$ function) and constraints, least…

High Energy Physics - Phenomenology · Physics 2014-08-27 Mehrdad Goshtasbpour

Our world is full of physics-driven data where effective mappings between data manifolds are desired. There is an increasing demand for understanding combined model-based and data-driven methods. We propose a nonlinear, learned singular…

Machine Learning · Computer Science 2020-09-30 Yoeri E. Boink , Christoph Brune

Singular Value Decomposition (SVD) is a powerful tool in linear algebra.We propose an extension of SVD for both the qualitative detection and quantitative determination of nonlinearity in a time series. The paper illustrates nonlinear SVD…

Chaotic Dynamics · Physics 2009-02-11 Prabhakar G. Vaidya , Sajini Anand P. S , Nithin Nagaraj

Singular Value Decomposition (SVD) is the basic body of many statistical algorithms and few users question whether SVD is properly handling its job. SVD aims at evaluating the decomposition that best approximates a data matrix, given some…

Applications · Statistics 2007-09-06 William Rey

The Randomized Singular Value Decomposition (RSVD) is a widely used algorithm for efficiently computing low-rank approximations of large matrices, without the need to construct a full-blown SVD. Of interest, of course, is the approximation…

Numerical Analysis · Mathematics 2025-10-09 Danil Akhtiamov , Reza Ghane , Babak Hassibi

This article studies the problem of decentralized Singular Value Decomposition (d-SVD), which is fundamental in various signal processing applications. Two scenarios are considered depending on the availability of the data matrix under…

Signal Processing · Electrical Eng. & Systems 2025-01-10 Yufan Fan , Marius Pesavento

Under certain conditions, an element of a tensor product space can be identified with a compact operator and the singular value decomposition (SVD) applies to the latter. These conditions are not fulfilled in Sobolev spaces. In the previous…

Functional Analysis · Mathematics 2022-03-25 Mazen Ali , Anthony Nouy

This thesis gives an overview of the state-of-the-art randomized linear algebra algorithms for singular value decomposition (SVD), including the presentation of existing pseudo-codes and theoretical error analysis. Our main focus is on…

Optimization and Control · Mathematics 2024-02-29 Xiaowen Li

Understanding and modeling complex dynamic systems is crucial for enhancing vehicle performance and safety, especially in the context of autonomous driving. Recently, popular methods such as Koopman operators and their approximators, known…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Chinnawut Nantabut

The singular value decomposition (SVD) allows to write a matrix as a product of a left singular vectors matrix, a nonnegative singular values diagonal matrix and a right singular vectors matrix. Among the applications of the SVD are the…

Numerical Analysis · Mathematics 2025-12-09 Doulaye Dembele

Low-rank decomposition, particularly Singular Value Decomposition (SVD), is a pivotal technique for mitigating the storage and computational demands of Large Language Models (LLMs). However, prevalent SVD-based approaches overlook the…

Machine Learning · Computer Science 2026-01-15 Lin Xv , Xian Gao , Ting Li , Yuzhuo Fu

The singular value decomposition (SVD) of a matrix is a powerful tool for many matrix computation problems. In this paper, we consider generalizing the standard SVD to analyze and compute the regularized solution of linear ill-posed…

Numerical Analysis · Mathematics 2023-12-19 Haibo Li

Certified model reduction for high-dimensional nonlinear control systems remains challenging: unlike balanced truncation for LTI systems, most nonlinear reduction methods either lack computable worst-case error bounds or rely on intractable…

Optimization and Control · Mathematics 2026-04-07 Brian Brown , Michael King

We examine holographic renormalization by the singular value decomposition (SVD) of matrix data generated by the Monte Carlo snapshot of the 2D classical Ising model at criticality. To take the continuous limit of the SVD enables us to find…

Statistical Mechanics · Physics 2016-11-03 Hiroaki Matsueda
‹ Prev 1 2 3 10 Next ›