English
Related papers

Related papers: Singular value automata and approximate minimizati…

200 papers

This paper presents a randomized quaternion singular value decomposition (QSVD) algorithm for low-rank matrix approximation problems, which are widely used in color face recognition, video compression, and signal processing problems. With…

Numerical Analysis · Mathematics 2021-12-28 Qiaohua Liu , Sitao Ling , Zhigang Jia

Besides perturbation theory, which requires, of course, the knowledge of the exact unperturbed solution, variational techniques represent the main tool for any investigation of the eigenvalue problem of some semibounded operator H in…

High Energy Physics - Phenomenology · Physics 2016-12-28 Wolfgang Lucha , F. F. Schoberl

We consider the problems of computing the optimal rank-$1$ Hankel and Toeplitz-structured approximation of arbitrary matrices under $L_2$ and $L_1$-norm error. Such problems arise naturally in engineered systems, including the basic…

Machine Learning · Computer Science 2026-05-07 Georgios I. Orfanidis

Consider the problem of estimating the entries of a large matrix, when the observed entries are noisy versions of a small random fraction of the original entries. This problem has received widespread attention in recent times, especially…

Statistics Theory · Mathematics 2014-12-31 Sourav Chatterjee

Randomized singular value decomposition (RSVD) is a class of computationally efficient algorithms for computing the truncated SVD of large data matrices. Given an $m \times n$ matrix $\widehat{{\mathbf M}}$, the prototypical RSVD algorithm…

Statistics Theory · Mathematics 2025-05-27 Yichi Zhang , Minh Tang

Singular value decomposition is central to many problems in engineering and scientific fields. Several quantum algorithms have been proposed to determine the singular values and their associated singular vectors of a given matrix. Although…

Quantum Physics · Physics 2021-06-30 Xin Wang , Zhixin Song , Youle Wang

The Singular Value Decomposition (SVD) of linear functions facilitates the calculation of their 2-induced norm and row and null spaces, hallmarks of linear control theory. In this work, we present a function representation that, similar to…

Optimization and Control · Mathematics 2024-04-02 Brian Charles Brown , Michael King , Sean Warnick , Enoch Yeung , David Grimsman

In this paper, we propose a new adaptive cross algorithm for computing a low tubal rank approximation of third-order tensors, with less memory and lower computational complexity than the truncated tensor SVD (t-SVD). This makes it…

Deep neural networks using state space models as layers are well suited for long-range sequence tasks but can be challenging to compress after training. We use that regularizing the sum of Hankel singular values of state space models leads…

Machine Learning · Computer Science 2025-11-03 Paul Schwerdtner , Jules Berman , Benjamin Peherstorfer

The tensor decomposition addressed in this paper may be seen as a generalisation of Singular Value Decomposition of matrices. We consider general multilinear and multihomogeneous tensors. We show how to reduce the problem to a truncated…

Algebraic Geometry · Mathematics 2012-10-17 Alessandra Bernardi , Jerome Brachat , Pierre Comon , Bernard Mourrain

In this article, we consider the sparse tensor singular value decomposition, which aims for dimension reduction on high-dimensional high-order data with certain sparsity structure. A method named Sparse Tensor Alternating Thresholding for…

Statistics Theory · Mathematics 2024-07-09 Anru Zhang , Rungang Han

This paper discusses a few algorithms for updating the approximate Singular Value Decomposition (SVD) in the context of information retrieval by Latent Semantic Indexing (LSI) methods. A unifying framework is considered which is based on…

Numerical Analysis · Mathematics 2014-05-14 Eugene Vecharynski , Yousef Saad

We propose a new hypermatrix singular value decomposition based upon the spectral decomposition of the symmetric products of transposes.

Spectral Theory · Mathematics 2020-04-23 Edinah K. Gnang , Fan Tian

We compared the regular Singular Value Decomposition (SVD), truncated SVD, Krylov method and Randomized PCA, in terms of time and space complexity. It is well-known that Krylov method and Randomized PCA only performs well when k << n, i.e.…

Numerical Analysis · Mathematics 2019-10-15 Xiaocan Li , Shuo Wang , Yinghao Cai

We introduce another new type of combinations of Bernstein operators in this paper, which can be used to approximate the functions with inner singularities. The direct and inverse results of the weighted approximation of this new type…

Functional Analysis · Mathematics 2011-06-28 Wen-ming Lu , Lin Zhang

Extracting finite state automata (FSAs) from black-box models offers a powerful approach to gaining interpretable insights into complex model behaviors. To support this pursuit, we present a weighted variant of Angluin's (1987)…

Computation and Language · Computer Science 2024-12-20 Clemente Pasti , Talu Karagöz , Anej Svete , Franz Nowak , Reda Boumasmoud , Ryan Cotterell

First, we extend the results of approximate matrix multiplication from the Frobenius norm to the spectral norm. Second, We develop a class of fast approximate generalized linear regression algorithms with respect to the spectral norm.…

Numerical Analysis · Computer Science 2015-11-11 Haishan Ye , Zhihua Zhang

We present an Angluin-style algorithm to learn nominal automata, which are acceptors of languages over infinite (structured) alphabets. The abstract approach we take allows us to seamlessly extend known variations of the algorithm to this…

Formal Languages and Automata Theory · Computer Science 2018-12-18 Joshua Moerman , Matteo Sammartino , Alexandra Silva , Bartek Klin , Michał Szynwelski

We introduce the Singular Value Representation (SVR), a new method to represent the internal state of neural networks using SVD factorization of the weights. This construction yields a new weighted graph connecting what we call spectral…

Machine Learning · Computer Science 2023-02-17 Dan Meller , Nicolas Berkouk

There are several factorizations of multi-dimensional tensors into lower-dimensional components, known as `tensor networks'. We consider the popular `tensor-train' (TT) format and ask: How efficiently can we compute a low-rank approximation…

Numerical Analysis · Mathematics 2023-04-18 Melven Röhrig-Zöllner , Jonas Thies , Achim Basermann