English
Related papers

Related papers: Two-sided uniformly randomized GSVD for large-scal…

200 papers

Big data analysis has become a crucial part of new emerging technologies such as the internet of things, cyber-physical analysis, deep learning, anomaly detection, etc. Among many other techniques, dimensionality reduction plays a key role…

A Cross-Product Free (CPF) Jacobi-Davidson (JD) type method is proposed to compute a partial generalized singular value decomposition (GSVD) of a large regular matrix pair $(A,B)$. It implicitly solves the mathematically equivalent…

Numerical Analysis · Mathematics 2022-12-14 Jinzhi Huang , Zhongxiao Jia

In signal processing and identification, generalized singular value decomposition (GSVD), related to a sequence of matrices in product/quotient form are essential numerical linear algebra tools. On behalf of the growing demand for efficient…

Numerical Analysis · Mathematics 2025-11-13 Sitao Ling , Wenxuan Ma , Musheng Wei

Higher order singular value decomposition (HOSVD) is an important tool for analyzing big data in multilinear algebra and machine learning. In this paper, we present two quantum algorithms for HOSVD. Our methods allow one to decompose a…

Quantum Physics · Physics 2020-04-07 Lejia Gu , Xiaoqiang Wang , H. W. Joseph Lee , Guofeng Zhang

This paper presents approaches to compute sparse solutions of Generalized Singular Value Problem (GSVP). The GSVP is regularized by $\ell_1$-norm and $\ell_q$-penalty for $0<q<1$, resulting in the $\ell_1$-GSVP and $\ell_q$-GSVP…

Machine Learning · Computer Science 2024-10-08 Ugochukwu O. Ugwu , Michael Kirby

The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Anthony W. Helmstetter , Saeed Vatankhah

In this article, we consider the sparse tensor singular value decomposition, which aims for dimension reduction on high-dimensional high-order data with certain sparsity structure. A method named Sparse Tensor Alternating Thresholding for…

Statistics Theory · Mathematics 2024-07-09 Anru Zhang , Rungang Han

We study Tikhonov regularization for solving ill--posed operator equations where the solutions are functions defined on surfaces. One contribution of this paper is an error analysis of Tikhonov regularization which takes into account…

Numerical Analysis · Mathematics 2016-12-15 Guozhi Dong , Bert Juettler , Otmar Scherzer , Thomas Takacs

Tikhonov regularization is one of the most commonly used methods of regularization of ill-posed problems. In the setting of finite element solutions of elliptic partial differential control problems, Tikhonov regularization amounts to…

Numerical Analysis · Mathematics 2016-09-19 Erik Burman , Peter Hansbo , Mats Larson

In this paper we propose novel methods for compression and recovery of multilinear data under limited sampling. We exploit the recently proposed tensor- Singular Value Decomposition (t-SVD)[1], which is a group theoretic framework for…

Information Theory · Computer Science 2013-11-01 Zemin Zhang , Gregory Ely , Shuchin Aeron , Ning Hao , Misha Kilmer

In this paper we propose an approach to approximate a truncated singular value decomposition of a large structured matrix. By first decomposing the matrix into a sum of Kronecker products, our approach can be used to approximate a large…

Numerical Analysis · Mathematics 2018-04-03 Clarissa Garvey , Chang Meng , James G. Nagy

Accurate determination of the regularization parameter in inverse problems still represents an analytical challenge, owing mainly to the considerable difficulty to separate the unknown noise from the signal. We present a new approach for…

Numerical Analysis · Mathematics 2019-07-24 Eitan Levin , Alexander Y. Meltzer

A classical problem in matrix computations is the efficient and reliable approximation of a given matrix by a matrix of lower rank. The truncated singular value decomposition (SVD) is known to provide the best such approximation for any…

Numerical Analysis · Mathematics 2014-08-12 Ming Gu

Singular value decomposition (SVD) is the mathematical basis of principal component analysis (PCA). Together, SVD and PCA are one of the most widely used mathematical formalism/decomposition in machine learning, data mining, pattern…

Machine Learning · Computer Science 2018-04-17 Shuai Zheng , Chris Ding , Feiping Nie

Singular value decomposition is central to many problems in engineering and scientific fields. Several quantum algorithms have been proposed to determine the singular values and their associated singular vectors of a given matrix. Although…

Quantum Physics · Physics 2021-06-30 Xin Wang , Zhixin Song , Youle Wang

In this paper we develop randomized Krylov subspace methods for efficiently computing regularized solutions to large-scale linear inverse problems. Building on the recently developed randomized Gram-Schmidt process, where sketched inner…

Numerical Analysis · Mathematics 2025-08-29 Julianne Chung , Silvia Gazzola

We study two-stage stochastic optimization models with mixed-integer decision variables appearing in both stages. For these models, dual decomposition enables parallel computing implementation and can quickly provide a lower bound for the…

Optimization and Control · Mathematics 2026-05-15 Pengyu Zhang , Ruiwei Jiang

For linear ill-posed problems with nontrivial null spaces, Tikhonov regularization and truncated singular value decomposition (TSVD) typically yield solutions that are close to the minimum norm solution. Such a bias is not always desirable,…

Numerical Analysis · Mathematics 2024-12-10 Ole Løseth Elvetun , Kim Knudsen , Bjørn Fredrik Nielsen

In this paper, we focus on the fixed TT-rank and precision problems of finding an approximation of the tensor train (TT) decomposition of a tensor. Note that the TT-SVD and TT-cross are two well-known algorithms for these two problems.…

Numerical Analysis · Mathematics 2025-02-11 Maolin Che , Yimin Wei , Hong Yan

Tikhonov regularization is a widely used technique in solving inverse problems that can enforce prior properties on the desired solution. In this paper, we propose a Krylov subspace based iterative method for solving linear inverse problems…

Numerical Analysis · Mathematics 2023-08-15 Haibo Li