English
Related papers

Related papers: Half-Precision Kronecker Product SVD Preconditione…

200 papers

Sparsity regularization has garnered significant interest across multiple disciplines, including statistics, imaging, and signal processing. Standard techniques for addressing sparsity regularization include iterative soft thresholding…

Optimization and Control · Mathematics 2025-06-16 Long Li , Liang Ding

The generalized singular value decomposition (GSVD) is a powerful tool for solving discrete ill-posed problems. In this paper, we propose a two-sided uniformly randomized GSVD algorithm for solving the large-scale discrete ill-posed problem…

Numerical Analysis · Mathematics 2024-12-11 Weiwei Xu , Weijie Shen , Zheng-Jian Bai

Contrast variation small-angle neutron scattering (CV-SANS) has been widely employed for nano structural analysis of multicomponent systems. In CV-SANS experiments, scattering intensities of samples with different scattering co\ ntrasts are…

Computational Physics · Physics 2026-02-10 Manabu Machida , Koichi Mayumi

Modern Convolutional Neural Network (CNN) architectures, despite their superiority in solving various problems, are generally too large to be deployed on resource constrained edge devices. In this paper, we reduce memory usage and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Marawan Gamal Abdel Hameed , Marzieh S. Tahaei , Ali Mosleh , Vahid Partovi Nia

This paper introduces the sparsifying preconditioner for the pseudospectral approximation of highly indefinite systems on periodic structures, which include the frequency-domain response problems of the Helmholtz equation and the…

Numerical Analysis · Mathematics 2014-09-18 Lexing Ying

The singular value decomposition (SVD) is a crucial tool in machine learning and statistical data analysis. However, it is highly susceptible to outliers in the data matrix. Existing robust SVD algorithms often sacrifice speed for…

Machine Learning · Statistics 2024-02-16 Sangil Han , Kyoowon Kim , Sungkyu Jung

This paper discusses weighted tensor Golub-Kahan-type bidiagonalization processes using the t-product. This product was introduced in [M. E. Kilmer and C. D. Martin, Factorization strategies for third order tensors, Linear Algebra Appl.,…

Numerical Analysis · Mathematics 2021-09-10 Lothar Reichel , Ugochukwu O Ugwu

Tikhonov regularization is a widely used technique in solving inverse problems that can enforce prior properties on the desired solution. In this paper, we propose a Krylov subspace based iterative method for solving linear inverse problems…

Numerical Analysis · Mathematics 2023-08-15 Haibo Li

Higher-order tensor decompositions are analogous to the familiar Singular Value Decomposition (SVD), but they transcend the limitations of matrices (second-order tensors). SVD is a powerful tool that has achieved impressive results in…

Machine Learning · Computer Science 2007-11-14 Peter D. Turney

Low-rank approximation methods such as singular value decomposition (SVD) and its variants (e.g., Fisher-weighted SVD, Activation SVD) have recently emerged as effective tools for neural network compression. In this setting, decomposition…

Machine Learning · Computer Science 2025-12-02 Haoran Qin , Shansita Sharma , Ali Abbasi , Chayne Thrash , Soheil Kolouri

A common task in single particle electron cryomicroscopy (cryo-EM) is the rigid alignment of images and/or volumes. In the context of images, a rigid alignment involves estimating the inner-product between one image of $N\times N$ pixels…

Numerical Analysis · Mathematics 2022-12-07 Aaditya V. Rangan

This paper aims to present the first Frequentist framework on signal region detection in high-resolution and high-order image regression problems. Image data and scalar-on-image regression are intensively studied in recent years. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Sanyou Wu , Long Feng

Semidefinite programs (SDPs) are standard convex problems that are frequently found in control and optimization applications. Interior-point methods can solve SDPs in polynomial time up to arbitrary accuracy, but scale poorly as the size of…

Optimization and Control · Mathematics 2022-01-10 Jared Miller , Yang Zheng , Mario Sznaier , Antonis Papachristodoulou

This paper presents a case study of application of the preconditioned method of conjugate gradients (CG) on a problem with operator resembling the structure of sum of Kronecker products. In particular, we are solving the Poisson's equation…

Numerical Analysis · Mathematics 2025-01-08 Věnceslav Chumchal , Pavel Marton , Martin Plešinger , Martina Šimůnková

Properties of Superiorized Preconditioned Conjugate Gradient (SupPCG) algorithms in image reconstruction from projections are examined. Least squares (LS) is usually chosen for measuring data-inconsistency in these inverse problems.…

Numerical Analysis · Mathematics 2018-07-27 Elias S. Helou , Gabor T. Herman , Chuan Lin , Marcelo V. W. Zibetti

In this note we present a multigrid preconditioning method for solving quadratic optimization problems constrained by a fractional diffusion equation. Multigrid methods within the all-at-once approach to solve the first order-order…

Optimization and Control · Mathematics 2020-10-29 Harbir Antil , Andrei Dr{ă}g{ă}nescu , Kiefer Green

This paper derives the CS decomposition for orthogonal tensors (T-CSD) and the generalized singular value decomposition for two tensors (T-GSVD) via the T-product. The structures of the two decompositions are analyzed in detail and are…

Numerical Analysis · Mathematics 2021-07-01 Yating Zhang , Xiaoxia Guo , Pengpeng Xie , Zhengbang Cao

This paper evaluates Tucker decomposition and Singular Value Decomposition (SVD) for compressing neuroimaging data. Tucker decomposition preserves multi-dimensional relationships, achieving superior reconstruction fidelity and perceptual…

Image and Video Processing · Electrical Eng. & Systems 2025-11-25 Jaeho Kim , Daniel David , Ana Vizitiv

The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Anthony W. Helmstetter , Saeed Vatankhah

Tensor decompositions have rich applications in statistics and machine learning, and developing efficient, accurate algorithms for the problem has received much attention recently. Here, we present a new method built on Kruskal's uniqueness…

Machine Learning · Computer Science 2017-04-20 Miaoyan Wang , Yun S. Song