English
Related papers

Related papers: Perturbations of CUR Decompositions

200 papers

We show that low-rank adaptation of large-scale models suffers from a low stable rank that is well below the linear algebraic rank of the subspace, degrading fine-tuning performance. To mitigate the underutilization of the allocated…

Machine Learning · Computer Science 2025-11-03 Kai Lion , Liang Zhang , Bingcong Li , Niao He

We study the matrix denoising problem of estimating the singular vectors of a rank-$1$ signal corrupted by noise with both column and row correlations. Existing works are either unable to pinpoint the exact asymptotic estimation error or,…

Statistics Theory · Mathematics 2024-10-29 Yihan Zhang , Marco Mondelli

In the current quantum computing paradigm, significant focus is placed on the reduction or mitigation of quantum decoherence. When designing new quantum processing units, the general objective is to reduce the amount of noise qubits are…

Quantum Physics · Physics 2026-02-17 Viacheslav Kuzmin , Wilfrid Somogyi , Ekaterina Pankovets , Alexey Melnikov

X-ray computed tomographic infrastructures are medical imaging modalities that rely on the acquisition of rays crossing examined objects while measuring their intensity decrease. Physical measurements are post-processed by mathematical…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Attila Juhos

Many statistical problems involve the estimation of a $\left(d\times d\right)$ orthogonal matrix $\textbf{Q}$. Such an estimation is often challenging due to the orthonormality constraints on $\textbf{Q}$. To cope with this problem, we…

Methodology · Statistics 2019-06-04 Luca Bagnato , Antonio Punzo

The Canonical Polyadic decomposition (CPD) is a convenient and intuitive tool for tensor factorization; however, for higher-order tensors, it often exhibits high computational cost and permutation of tensor entries, these undesirable…

Numerical Analysis · Computer Science 2018-09-05 Anh-Huy Phan , Andrzej Cichocki , Ivan Oseledets , Salman Ahmadi Asl , Giuseppe Calvi , Danilo Mandic

The class of Fourier matrices is of special importance in compressed sensing (CS). This paper concerns deterministic construction of compressed sensing matrices from Fourier matrices. By using Katz' character sum estimation, we are able to…

Information Theory · Computer Science 2013-01-04 Guangwu Xu , Zhiqiang Xu

In this paper, we study the problem of decomposing a superposition of a low-rank matrix and a sparse matrix when a relatively few linear measurements are available. This problem arises in many data processing tasks such as aligning multiple…

Information Theory · Computer Science 2012-03-01 Arvind Ganesh , Kerui Min , John Wright , Yi Ma

Valid causal inference in observational studies often requires controlling for confounders. However, in practice measurements of confounders may be noisy, and can lead to biased estimates of causal effects. We show that we can reduce the…

Machine Learning · Statistics 2018-06-05 Nathan Kallus , Xiaojie Mao , Madeleine Udell

CRUSH is an approach to data analysis under noise interference, developed specifically for submillimeter imaging arrays. The method uses an iterated sequence of statistical estimators to separate source and noise signals. Its filtering…

Astrophysics · Physics 2014-11-18 A. Kovacs

The sparse factorization of a large matrix is fundamental in modern statistical learning. In particular, the sparse singular value decomposition and its variants have been utilized in multivariate regression, factor analysis, biclustering,…

Machine Learning · Statistics 2020-03-19 Kun Chen , Ruipeng Dong , Wanwan Xu , Zemin Zheng

Matrix factorization is a simple and effective solution to the recommendation problem. It has been extensively employed in the industry and has attracted much attention from the academia. However, it is unclear what the low-dimensional…

Machine Learning · Computer Science 2018-08-29 Farhan Khawar , Nevin L. Zhang

Procedural noise is a fundamental component of computer graphics pipelines, offering a flexible way to generate textures that exhibit "natural" random variation. Many different types of noise exist, each produced by a separate algorithm. In…

The problem of simultaneous column and row subset selection is addressed in this paper. The column space and row space of a matrix are spanned by its left and right singular vectors, respectively. However, the singular vectors are not…

Machine Learning · Computer Science 2021-06-15 Ashkan Esmaeili , Mohsen Joneidi , Mehrdad Salimitari , Umar Khalid , Nazanin Rahnavard

It is a common problem in lattice QCD calculation of the mass of the hadron with an annihilation channel that the signal falls off in time while the noise remains constant. In addition, the disconnected insertion calculation of the…

High Energy Physics - Lattice · Physics 2018-07-12 Keh-Fei Liu , Jian Liang , Yi-Bo Yang

We consider a singularly perturbed fourth-order problem with third-order terms on the unit square. With a formal power series approach, we decompose the solution into solutions of reduced (third-order) problems and various layer parts. The…

Analysis of PDEs · Mathematics 2015-11-18 Sebastian Franz , Katharina Höhne , Marcus Waurick

We consider the problem of noisy matrix completion, in which the goal is to reconstruct a structured matrix whose entries are partially observed in noise. Standard approaches to this underdetermined inverse problem are based on assuming…

Machine Learning · Statistics 2017-09-04 Nihar B. Shah , Sivaraman Balakrishnan , Martin J. Wainwright

By defining two important terms called basic perturbation vectors and obtaining their linear bounds, we obtain the linear componentwise perturbation bounds for unitary factors and upper triangular factors of the generalized Schur…

Numerical Analysis · Mathematics 2022-04-21 Guihua Zhang , Hanyu Li , Yimin Wei

Crackling noise arises when a system responds to changing external conditions through discrete, impulsive events spanning a broad range of sizes. A wide variety of physical systems exhibiting crackling noise have been studied, from…

Statistical Mechanics · Physics 2009-11-07 James P. Sethna , Karin A. Dahmen , Christopher R. Myers

We introduce a new approach to an enumerative problem closely linked with the geometry of branched coverings; that is, we study the number of ways a permutation can be decomposed into a product of a given number of 2-cycles, 3-cycles, etc.…

Combinatorics · Mathematics 2007-05-23 John Irving