English
Related papers

Related papers: Data-Driven Matrix Recovery via Optimal Shrinkage …

200 papers

We develop a data-driven optimal shrinkage algorithm for matrix denoising in the presence of high-dimensional noise with a separable covariance structure; that is, the noise is colored and dependent across samples. The algorithm, coined…

Applications · Statistics 2024-05-14 Pei-Chun Su , Hau-Tieng Wu

The truncated singular value decomposition (SVD) of the measurement matrix is the optimal solution to the_representation_ problem of how to best approximate a noisy measurement matrix using a low-rank matrix. Here, we consider the…

Statistics Theory · Mathematics 2014-04-21 Raj Rao Nadakuditi

Across many disciplines from neuroscience and genomics to machine learning, atmospheric science and finance, the problems of denoising large data matrices to recover signals obscured by noise, and of estimating the structure of these…

Data Analysis, Statistics and Probability · Physics 2023-12-06 Itamar D. Landau , Gabriel C. Mel , Surya Ganguli

We consider recovery of low-rank matrices from noisy data by shrinkage of singular values, in which a single, univariate nonlinearity is applied to each of the empirical singular values. We adopt an asymptotic framework, in which the matrix…

Statistics Theory · Mathematics 2016-05-17 Matan Gavish , David L. Donoho

We propose a patch-based singular value shrinkage method for diffusion magnetic resonance image estimation targeted at low signal to noise ratio and accelerated acquisitions. It operates on the complex data resulting from a sensitivity…

Image and Video Processing · Electrical Eng. & Systems 2019-06-21 Lucilio Cordero-Grande , Daan Christiaens , Jana Hutter , Anthony N. Price , Joseph V. Hajnal

A low rank matrix X has been contaminated by uniformly distributed noise, missing values, outliers and corrupt entries. Reconstruction of X from the singular values and singular vectors of the contaminated matrix Y is a key problem in…

Information Theory · Computer Science 2017-11-21 Danny Barash , Matan Gavish

Recovering a low-rank signal matrix from its noisy observation, commonly known as matrix denoising, is a fundamental inverse problem in statistical signal processing. Matrix denoising methods are generally based on shrinkage or thresholding…

Methodology · Statistics 2017-01-23 Santosh Kumar Yadav , Rohit Sinha , Prabin Kumar Bora

We study the problem of estimating a large, low-rank matrix corrupted by additive noise of unknown covariance, assuming one has access to additional side information in the form of noise-only measurements. We study the Whiten-Shrink-reColor…

Statistics Theory · Mathematics 2023-07-18 Matan Gavish , William Leeb , Elad Romanov

We develop new theoretical results on matrix perturbation to shed light on the impact of architecture on the performance of a deep network. In particular, we explain analytically what deep learning practitioners have long observed…

Machine Learning · Computer Science 2022-12-06 Rudolf H. Riedi , Randall Balestriero , Richard G. Baraniuk

Matrix recovery from sparse observations is an extensively studied topic emerging in various applications, such as recommendation system and signal processing, which includes the matrix completion and compressed sensing models as special…

Methodology · Statistics 2026-04-13 Ziyuan Chen , Ying Yang , Fang Yao

In large-scale, data-driven applications, parameters are often only known approximately due to noise and limited data samples. In this paper, we focus on high-dimensional optimization problems with linear constraints under uncertain…

Optimization and Control · Mathematics 2024-03-01 Naqi Huang , Nestor Parolya , Theresia van Essen

We present a high-order spacetime numerical method for discretizing and solving linear initial-boundary value problems using wavelet-based techniques with user-prescribed error estimates. The spacetime wavelet discretization yields a system…

Numerical Analysis · Mathematics 2025-09-04 Cody D. Cochran , Karel Matous

We consider the recovery of a low rank $M \times N$ matrix $S$ from its noisy observation $\tilde{S}$ in two different regimes. Under the assumption that $M$ is comparable to $N$, we propose two consistent estimators for $S$. Our analysis…

Statistics Theory · Mathematics 2019-04-24 Xiucai Ding

The Singular Value Decomposition is a matrix decomposition technique widely used in the analysis of multivariate data, such as complex space-time images obtained in both physical and biological systems. In this paper, we examine the…

Statistical Mechanics · Physics 2009-09-25 A. M. Sengupta , P. P. Mitra

We develop a data-driven regularization method for the severely ill-posed problem of photoacoustic image reconstruction from limited view data. Our approach is based on the regularizing networks that have been recently introduced and…

Numerical Analysis · Mathematics 2024-12-20 Johannes Schwab , Stephan Antholzer , Robert Nuster , Günther Paltauf , Markus Haltmeier

The low-complexity assumption in linear systems can often be expressed as rank deficiency in data matrices with generalized Hankel structure. This makes it possible to denoise the data by estimating the underlying structured low-rank…

Systems and Control · Electrical Eng. & Systems 2021-11-10 Mingzhou Yin , Roy S. Smith

Matrix learning is at the core of many machine learning problems. A number of real-world applications such as collaborative filtering and text mining can be formulated as a low-rank matrix completion problem, which recovers incomplete…

Machine Learning · Computer Science 2021-02-23 Yaqing Wang , Quanming Yao , James T. Kwok

Single image super-resolution traditionally assumes spatially-invariant degradation models, yet real-world imaging systems exhibit complex distance-dependent effects including atmospheric scattering, depth-of-field variations, and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Tianhao Guo , Bingjie Lu , Feng Wang , Zhengyang Lu

Many statistical $M$-estimators are based on convex optimization problems formed by the combination of a data-dependent loss function with a norm-based regularizer. We analyze the convergence rates of projected gradient and composite…

Machine Learning · Statistics 2012-07-26 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

We propose a stochastic gradient descent approach with partitioned-truncated singular value decomposition for large-scale inverse problems of magnetic modulus data. Motivated by a uniqueness theorem in gravity inverse problem and realizing…

Numerical Analysis · Mathematics 2022-06-01 Wenbin Li , Kangzhi Wang , Tingting Fan
‹ Prev 1 2 3 10 Next ›