English
Related papers

Related papers: ScreeNOT: Exact MSE-Optimal Singular Value Thresho…

200 papers

This paper develops a spatially resolved perturbation theory for singular vectors under high-dimensional separable noise and applies it to data-driven matrix recovery. In the asymptotic regime where the matrix dimensions are proportional…

Spectral Theory · Mathematics 2026-03-16 Pei-Chun Su

A greedy algorithm is proposed for sparse-sensor selection in reduced-order sensing that contains correlated noise in measurement. The sensor selection is carried out by maximizing the determinant of the Fisher information matrix in a…

Optimization and Control · Mathematics 2021-04-28 Keigo Yamada , Yuji Saito , Koki Nankai , Taku Nonomura , Keisuke Asai , Daisuke Tsubakino

Denoising by frame thresholding is one of the most basic and efficient methods for recovering a discrete signal or image from data that are corrupted by additive Gaussian white noise. The basic idea is to select a frame of analyzing…

Numerical Analysis · Mathematics 2015-01-21 Markus Haltmeier , Axel Munk

The localized nature of curvelet functions, together with their frequency and dip characteristics, makes the curvelet transform an excellent choice for processing seismic data. In this work, a denoising method is proposed based on a…

Geophysics · Physics 2023-04-14 Naveed Iqbal , Mohamed Deriche , Ghassan AlRegib , Sikandar Khan

The problem of structured matrix estimation has been studied mostly under strong noise dependence assumptions. This paper considers a general framework of noisy low-rank-plus-sparse matrix recovery, where the noise matrix may come from any…

Machine Learning · Statistics 2025-04-07 Jinhang Chai , Jianqing Fan

Efficiently computing a subset of a correlation matrix consisting of values above a specified threshold is important to many practical applications. Real-world problems in genomics, machine learning, finance other applications can produce…

Computation · Statistics 2016-03-15 James Baglama , Michael Kane , Bryan Lewis , Alex Poliakov

We develop new techniques for proving lower bounds on the least singular value of random matrices with limited randomness. The matrices we consider have entries that are given by polynomials of a few underlying base random variables. This…

Data Structures and Algorithms · Computer Science 2025-09-29 Aditya Bhaskara , Eric Evert , Vaidehi Srinivas , Aravindan Vijayaraghavan

We study a seemingly unexpected and relatively less understood overfitting aspect of a fundamental tool in sparse linear modeling - best subset selection, which minimizes the residual sum of squares subject to a constraint on the number of…

Methodology · Statistics 2022-01-11 Rahul Mazumder , Peter Radchenko , Antoine Dedieu

This study evaluates thresholds for removing singular values from singular value decomposition-based low-rank approximations of deep neural network weight matrices. Each weight matrix is modeled as the sum of signal and noise matrices. The…

Machine Learning · Statistics 2026-04-10 Kohei Nishikawa , Koki Shimizu , Hiroki Hashiguchi

We introduce Noise Recycling, a method that substantially enhances decoding performance of orthogonal channels subject to correlated noise without the need for joint encoding or decoding. The method can be used with any combination of…

Information Theory · Computer Science 2020-06-11 Alejandro Cohen , Amit Solomon , Ken R. Duffy , Muriel Médard

Scientific discovery increasingly requires learning on federated datasets, fed by streams from high-resolution instruments, that have extreme class imbalance. Current ML approaches either require impractical data aggregation or fail due to…

Machine Learning · Computer Science 2026-03-16 Md Anwar Hossen , Nathan R. Tallent , Luanzheng Guo , Ali Jannesary

Optimization of sensor selection has been studied to monitor complex and large-scale systems with data-driven linear reduced-order modeling. An algorithm for greedy sensor selection is presented under the assumption of correlated noise in…

Signal Processing · Electrical Eng. & Systems 2022-07-14 Keigo Yamada , Yuji Saito , Taku Nonomura , Keisuke Asai

We introduce a smooth variant of the SCAD thresholding rule for wavelet denoising by replacing its piecewise linear transition with a raised cosine. The resulting shrinkage function is odd, continuous on R, and continuously differentiable…

Computation · Statistics 2026-01-19 Radhika Kulkarni , Aluisio Pinheiro , Brani Vidakovic , Abdourrahmane M. Atto

We propose a patch-based singular value shrinkage method for diffusion magnetic resonance image estimation targeted at low signal to noise ratio and accelerated acquisitions. It operates on the complex data resulting from a sensitivity…

Image and Video Processing · Electrical Eng. & Systems 2019-06-21 Lucilio Cordero-Grande , Daan Christiaens , Jana Hutter , Anthony N. Price , Joseph V. Hajnal

Sparsity promoting norms are frequently used in high dimensional regression. A limitation of such Lasso-type estimators is that the optimal regularization parameter depends on the unknown noise level. Estimators such as the concomitant…

Machine Learning · Statistics 2020-09-04 Quentin Bertrand , Mathurin Massias , Alexandre Gramfort , Joseph Salmon

We propose some new mixed finite element methods for the time dependent stochastic Stokes equations with multiplicative noise, which use the Helmholtz decomposition of the driving multiplicative noise. It is known [16] that the pressure…

Numerical Analysis · Mathematics 2020-06-09 Xiaobing Feng , Andreas Prohl , Liet Vo

Sparse coding refers to the pursuit of the sparsest representation of a signal in a typically overcomplete dictionary. From a Bayesian perspective, sparse coding provides a Maximum a Posteriori (MAP) estimate of the unknown vector under a…

Signal Processing · Electrical Eng. & Systems 2019-09-04 Dror Simon , Jeremias Sulam , Yaniv Romano , Yue M. Lu , Michael Elad

We address the problem of signal denoising via transform-domain shrinkage based on a novel $\textit{risk}$ criterion called the minimum probability of error (MPE), which measures the probability that the estimated parameter lies outside an…

Applications · Statistics 2020-02-19 Jishnu Sadasivan , Subhadip Mukherjee , Chandra Sekhar Seelamantula

We consider distributed recursive estimation of consensus+innovations type in the presence of heavy-tailed sensing and communication noises. We allow that the sensing and communication noises are mutually correlated while independent…

Optimization and Control · Mathematics 2023-11-13 Manojlo Vukovic , Dusan Jakovetic , Dragana Bajovic , Soummya Kar

We consider an approach to fault tolerant quantum computing based on a simple error detecting code operating as the substrate for a conventional surface code. We develop a customised decoder to process the information about the likely…

Quantum Physics · Physics 2019-12-11 Xiaosi Xu , Qi Zhao , Xiao Yuan , Simon C. Benjamin