English
Related papers

Related papers: Optimal Shrinkage of Singular Values Under Random …

200 papers

Deep neural networks can memorize corrupted labels, making data quality critical for model performance, yet real-world datasets are frequently compromised by both label noise and input noise. This paper proposes a mutual information-based…

Machine Learning · Computer Science 2025-08-12 Jinghan Yang , Jiayu Weng

We introduce a new model to study algorithm design under unreliable information, and apply this model for the problem of finding the uncorrupted maximum element of a list containing $n$ elements, among which are $k$ corrupted elements.…

Data Structures and Algorithms · Computer Science 2024-09-11 Trung Dang , Zhiyi Huang

Dealing with missing data in data analysis is inevitable. Although powerful imputation methods that address this problem exist, there is still much room for improvement. In this study, we examined single imputation based on deep…

Machine Learning · Computer Science 2020-04-07 Najmeh Abiri , Björn Linse , Patrik Edén , Mattias Ohlsson

This paper introduces a novel algorithm to approximate the matrix with minimum nuclear norm among all matrices obeying a set of convex constraints. This problem may be understood as the convex relaxation of a rank minimization problem, and…

Optimization and Control · Mathematics 2008-10-21 Jian-Feng Cai , Emmanuel J. Candes , Zuowei Shen

We present a simple algorithm for identifying and correcting real-valued noisy labels from a mixture of clean and corrupted sample points using Gaussian process regression. A heteroscedastic noise model is employed, in which additive…

Machine Learning · Computer Science 2021-03-30 Yu-Hang Tang , Yuanran Zhu , Wibe A. de Jong

Sparse estimation methods capable of tolerating outliers have been broadly investigated in the last decade. We contribute to this research considering high-dimensional regression problems contaminated by multiple mean-shift outliers which…

Methodology · Statistics 2025-10-21 Luca Insolia , Ana Kenney , Francesca Chiaromonte , Giovanni Felici

We study $\textit{sparse singular value certificates}$ for random rectangular matrices. If $M$ is an $n \times d$ matrix with independent Gaussian entries, we give a new family of polynomial-time algorithms which can certify upper bounds on…

Data Structures and Algorithms · Computer Science 2024-12-31 Ilias Diakonikolas , Samuel B. Hopkins , Ankit Pensia , Stefan Tiegel

This letter proposes to estimate low-rank matrices by formulating a convex optimization problem with non-convex regularization. We employ parameterized non-convex penalty functions to estimate the non-zero singular values more accurately…

Computer Vision and Pattern Recognition · Computer Science 2016-04-14 Ankit Parekh , Ivan W. Selesnick

Statistically consistent methods based on the noise transition matrix ($T$) offer a theoretically grounded solution to Learning with Noisy Labels (LNL), with guarantees of convergence to the optimal clean-data classifier. In practice,…

Machine Learning · Computer Science 2026-03-16 Chen Feng , Zhuo Zhi , Zhao Huang , Jiawei Ge , Ling Xiao , Nicu Sebe , Georgios Tzimiropoulos , Ioannis Patras

The inability of DNNs to explain their black-box behavior has led to a recent surge of explainability methods. However, there are growing concerns that these explainability methods are not robust and trustworthy. In this work, we perform…

Machine Learning · Computer Science 2023-10-26 Divyansh Srivastava , Tuomas Oikarinen , Tsui-Wei Weng

We consider the problem of noisy matrix completion, in which the goal is to reconstruct a structured matrix whose entries are partially observed in noise. Standard approaches to this underdetermined inverse problem are based on assuming…

Machine Learning · Statistics 2017-09-04 Nihar B. Shah , Sivaraman Balakrishnan , Martin J. Wainwright

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

We consider the problem of recovering an unknown low-rank matrix X with (possibly) non-orthogonal, effectively sparse rank-1 decomposition from measurements y gathered in a linear measurement process A. We propose a variational formulation…

Information Theory · Computer Science 2023-06-13 Johannes Maly

Many applications involve estimation of a signal matrix from a noisy data matrix. In such cases, it has been observed that estimators that shrink or truncate the singular values of the data matrix perform well when the signal matrix has…

Methodology · Statistics 2018-06-20 David Gerard , Peter Hoff

Understanding how the optimal value of an optimisation problem changes when its input data is modified is an old question in mathematical optimisation. This paper investigates the computation of the optimal values of a family of (possibly…

Optimization and Control · Mathematics 2026-03-02 Guillaume Derval , Damien Ernst , Quentin Louveaux , Bardhyl Miftari

The smallest singular value and condition number play important roles in numerical linear algebra and the analysis of algorithms. In numerical analysis with randomness, many previous works make Gaussian assumptions, which are not general…

Probability · Mathematics 2022-11-09 Haoyu Wang

Anomaly detection (AD) tasks have been solved using machine learning algorithms in various domains and applications. The great majority of these algorithms use normal data to train a residual-based model and assign anomaly scores to unseen…

Machine Learning · Computer Science 2024-02-01 Markus Ulmer , Jannik Zgraggen , Lilach Goren Huber

In multimedia understanding tasks, corrupted samples pose a critical challenge, because when fed to machine learning models they lead to performance degradation. In the past, three groups of approaches have been proposed to handle noisy…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Francesco Barbato , Umberto Michieli , Mehmet Kerim Yucel , Pietro Zanuttigh , Mete Ozay

The randomized singular value decomposition (R-SVD) is a popular sketching-based algorithm for efficiently computing the partial SVD of a large matrix. When the matrix is low-rank, the R-SVD produces its partial SVD exactly; but when the…

Information Theory · Computer Science 2023-07-07 Elad Romanov

The robustness to noise and outliers is an important issue in linear representation in real applications. We focus on the problem that samples are grossly corrupted, which is also the 'sample specific' corruptions problem. A reasonable…

Computer Vision and Pattern Recognition · Computer Science 2015-12-14 Wei-Ya Ren