English
Related papers

Related papers: Robust Rank Estimation for Noisy Matrices

200 papers

Most of the regularization methods such as the LASSO have one (or more) regularization parameter(s), and to select the value of the regularization parameter is essentially equal to select a model. Thus, to obtain a model suitable for the…

Methodology · Statistics 2025-11-07 Sumito Kurata , Kei Hirose

With the rapid growth of information, recommender systems have become integral for providing personalized suggestions and overcoming information overload. However, their practical deployment often encounters ``dirty'' data, where noise or…

Information Retrieval · Computer Science 2025-04-02 Kaike Zhang , Qi Cao , Fei Sun , Yunfan Wu , Shuchang Tao , Huawei Shen , Xueqi Cheng

With the introduction of machine learning in high-stakes decision making, ensuring algorithmic fairness has become an increasingly important problem to solve. In response to this, many mathematical definitions of fairness have been…

Machine Learning · Computer Science 2024-06-04 Edward Small , Wei Shao , Zeliang Zhang , Peihan Liu , Jeffrey Chan , Kacper Sokol , Flora Salim

We analyze the Accelerated Noisy Power Method, an algorithm for Principal Component Analysis in the setting where only inexact matrix-vector products are available, which can arise for instance in decentralized PCA. While previous works…

Machine Learning · Statistics 2026-02-04 Pierre Aguié , Mathieu Even , Laurent Massoulié

The ability to learn disentangled representations that split underlying sources of variation in high dimensional, unstructured data is important for data efficient and robust use of neural networks. While various approaches aiming towards…

Machine Learning · Statistics 2019-05-15 Raphael Suter , Đorđe Miladinović , Bernhard Schölkopf , Stefan Bauer

Estimating the rank of a corrupted data matrix is an important task in data analysis, most notably for choosing the number of components in PCA. Significant progress on this task was achieved using random matrix theory by characterizing the…

Statistics Theory · Mathematics 2023-07-12 Boris Landa , Thomas T. C. K. Zhang , Yuval Kluger

Accelerating magnetic resonance imaging (MRI) remains challenging, particularly under realistic acquisition noise. While diffusion models have recently shown promise for reconstructing undersampled MRI data, many approaches lack an explicit…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Nikola Janjušević , Amirhossein Khalilian-Gourtani , Yao Wang , Li Feng

There has been a recent surge of interest in studying permutation-based models for ranking from pairwise comparison data. Despite being structurally richer and more robust than parametric ranking models, permutation-based models are less…

Machine Learning · Statistics 2017-10-31 Cheng Mao , Jonathan Weed , Philippe Rigollet

Robustness estimation is critical for the design and maintenance of resilient networks, one of the global challenges of the 21st century. Existing studies exploit network metrics to generate attack strategies, which simulate intentional…

Social and Information Networks · Computer Science 2016-08-16 Sebastian Wandelt , Xiaoqian Sun

Noisy PN learning is the problem of binary classification when training examples may be mislabeled (flipped) uniformly with noise rate rho1 for positive examples and rho0 for negative examples. We propose Rank Pruning (RP) to solve noisy PN…

Machine Learning · Statistics 2017-08-11 Curtis G. Northcutt , Tailin Wu , Isaac L. Chuang

As the issue of robustness in AI systems becomes vital, statistical learning techniques that are reliable even in presence of partly contaminated data have to be developed. Preference data, in the form of (complete) rankings in the simplest…

Machine Learning · Computer Science 2023-03-24 Morgane Goibert , Clément Calauzènes , Ekhine Irurozki , Stéphan Clémençon

The real-world data is often susceptible to label noise, which might constrict the effectiveness of the existing state of the art algorithms for ordinal regression. Existing works on ordinal regression do not take label noise into account.…

Machine Learning · Computer Science 2020-01-28 Bhanu Garg , Naresh Manwani

We introduce spiky rank, a new matrix parameter that enhances blocky rank by combining the combinatorial structure of the latter with linear-algebraic flexibility. A spiky matrix is block-structured with diagonal blocks that are arbitrary…

Computational Complexity · Computer Science 2026-03-02 Lianna Hambardzumyan , Konstantin Myasnikov , Artur Riazanov , Morgan Shirley , Adi Shraibman

We consider the statistical inference for noisy incomplete binary (or 1-bit) matrix. Despite the importance of uncertainty quantification to matrix completion, most of the categorical matrix completion literature focuses on point estimation…

Statistics Theory · Mathematics 2023-01-20 Yunxiao Chen , Chengcheng Li , Jing Ouyang , Gongjun Xu

Deep neural networks (DNNs) are powerful tools in computer vision tasks. However, in many realistic scenarios label noise is prevalent in the training images, and overfitting to these noisy labels can significantly harm the generalization…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Jan M. Köhler , Maximilian Autenrieth , William H. Beluch

Noisy labels damage the performance of deep networks. For robust learning, a prominent two-stage pipeline alternates between eliminating possible incorrect labels and semi-supervised training. However, discarding part of noisy labels could…

Machine Learning · Computer Science 2023-01-09 Mingcai Chen , Hao Cheng , Yuntao Du , Ming Xu , Wenyu Jiang , Chongjun Wang

This paper studies low-rank matrix completion in the presence of heavy-tailed and possibly asymmetric noise, where we aim to estimate an underlying low-rank matrix given a set of highly incomplete noisy entries. Though the matrix completion…

Statistics Theory · Mathematics 2022-06-10 Bingyan Wang , Jianqing Fan

Reliable and robust evaluation methods are a necessary first step towards developing machine learning models that are themselves robust and reliable. Unfortunately, current evaluation protocols typically used to assess classifiers fail to…

Machine Learning · Computer Science 2025-05-26 Michael W. Spratling

Low-rank matrix completion is a widely studied problem with many variants. Inductive matrix completion (IMC) incorporates row and column side information to significantly narrow the search space. Prior work falls into two regimes: methods…

Machine Learning · Statistics 2026-05-19 Yuepeng Yang , Cong Ma

Robustness of deep neural networks to input noise remains a critical challenge, as naive noise injection often degrades accuracy on clean (uncorrupted) data. We propose a novel training framework that addresses this trade-off through two…

Machine Learning · Statistics 2026-01-06 Hai-Vy Nguyen , Fabrice Gamboa , Sixin Zhang , Reda Chhaibi , Serge Gratton , Thierry Giaccone