English
Related papers

Related papers: Extreme value theory for singular subspace estimat…

200 papers

With the rapid growth of graph-structured data in critical domains, unsupervised graph-level anomaly detection (UGAD) has become a pivotal task. UGAD seeks to identify entire graphs that deviate from normal behavioral patterns. However,…

Machine Learning · Computer Science 2025-11-07 Qingfeng Chen , Haojin Zeng , Jingyi Jie , Shichao Zhang , Debo Cheng

We consider the matrix completion problem under a form of row/column weighted entrywise sampling, including the case of uniform entrywise sampling as a special case. We analyze the associated random observation operator, and prove that with…

Information Theory · Computer Science 2011-05-17 Sahand Negahban , Martin J. Wainwright

In this paper, we propose new randomized algorithms for estimating the two-to-infinity and one-to-two norms in a matrix-free setting, using only matrix-vector multiplications. Our methods are based on appropriate modifications of…

Machine Learning · Computer Science 2026-01-21 Askar Tsyganov , Evgeny Frolov , Sergey Samsonov , Maxim Rakhuba

Extreme value theory has constructed asymptotic properties of the sample maximum. This study concerns probability distribution estimation of the sample maximum. The traditional approach is parametric fitting to the limiting distribution --…

Statistics Theory · Mathematics 2024-07-19 Taku Moriyama

Motivated by the need to identify erroneous disparity assignments, various approaches for uncertainty and confidence estimation of dense stereo matching have been presented in recent years. As in many other fields, especially deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Max Mehltretter

This paper proposes a highly accurate algorithm to estimate the signal-to-noise ratio (SNR) for a linear system from a single realization of the received signal. We assume that the linear system has a Gaussian matrix with one sided left…

Information Theory · Computer Science 2017-10-10 Mohamed A. Suliman , Ayed M. Alrashdi , Tarig Ballal , Tareq Y. Al-Naffouri

Test-time reinforcement learning (TTRL) always adapts models at inference time via pseudo-labeling, leaving it vulnerable to spurious optimization signals from label noise. Through an empirical study, we observe that responses with medium…

Machine Learning · Computer Science 2026-04-24 Yongcan Yu , Lingxiao He , Jian Liang , Kuangpu Guo , Meng Wang , Qianlong Xie , Xingxing Wang , Ran He

Detection of the number of signals corrupted by high-dimensional noise is a fundamental problem in signal processing and statistics. This paper focuses on a general setting where the high-dimensional noise has an unknown complicated…

Statistics Theory · Mathematics 2022-05-16 Xiucai Ding , Fan Yang

Analysis of low-degree polynomial algorithms is a powerful, newly-popular method for predicting computational thresholds in hypothesis testing problems. One limitation of current techniques for this analysis is their restriction to…

Statistics Theory · Mathematics 2020-11-10 Dmitriy Kunisky

Deep learning methods for unsupervised registration often rely on objectives that assume a uniform noise level across the spatial domain (e.g. mean-squared error loss), but noise distributions are often heteroscedastic and input-dependent…

Image and Video Processing · Electrical Eng. & Systems 2024-07-19 Xiaoran Zhang , Daniel H. Pak , Shawn S. Ahn , Xiaoxiao Li , Chenyu You , Lawrence H. Staib , Albert J. Sinusas , Alex Wong , James S. Duncan

We investigate unbiased high-dimensional mean estimators in differential privacy. We consider differentially private mechanisms whose expected output equals the mean of the input dataset, for every dataset drawn from a fixed bounded…

Statistics Theory · Mathematics 2023-12-22 Aleksandar Nikolov , Haohua Tang

We propose a novel framework for incorporating unlabeled data into semi-supervised classification problems, where scenarios involving the minimization of either i) adversarially robust or ii) non-robust loss functions have been considered.…

In this paper, we consider the singular values and singular vectors of low rank perturbations of large rectangular random matrices, in the regime the matrix is "long": we allow the number of rows (columns) to grow polynomially in the number…

Probability · Mathematics 2021-10-22 Gérard Ben Arous , Daniel Zhengyu Huang , Jiaoyang Huang

We derive minimax testing errors in a distributed framework where the data is split over multiple machines and their communication to a central machine is limited to $b$ bits. We investigate both the $d$- and infinite-dimensional signal…

Statistics Theory · Mathematics 2022-12-13 Botond Szabó , Lasse Vuursteen , Harry van Zanten

We consider globally invertible and piecewise contracting maps in higher dimensions and we perturb them with a particular kind of noise introduced by Lasota and Mackey. We got random transformations which are given by a stationary process:…

Dynamical Systems · Mathematics 2015-03-19 D. Faranda , J. -M. Freitas , P. Guiraud , S. Vaienti

Using established principles from Statistics and Information Theory, we show that invariance to nuisance factors in a deep neural network is equivalent to information minimality of the learned representation, and that stacking layers and…

Machine Learning · Computer Science 2018-06-29 Alessandro Achille , Stefano Soatto

We establish higher-order nonasymptotic expansions for a difference between probability distributions of sums of i.i.d. random vectors in a Euclidean space. The derived bounds are uniform over two classes of sets: the set of all Euclidean…

Statistics Theory · Mathematics 2022-11-30 Mayya Zhilova

This work presents a study on label noise in medical image segmentation by considering a noise model based on Gaussian field deformations. Such noise is of interest because it yields realistic looking segmentations and because it is…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Marcus Nordström , Henrik Hult , Atsuto Maki

Deep neural networks have been successfully applied to a broad range of problems where overparametrization yields weight matrices which are partially random. A comparison of weight matrix singular vectors to the Porter-Thomas distribution…

Disordered Systems and Neural Networks · Physics 2024-01-22 Max Staats , Matthias Thamm , Bernd Rosenow

We study the problem of denoising when only the noise level is known, not the noise distribution. Independent noise $Z$ corrupts a signal $X$, yielding the observation $Y = X + \sigma Z$ with known $\sigma \in (0,1)$. We propose…

Machine Learning · Statistics 2026-03-30 Tengyuan Liang