English
Related papers

Related papers: Compressibility Measures for Affinely Singular Ran…

200 papers

Dimensionality reduction is in demand to reduce the complexity of solving large-scale problems with data lying in latent low-dimensional structures in machine learning and computer version. Motivated by such need, in this work we study the…

Information Theory · Computer Science 2018-01-31 Gen Li , Qinghua Liu , Yuantao Gu

We investigate the Brown measures of compressions of $R$-diagonal random variables, extending previous results to include unbounded cases. For random variables with finite variance, we demonstrate that the Brown measures of their…

Probability · Mathematics 2026-04-27 Vladislav Kargin

Circular variables that represent directions or periodic observations arise in many fields, such as biology and environmental sciences. An important issue when dealing with circular data is how to estimate their dispersion robustly,…

Methodology · Statistics 2026-03-03 Houyem Demni , Mia Hubert , Giovanni C. Porzio , Peter J. Rousseeuw

The study of the restricted isometry property (RIP) of corrupted random matrices is particularly important in the field of compressed sensing (CS) with corruptions. If a matrix still satisfies the RIP after that a certain portion of rows…

Probability · Mathematics 2019-03-22 Ran Lu

We prove optimal sampling bounds achieving $(1\pm\varepsilon)$-relative error for a broad class of Lipschitz continuous classification loss functions under various regularization terms. This includes important functions such as logistic and…

Machine Learning · Computer Science 2026-05-25 Meysam Alishahi , Alexander Munteanu , Simon Omlor , Jeff M. Phillips

We present a framework for the theoretical analysis of ensembles of low-complexity empirical risk minimisers trained on independent random compressions of high-dimensional data. First we introduce a general distribution-dependent…

Machine Learning · Computer Science 2021-06-03 Henry W. J. Reeve , Ata Kaban

An important functional of Poisson random measure is the negative binomial process (NBP). We use NBP to introduce a generalized Poisson-Kingman distribution and its corresponding random discrete probability measure. This random discrete…

Statistics Theory · Mathematics 2023-07-04 Sadegh Chegini , Mahmoud Zarepour

In this paper, we aim to generalize the notion of restricted isometry constant (RIC) in compressive sensing (CS) to restricted isometry random variable (RIV). Associated with a deterministic encoder there are two RICs, namely, the left and…

Information Theory · Computer Science 2015-02-20 Oliver James , Heung-No Lee

Motivated by the manifold hypothesis, which states that data with a high extrinsic dimension may yet have a low intrinsic dimension, we develop refined statistical bounds for entropic optimal transport that are sensitive to the intrinsic…

Statistics Theory · Mathematics 2023-08-25 Austin J. Stromme

By means of rather general arguments, based on an approach due to Derrida that makes use of samples of finite size, we analyse the effective diffusivity and drift tensors in certain types of random medium in which the motion of the…

Condensed Matter · Physics 2009-10-28 D S Dean , I T Drummond , R R Horgan

Dimension reduction plays an essential role when decreasing the complexity of solving large-scale problems. The well-known Johnson-Lindenstrauss (JL) Lemma and Restricted Isometry Property (RIP) admit the use of random projection to reduce…

Information Theory · Computer Science 2018-03-14 Gen Li , Yuantao Gu

Since Shannon's foundational work, rate-distortion theory has defined the fundamental limits of lossy compression. Classical results, derived for memoryless and stationary ergodic sources in the asymptotic regime, have shaped both transform…

Information Theory · Computer Science 2026-03-11 Sujata Sinha , Vishwas Rao , Robert Underwood , David Lenz , Sheng Di , Franck Cappello , Lingjia Liu

Let $\{{\bf \mathcal{Z}}_n:n\geq 1\}$ be a sequence of i.i.d. random probability measures. Independently, for each $n\geq 1$, let $(X_{n1},\ldots, X_{nn})$ be a random vector of positive random variables that add up to one. This paper…

Probability · Mathematics 2021-06-24 Shui Feng

Accurate estimation of Intrinsic Dimensionality (ID) is of crucial importance in many data mining and machine learning tasks, including dimensionality reduction, outlier detection, similarity search and subspace clustering. However, since…

High dimensional data can have a surprising property: pairs of data points may be easily separated from each other, or even from arbitrary subsets, with high probability using just simple linear classifiers. However, this is more of a rule…

Machine Learning · Computer Science 2023-11-15 Oliver J. Sutton , Qinghua Zhou , Alexander N. Gorban , Ivan Y. Tyukin

This paper introduces the $f$-sensitivity model, a new sensitivity model that characterizes the violation of unconfoundedness in causal inference. It assumes the selection bias due to unmeasured confounding is bounded "on average"; compared…

Methodology · Statistics 2022-09-07 Ying Jin , Zhimei Ren , Zhengyuan Zhou

We propose a new and generic approach for detecting multiple change-points in dynamic networks with Markov formation, termed random interval distillation (RID). By collecting random intervals with sufficient strength of signals and…

Methodology · Statistics 2024-10-29 Xinyuan Fan , Weichi Wu

Respondent-driven sampling (RDS) is an approach to sampling design and analysis which utilizes the networks of social relationships that connect members of the target population, using chain-referral methods to facilitate sampling. RDS…

Methodology · Statistics 2015-08-19 Yakir Berchenko , Jonathan Rosenblatt , Simon D. W. Frost

The vulnerability of machine learning models to adversarial perturbations has motivated a significant amount of research under the broad umbrella of adversarial machine learning. Sophisticated attacks may cause learning algorithms to learn…

Machine Learning · Computer Science 2021-09-27 Sandamal Weerasinghe , Tansu Alpcan , Sarah M. Erfani , Christopher Leckie , Benjamin I. P. Rubinstein

Metric learning aims at finding a suitable distance metric over the input space, to improve the performance of distance-based learning algorithms. In high-dimensional settings, it can also serve as dimensionality reduction by imposing a…

Machine Learning · Computer Science 2024-04-16 Efstratios Palias , Ata Kabán