English
Related papers

Related papers: Confidence-Optimal Random Embeddings

200 papers

Allen-Zhu, Gelashvili, Micali, and Shavit construct a sparse, sign-consistent Johnson-Lindenstrauss distribution, and prove that this distribution yields an essentially optimal dimension for the correct choice of sparsity. However, their…

Data Structures and Algorithms · Computer Science 2019-10-01 Meena Jagadeesan

Dimension reduction plays an essential role when decreasing the complexity of solving large-scale problems. The well-known Johnson-Lindenstrauss (JL) Lemma and Restricted Isometry Property (RIP) admit the use of random projection to reduce…

Information Theory · Computer Science 2018-03-14 Gen Li , Yuantao Gu

Consider a population of $N$ individuals, each having $d\geq 1$ different traits, and an additive measure, called dispersion, which rewards large pairwise separations between traits. The goal is to select $M\leq N$ individuals such that…

Statistical Mechanics · Physics 2026-05-01 Fabio Deelan Cunden , Noemi Cuppone , Giovanni Gramegna , Pierpaolo Vivo

Many inference problems, such as sequential decision problems like A/B testing, adaptive sampling schemes like bandit selection, are often online in nature. The fundamental problem for online inference is to provide a sequence of confidence…

Statistics Theory · Mathematics 2021-06-07 Arun Kumar Kuchibhotla , Qinqing Zheng

Discrete diffusion has become a leading framework for generative modeling in various applications including language, vision, and biology. Existing convergence theory, however, exhibits fundamental limitations. KL-based analyses diverge…

Machine Learning · Computer Science 2026-05-19 Kelvin Kan , Xingjian Li , Benjamin J. Zhang , Tuhin Sahai , Stanley Osher , Markos A. Katsoulakis

The celebrated Johnson-Lindenstrauss lemma states that for all $\varepsilon \in (0,1)$ and finite sets $X \subseteq \mathbb{R}^N$ with $n>1$ elements, there exists a matrix $\Phi \in \mathbb{R}^{m \times N}$ with…

Metric Geometry · Mathematics 2024-03-08 Rafael Chiclana , Mark A. Iwen , Mark Philip Roach

Wasserstein distributionally robust optimization estimators are obtained as solutions of min-max problems in which the statistician selects a parameter minimizing the worst-case loss among all probability models within a certain distance…

Statistics Theory · Mathematics 2021-03-04 Jose Blanchet , Karthyek Murthy , Nian Si

We develop a simple and unified approach to investigate several aspects of the cluster statistics of random expansive (multi-)sets. In particular, we determine the limiting distribution of the size of the smallest and largest clusters, we…

Probability · Mathematics 2022-08-02 Konstantinos Panagiotou , Leon Ramzews

The notion of maximal-spacing in several dimensions was introduced and studied by Deheuvels (1983) for data uniformly distributed on the unit cube. Later on, Janson (1987) extended the results to data uniformly distributed on any bounded…

Statistics Theory · Mathematics 2016-05-06 Catherine Aaron , Alejandro Cholaquidis , Ricardo Fraiman

We address functional uncertainty quantification for ill-posed inverse problems where it is possible to evaluate a possibly rank-deficient forward model, the observation noise distribution is known, and there are known parameter…

Methodology · Statistics 2025-02-06 Michael Stanley , Pau Batlle , Pratik Patil , Houman Owhadi , Mikael Kuusela

Confidence sets from i.i.d. data are constructed for the extrinsic mean of a probabilty measure P on spheres, real projective spaces, and complex projective spaces, as well as Grassmann manifolds, with the latter three embedded by the…

Statistics Theory · Mathematics 2016-02-15 Thomas Hotz , Florian Kelma

Motivated by the manifold hypothesis, which states that data with a high extrinsic dimension may yet have a low intrinsic dimension, we develop refined statistical bounds for entropic optimal transport that are sensitive to the intrinsic…

Statistics Theory · Mathematics 2023-08-25 Austin J. Stromme

Random Projection is a foundational research topic that connects a bunch of machine learning algorithms under a similar mathematical basis. It is used to reduce the dimensionality of the dataset by projecting the data points efficiently to…

Machine Learning · Computer Science 2017-10-10 Mahmoud Nabil

We establish several optimal estimates for exceptional parameters in the projection of fractal measures: (1) For a parametric family of self-similar measures satisfying a transversality condition, the set of parameters leading to a…

Dynamical Systems · Mathematics 2025-10-09 Meng Wu

We present a distribution optimization framework that significantly improves confidence bounds for various risk measures compared to previous methods. Our framework encompasses popular risk measures such as the entropic risk measure,…

Machine Learning · Computer Science 2023-06-13 Hao Liang , Zhi-quan Luo

This paper is an attempt to set a justification for making use of some dicrepancy indexes, starting from the classical Maximum Likelihood definition, and adapting the corresponding basic principle of inference to situations where…

Statistics Theory · Mathematics 2021-02-24 Michel Broniatowski

Johnson-Lindenstrauss guarantees certain topological structure is preserved under random projections when project high dimensional deterministic vectors to low dimensional vectors. In this work, we try to understand how random matrix affect…

Probability · Mathematics 2022-07-26 Juntao Duan , Ionel Popescu , Heinrich Matzinger

Modern time series analysis requires the ability to handle datasets that are inherently high-dimensional; examples include applications in climatology, where measurements from numerous sensors must be taken into account, or inventory…

Computational Geometry · Computer Science 2023-02-15 Ioannis Psarros , Dennis Rohde

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

Machine Learning · Computer Science 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

We study the problem of distributional approximations to high-dimensional non-degenerate $U$-statistics with random kernels of diverging orders. Infinite-order $U$-statistics (IOUS) are a useful tool for constructing simultaneous prediction…

Statistics Theory · Mathematics 2019-12-11 Yanglei Song , Xiaohui Chen , Kengo Kato