English
Related papers

Related papers: Large distortion dimension reduction using random …

200 papers

Let $\mathcal{M}$ be a smooth manifold of positive dimension $n$ equipped with a smooth density $d\mu_{\mathcal{M}}$. Let $A$ be a polyhomogeneous elliptic pseudo-differential operator of positive order $m$ on $\mathcal{M}$ which is…

Spectral Theory · Mathematics 2018-06-21 Alejandro Rivera

Let K be an arbitrary (commutative) field with at least three elements, and let n, p and r be positive integers with r<=min(n,p). In a recent work, we have proved that an affine subspace of M_{n,p}(K) containing only matrices of rank…

Rings and Algebras · Mathematics 2012-05-10 Clément de Seguins Pazzis

We consider high dimensional $M$-estimation in settings where the response $Y$ is possibly missing at random and the covariates $\mathbf{X} \in \mathbb{R}^p$ can be high dimensional compared to the sample size $n$. The parameter of interest…

Methodology · Statistics 2019-11-27 Abhishek Chakrabortty , Jiarui Lu , T. Tony Cai , Hongzhe Li

We study the low rank regression problem $\my = M\mx + \epsilon$, where $\mx$ and $\my$ are $d_1$ and $d_2$ dimensional vectors respectively. We consider the extreme high-dimensional setting where the number of observations $n$ is less than…

Data Structures and Algorithms · Computer Science 2020-10-27 Qiong Wu , Felix Ming Fai Wong , Zhenming Liu , Yanhua Li , Varun Kanade

We study the following natural question on random sets of points in $\mathbb{F}_2^m$: Given a random set of $k$ points $Z=\{z_1, z_2, \dots, z_k\} \subseteq \mathbb{F}_2^m$, what is the dimension of the space of degree at most $r$…

Information Theory · Computer Science 2022-11-24 Siddharth Bhandari , Prahladh Harsha , Ramprasad Saptharishi , Srikanth Srinivasan

We derive a general large deviation principle for a canonical sequence of probability measures, having its origins in random matrix theory, on unbounded sets $K$ of ${\bf C}$ with weakly admissible external fields $Q$ and very general…

Probability · Mathematics 2019-04-29 T. Bloom , N. Levenberg , F. Wielonsky

Given a cloud of $n$ data points in $\mathbb{R}^d$, consider all projections onto $m$-dimensional subspaces of $\mathbb{R}^d$ and, for each such projection, the empirical distribution of the projected points. What does this collection of…

Machine Learning · Statistics 2025-05-06 Andrea Montanari , Kangjie Zhou

We tackle the problem of high-dimensional nonparametric density estimation by taking the class of log-concave densities on $\mathbb{R}^p$ and incorporating within it symmetry assumptions, which facilitate scalable estimation algorithms and…

Statistics Theory · Mathematics 2019-03-15 Min Xu , Richard J. Samworth

We consider $N\times N$ random matrices of the form $H = W + V$ where $W$ is a real symmetric Wigner matrix and $V$ a random or deterministic, real, diagonal matrix whose entries are independent of $W$. We assume subexponential decay for…

Probability · Mathematics 2015-09-29 Ji Oon Lee , Kevin Schnelli

Reparameterization (RP) and likelihood ratio (LR) gradient estimators are used throughout machine and reinforcement learning; however, they are usually explained as simple mathematical tricks without providing any insight into their nature.…

Machine Learning · Computer Science 2019-10-16 Paavo Parmas , Masashi Sugiyama

Let ${\pmb M}$, ${\pmb N}$ and ${\pmb K}$ be $d$-dimensional Riemann manifolds. Assume that ${\bf A}:=(A_n)_{n\in{\Bbb N}}$ is a sequence of Lebesgue measurable subsets of ${\pmb M}$ satisfying a necessary density condition and ${\bf…

Classical Analysis and ODEs · Mathematics 2015-09-01 De-Jun Feng , Esa Järvenpää , Maarit Järvenpää , Ville Suomala

Let $n$ and $s$ be fixed integers such that $n\geq 2$ and $1\leq s\leq \frac{n}{2}$. Let $M_n(\mathbb{K})$ be the ring of all $n\times n$ matrices over a field $\mathbb{K}$. If a map $\delta:M_n(\mathbb{K})\rightarrow M_n(\mathbb{K})$…

Rings and Algebras · Mathematics 2019-03-13 Xiaowei Xu , Baochuan Xie , Yanhua Wang , Zhibing Zhao

The statistics and machine learning communities have recently seen a growing interest in classification-based approaches to two-sample testing. The outcome of a classification-based two-sample test remains a rejection decision, which is not…

Statistics Theory · Mathematics 2022-11-15 Loris Michel , Jeffrey Näf , Nicolai Meinshausen

Let $V \subset \mathbb{R}$ be a finite set with $|V| = n $ and suppose we are given each pairwise distance independently with probability $p$. We show that if $p = (1+\epsilon)/n$, for some fixed $\epsilon >0$, then we can reconstruct a…

Combinatorics · Mathematics 2026-02-27 Julien Portier

This article carries out a large dimensional analysis of standard regularized discriminant analysis classifiers designed on the assumption that data arise from a Gaussian mixture model with different means and covariances. The analysis…

Machine Learning · Statistics 2019-06-19 Khalil Elkhalil , Abla Kammoun , Romain Couillet , Tareq Y. Al-Naffouri , Mohamed-Slim Alouini

We consider the problem of recovering an $N$-dimensional sparse vector $\vm{x}$ from its linear transformation $\vm{y}=\vm{D} \vm{x}$ of $M(< N)$ dimension. Minimizing the $l_{1}$-norm of $\vm{x}$ under the constraint $\vm{y} = \vm{D}…

Information Theory · Computer Science 2015-03-20 Yoshiyuki Kabashima , Mikko Vehkapera , Saikat Chatterjee

We introduce LOT Wassmap, a computationally feasible algorithm to uncover low-dimensional structures in the Wasserstein space. The algorithm is motivated by the observation that many datasets are naturally interpreted as probability…

Machine Learning · Computer Science 2023-02-16 Alexander Cloninger , Keaton Hamm , Varun Khurana , Caroline Moosmüller

In this paper, we consider an estimation problem concerning the matrix of correlation coefficients in context of high dimensional data settings. In particular, we revisit some results in Li and Rolsalsky [Li, D. and Rolsalsky, A. (2006).…

Statistics Theory · Mathematics 2017-06-22 Sévérien Nkurunziza , Yueleng Wang

We imagine an experiment on an unknown quantum mechanical system in which the system is prepared in various ways and a range of measurements are performed. For each measurement M and preparation rho the experimenter can determine, given…

Quantum Physics · Physics 2009-01-20 Stephanie Wehner , Matthias Christandl , Andrew C. Doherty

We introduce sparse random projection, an important dimension-reduction tool from machine learning, for the estimation of discrete-choice models with high-dimensional choice sets. Initially, high-dimensional data are compressed into a…

Machine Learning · Statistics 2016-04-21 Khai X. Chiong , Matthew Shum