English
Related papers

Related papers: Dimension reduction techniques for $\ell_p$, $1 \l…

200 papers

For any $n>1$ and $0<\varepsilon<1/2$, we show the existence of an $n^{O(1)}$-point subset $X$ of $\mathbb{R}^n$ such that any linear map from $(X,\ell_2)$ to $\ell_2^m$ with distortion at most $1+\varepsilon$ must have $m = \Omega(\min\{n,…

Information Theory · Computer Science 2014-11-11 Kasper Green Larsen , Jelani Nelson

Unsupervised learning aims to capture the underlying structure of potentially large and high-dimensional datasets. Traditionally, this involves using dimensionality reduction (DR) methods to project data onto lower-dimensional spaces or…

Machine Learning · Computer Science 2025-06-30 Hugues Van Assel , Cédric Vincent-Cuaz , Nicolas Courty , Rémi Flamary , Pascal Frossard , Titouan Vayer

We prove an explicit formula for the law in zero of the solution of a class of elliptic SPDE in $\mathbb{R}^2$. This formula is the simplest instance of dimensional reduction, discovered in the physics literature by Parisi and Sourlas…

Probability · Mathematics 2020-08-04 Sergio Albeverio , Francesco C. De Vecchi , Massimiliano Gubinelli

In this article, we study the relation between Sobolev-type embeddings for Sobolev spaces or Besov spaces or Triebel-Lizorkin spaces defined either on a doubling or on a geodesic metric measure space and lower bound for measure of balls…

Functional Analysis · Mathematics 2018-03-26 Nijjwal Karak

This paper is devoted to dimensional reductions via the norm resolvent convergence. We derive explicit bounds on the resolvent difference as well as spectral asymptotics. The efficiency of our abstract tool is demonstrated by its…

Mathematical Physics · Physics 2018-11-26 David Krejcirik , Nicolas Raymond , Julien Royer , Petr Siegl

In this paper we study the regularity of embeddings of finite--dimensional subsets of Banach spaces into Euclidean spaces. In 1999, Hunt and Kaloshin [Nonlinearity 12 1263-1275] introduced the thickness exponent and proved an embedding…

Functional Analysis · Mathematics 2019-10-07 Alexandros Margaris , James C. Robinson

Dimension is an inherent bottleneck to some modern learning tasks, where optimization methods suffer from the size of the data. In this paper, we study non-isotropic distributions of data and develop tools that aim at reducing these…

Machine Learning · Statistics 2025-02-12 Mathieu Even , Laurent Massoulié

We study the problem of $2$-dimensional orthogonal range counting with additive error. Given a set $P$ of $n$ points drawn from an $n\times n$ grid and an error parameter $\eps$, the goal is to build a data structure, such that for any…

Data Structures and Algorithms · Computer Science 2016-05-24 Zhewei Wei , Ke Yi

The merit of projecting data onto linear subspaces is well known from, e.g., dimension reduction. One key aspect of subspace projections, the maximum preservation of variance (principal component analysis), has been thoroughly researched…

Machine Learning · Computer Science 2022-09-27 Erik Thordsen , Erich Schubert

We devise a new embedding technique, which we call measured descent, based on decomposing a metric space locally, at varying speeds, according to the density of some probability measure. This provides a refined and unified framework for the…

Data Structures and Algorithms · Computer Science 2007-05-23 Robert Krauthgamer , James R. Lee , Manor Mendel , Assaf Naor

Different unsupervised models for dimensionality reduction like PCA, LLE, Shannon's mapping, tSNE, UMAP, etc. work on different principles, hence, they are difficult to compare on the same ground. Although they are usually good for…

Methodology · Statistics 2024-05-10 Subhrajyoty Roy

We give near-tight lower bounds for the sparsity required in several dimensionality reducing linear maps. First, consider the JL lemma which states that for any set of n vectors in R there is a matrix A in R^{m x d} with m = O(eps^{-2}log…

Data Structures and Algorithms · Computer Science 2012-11-07 Jelani Nelson , Huy L. Nguyen

The challenge of taking many variables into account in optimization problems may be overcome under the hypothesis of low effective dimensionality. Then, the search of solutions can be reduced to the random embedding of a low dimensional…

Optimization and Control · Mathematics 2018-10-23 Mickaël Binois , David Ginsbourger , Olivier Roustant

Dimension reduction (DR) is commonly utilized to capture the intrinsic structure and transform high-dimensional data into low-dimensional space while retaining meaningful properties of the original data. It is used in various applications,…

Machine Learning · Computer Science 2022-11-29 Zelin Zang , Shenghui Cheng , Linyan Lu , Hanchen Xia , Liangyu Li , Yaoting Sun , Yongjie Xu , Lei Shang , Baigui Sun , Stan Z. Li

During the last century, two independent theories using the concept of dimensional reduction have been developed independently. The first, known as F\"oppl-von K\`arm\`an theory, uses Riemannian geometry and continuum mechanics to study the…

General Relativity and Quantum Cosmology · Physics 2022-11-18 Mokhtar Adda-Bedia , Eytan Katzav

We consider the problem of model reduction of parametrized PDEs where the goal is to approximate any function belonging to the set of solutions at a reduced computational cost. For this, the bottom line of most strategies has so far been…

Numerical Analysis · Mathematics 2020-03-02 V. Ehrlacher , D. Lombardi , O. Mula , F. -X. Vialard

The problem of recovering the configuration of points from their partial pairwise distances, referred to as the Euclidean Distance Matrix Completion (EDMC) problem, arises in a broad range of applications, including sensor network…

Optimization and Control · Mathematics 2026-05-07 Chandler Smith , HanQin Cai , Abiy Tasissa

Given a subset K of the unit Euclidean sphere, we estimate the minimal number m = m(K) of hyperplanes that generate a uniform tessellation of K, in the sense that the fraction of the hyperplanes separating any pair x, y in K is nearly…

Probability · Mathematics 2013-09-27 Yaniv Plan , Roman Vershynin

In many data science applications, the objective is to extract appropriately-ordered smooth low-dimensional data patterns from high-dimensional data sets. This is challenging since common sorting algorithms are primarily aiming at finding…

Machine Learning · Computer Science 2024-10-30 Illia Horenko , Lukas Pospisil

In large scale machine learning, random sampling is a popular way to approximate datasets by a small representative subset of examples. In particular, sensitivity sampling is an intensely studied technique which provides provable guarantees…

Data Structures and Algorithms · Computer Science 2024-01-04 David P. Woodruff , Taisuke Yasuda