English
Related papers

Related papers: On Projections to Linear Subspaces

200 papers

Accurate estimation of Intrinsic Dimensionality (ID) is of crucial importance in many data mining and machine learning tasks, including dimensionality reduction, outlier detection, similarity search and subspace clustering. However, since…

The computational complexity of some depths that satisfy the projection property, such as the halfspace depth or the projection depth, is known to be high, especially for data of higher dimensionality. In such scenarios, the exact depth is…

Statistics Theory · Mathematics 2021-05-28 Stanislav Nagy , Rainer Dyckerhoff , Pavlo Mozharovskyi

Quantitative assessment of the uncertainties tainting the results of computer simulations is nowadays a major topic of interest in both industrial and scientific communities. One of the key issues in such studies is to get information about…

Statistics Theory · Mathematics 2023-12-05 Guillaume Damblin , Mathieu Couplet , Bertrand Iooss

An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few…

Methodology · Statistics 2021-09-28 Di Bo , Hoon Hwangbo , Vinit Sharma , Corey Arndt , Stephanie C. TerMaath

The analysis of neural representation has become an integral part of research aiming to better understand the inner workings of neural networks. While there are many different approaches to investigate neural representations, an important…

Machine Learning · Computer Science 2026-04-23 Rickmer Schulte , David Rügamer

Linear dimensionality reduction methods are a cornerstone of analyzing high dimensional data, due to their simple geometric interpretations and typically attractive computational properties. These methods capture many data features of…

Machine Learning · Statistics 2016-03-22 John P. Cunningham , Zoubin Ghahramani

Diversities are an extension of the concept of a metric space which assign a non-negative value to every finite set of points, rather than just pairs. A general theory of diversities has been developed which exhibits many deep analogies to…

Metric Geometry · Mathematics 2026-03-04 David Bryant , Paul Tupper

We introduce and explore a new concept of evasive subspace with respect to a collection of subspaces sharing a common dimension, most notably partial spreads. We show that this concept generalises known notions of subspace scatteredness and…

Combinatorics · Mathematics 2023-10-17 Anina Gruica , Alberto Ravagnani , John Sheekey , Ferdinando Zullo

Dimension reduction is the process of embedding high-dimensional data into a lower dimensional space to facilitate its analysis. In the Euclidean setting, one fundamental technique for dimension reduction is to apply a random linear map to…

Probability · Mathematics 2017-09-19 Samet Oymak , Joel A. Tropp

Distances are pervasive in machine learning. They serve as similarity measures, loss functions, and learning targets; it is said that a good distance measure solves a task. When defining distances, the triangle inequality has proven to be a…

Machine Learning · Computer Science 2020-07-08 Silviu Pitis , Harris Chan , Kiarash Jamali , Jimmy Ba

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

Machine Learning · Computer Science 2023-11-27 Clément Bonet

Motivated by the manifold hypothesis, which states that data with a high extrinsic dimension may yet have a low intrinsic dimension, we develop refined statistical bounds for entropic optimal transport that are sensitive to the intrinsic…

Statistics Theory · Mathematics 2023-08-25 Austin J. Stromme

Pre-trained word embeddings are widely used for transfer learning in natural language processing. The embeddings are continuous and distributed representations of the words that preserve their similarities in compact Euclidean spaces.…

Computation and Language · Computer Science 2020-06-25 Halid Ziya Yerebakan , Parmeet Bhatia , Yoshihisa Shinagawa

The effectiveness of projection methods for solving systems of linear inequalities is investigated. It is shown that they have a computational advantage over some alternatives and that this makes them successful in real-world applications.…

Optimization and Control · Mathematics 2009-12-23 Y. Censor , W. Chen , P. L. Combettes , R. Davidi , G. T. Herman

Random projections are able to perform dimension reduction efficiently for datasets with nonlinear low-dimensional structures. One well-known example is that random matrices embed sparse vectors into a low-dimensional subspace nearly…

Machine Learning · Computer Science 2019-01-11 Jian-Feng Cai , Dong Li , Jiaze Sun , Ke Wang

This paper investigates the theoretical foundations of metric learning, focused on three key questions that are not fully addressed in prior work: 1) we consider learning general low-dimensional (low-rank) metrics as well as sparse metrics;…

Machine Learning · Statistics 2018-02-07 Lalit Jain , Blake Mason , Robert Nowak

Metric embeddings are central to metric theory and its applications. Here we consider embeddings of a different sort: maps from a set to subsets of a metric space so that distances between points are approximated by minimal distances…

Metric Geometry · Mathematics 2025-08-13 David Bryant , Katharina T. Huber , Vincent Moulton , Andreas Spillner

Random projection is often used to project higher-dimensional vectors onto a lower-dimensional space, while approximately preserving their pairwise distances. It has emerged as a powerful tool in various data processing tasks and has…

Machine Learning · Computer Science 2020-06-30 Wenye Li , Shuzhong Zhang

The depinning of an elastic line interacting with a quenched disorder is studied for long range interactions, applicable to crack propagation or wetting. An ultrametric distance is introduced instead of the Euclidean distance, allowing for…

Other Condensed Matter · Physics 2009-11-10 Damien Vandembroucq , Stephane Roux

Nonlinear expectation, including sublinear expectation as its special case, is a new and original framework of probability theory and has potential applications in some scientific fields, especially in finance risk measure and management.…

Statistics Theory · Mathematics 2013-04-15 Lu Lin , Yufeng Shi , Xin Wang , Shuzhen Yang