English
Related papers

Related papers: $O(k)$-Equivariant Dimensionality Reduction on Sti…

200 papers

Dimensionality reduction is a fundamental task that aims to simplify complex data by reducing its feature dimensionality while preserving essential patterns, with core applications in data analysis and visualisation. To preserve the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Thomas Dagès , Simon Weber , Ya-Wei Eileen Lin , Ronen Talmon , Daniel Cremers , Michael Lindenbaum , Alfred M. Bruckstein , Ron Kimmel

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

Machine Learning · Computer Science 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach

Data-driven approximations of the infinite-dimensional Koopman operator rely on finite-dimensional projections, where the predictive accuracy of the resulting models hinges heavily on the invariance of the chosen subspace. Subspace pruning…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Dhruv Shah , Jorge Cortes

Let $P$ be a set of $n$ points in $\Re^2$. For a parameter $\varepsilon\in (0,1)$, a subset $C\subseteq P$ is an \emph{$\varepsilon$-kernel} of $P$ if the projection of the convex hull of $C$ approximates that of $P$ within…

Computational Geometry · Computer Science 2023-03-15 Pankaj K. Agarwal , Sariel Har-Peled

In this paper, we propose a general procedure for establishing the geometric landscape connections of a Riemannian optimization problem under the embedded and quotient geometries. By applying the general procedure to the fixed-rank positive…

Optimization and Control · Mathematics 2023-04-12 Yuetian Luo , Xudong Li , Anru R. Zhang

We propose a new method for simplifying semidefinite programs (SDP) inspired by symmetry reduction. Specifically, we show if an orthogonal projection map satisfies certain invariance conditions, restricting to its range yields an equivalent…

Optimization and Control · Mathematics 2023-03-09 Frank Permenter , Pablo A. Parrilo

This work puts forth low-complexity Riemannian subspace descent algorithms for the minimization of functions over the symmetric positive definite (SPD) manifold. Different from the existing Riemannian gradient descent variants, the proposed…

Machine Learning · Statistics 2023-12-19 Yogesh Darmwal , Ketan Rajawat

The success of algorithms in the analysis of high-dimensional data is often attributed to the manifold hypothesis, which supposes that this data lie on or near a manifold of much lower dimension. It is often useful to determine or estimate…

Machine Learning · Statistics 2024-09-10 Anna C. Gilbert , Kevin O'Neill

Product quantization-based approaches are effective to encode high-dimensional data points for approximate nearest neighbor search. The space is decomposed into a Cartesian product of low-dimensional subspaces, each of which generates a sub…

Computer Vision and Pattern Recognition · Computer Science 2014-05-19 Jianfeng Wang , Jingdong Wang , Jingkuan Song , Xin-Shun Xu , Heng Tao Shen , Shipeng Li

Hyperspectral optical imaging provides rich spectral information for estimating continuous environmental and material parameters; however, its high dimensionality and strong feature correlation pose significant challenges for machine…

Optics · Physics 2025-12-18 Parisa Parand , Mahmoud Samadpour

Riemannian optimization has drawn a lot of attention due to its wide applications in practice. Riemannian stochastic first-order algorithms have been studied in the literature to solve large-scale machine learning problems over Riemannian…

Optimization and Control · Mathematics 2022-03-22 Bokun Wang , Shiqian Ma , Lingzhou Xue

We study a variant of the median problem for a collection of point sets in high dimensions. This generalizes the geometric median as well as the (probabilistic) smallest enclosing ball (pSEB) problems. Our main objective and motivation is…

Computational Geometry · Computer Science 2019-03-04 Amer Krivošija , Alexander Munteanu

Recently, Musco and Woodruff (FOCS, 2017) showed that given an $n \times n$ positive semidefinite (PSD) matrix $A$, it is possible to compute a $(1+\epsilon)$-approximate relative-error low-rank approximation to $A$ by querying…

Data Structures and Algorithms · Computer Science 2021-06-16 Ainesh Bakshi , Nadiia Chepurko , David P. Woodruff

Geographic experiments are a widely-used methodology for measuring incremental return on ad spend (iROAS) at scale, yet their design presents significant challenges. The unit count is small, heterogeneity is large, and the optimal Supergeo…

Applications · Statistics 2025-12-01 Charles Shaw

We consider the task of fitting low-dimensional embeddings to high-dimensional data. In particular, we study the $k$-Euclidean Metric Violation problem ($\textsf{$k$-EMV}$), where the input is $D \in \mathbb{R}^{\binom{n}{2}}_{\geq 0}$ and…

Data Structures and Algorithms · Computer Science 2025-09-12 Prashanti Anderson , Ainesh Bakshi , Samuel B. Hopkins

We study adaptive data-dependent dimensionality reduction in the context of supervised learning in general metric spaces. Our main statistical contribution is a generalization bound for Lipschitz functions in metric spaces that are…

Machine Learning · Computer Science 2015-03-26 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

A path from s to t on a polyhedral terrain is descending if the height of a point p never increases while we move p along the path from s to t. No efficient algorithm is known to find a shortest descending path (SDP) from s to t in a…

Computational Geometry · Computer Science 2007-05-23 Mustaq Ahmed , Anna Lubiw

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

Dimensionality-reduction techniques are a fundamental tool for extracting useful information from high-dimensional data sets. Because secant sets encode manifold geometry, they are a useful tool for designing meaningful data-reduction…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Henry Kvinge , Elin Farnell , Michael Kirby , Chris Peterson

Considering orthogonal Stiefel manifolds as constraint manifolds, we give an explicit description of a set of local coordinates that also generate a basis for the tangent space in any point of the orthogonal Stiefel manifolds. We show how…

Optimization and Control · Mathematics 2018-08-28 Petre Birtea , Ioan Casu , Dan Comanescu