English
Related papers

Related papers: Using the Johnson-Lindenstrauss lemma in linear an…

200 papers

Minimizing functionals in the space of probability distributions can be done with Wasserstein gradient flows. To solve them numerically, a possible approach is to rely on the Jordan-Kinderlehrer-Otto (JKO) scheme which is analogous to the…

Machine Learning · Computer Science 2022-11-16 Clément Bonet , Nicolas Courty , François Septier , Lucas Drumetz

We design a heuristic method, a genetic algorithm, for the computation of an upper bound of the minimum distance of a linear code over a finite field. By the use of the row reduced echelon form, we obtain a permutation encoding of the…

Information Theory · Computer Science 2018-07-20 José Gómez-Torrecillas , F. J. Lobillo , Gabriel Navarro

Dimensionality reduction techniques map values from a high dimensional space to one with a lower dimension. The result is a space which requires less physical memory and has a faster distance calculation. These techniques are widely used…

Information Retrieval · Computer Science 2024-02-14 Richard Connor , Lucia Vadicamo

We consider box-constrained integer programs with objective $g(Wx) + c^T x$, where $g$ is a "complicated" function with an $m$ dimensional domain. Here we assume we have $n \gg m$ variables and that $W \in \mathbb Z^{m \times n}$ is an…

Data Structures and Algorithms · Computer Science 2023-03-07 Daniel Dadush , Arthur Léonard , Lars Rohwedder , José Verschae

A new method is proposed for variable screening, variable selection and prediction in linear regression problems where the number of predictors can be much larger than the number of observations. The method involves minimizing a penalized…

Statistics Theory · Mathematics 2017-09-14 D. Vasiliu , T. Dey , I. L. Dryden

Since the invention of the famous LLL algorithm, lattice reduction has been an extremely useful tool in computational number theory. By construction, the LLL algorithm deals with lattices living in a vector space endowed with a positive…

Computational Complexity · Computer Science 2025-11-21 Antoine Joux

The Lov\'{a}sz Local Lemma is a very powerful tool in probabilistic combinatorics, that is often used to prove existence of combinatorial objects satisfying certain constraints. Moser and Tardos have shown that the LLL gives more than just…

Combinatorics · Mathematics 2019-09-13 Anton Bernshteyn

The Euclidean distance geometry problem arises in a wide variety of applications, from determining molecular conformations in computational chemistry to localization in sensor networks. When the distance information is incomplete, the…

Information Theory · Computer Science 2018-10-30 Abiy Tasissa , Rongjie Lai

In this paper we show that the computational complexity of the Iterative Thresholding and K-residual-Means (ITKrM) algorithm for dictionary learning can be significantly reduced by using dimensionality-reduction techniques based on the…

Machine Learning · Statistics 2020-02-25 Karin Schnass , Flavio Teixeira

Distance geometry explores the properties of distance spaces that can be exactly represented as the pairwise Euclidean distances between points in $\mathbb{R}^d$ ($d \geq 1$), or equivalently, distance spaces that can be isometrically…

Computational Geometry · Computer Science 2025-03-26 Matthias Bentert , Fedor V. Fomin , Petr A. Golovach , M. S. Ramanujan , Saket Saurabh

Feature hashing and other random projection schemes are commonly used to reduce the dimensionality of feature vectors. The goal is to efficiently project a high-dimensional feature vector living in $\mathbb{R}^n$ into a much…

Machine Learning · Statistics 2020-03-27 Meena Jagadeesan

Randomized dimensionality reduction is a widely-used algorithmic technique for speeding up large-scale Euclidean optimization problems. In this paper, we study dimension reduction for a variety of maximization problems, including…

Data Structures and Algorithms · Computer Science 2025-06-03 Jie Gao , Rajesh Jayaram , Benedikt Kolbe , Shay Sapir , Chris Schwiegelshohn , Sandeep Silwal , Erik Waingarten

We consider the popular $k$-means problem in $d$-dimensional Euclidean space. Recently Friggstad, Rezapour, Salavatipour [FOCS'16] and Cohen-Addad, Klein, Mathieu [FOCS'16] showed that the standard local search algorithm yields a…

Data Structures and Algorithms · Computer Science 2017-08-30 Vincent Cohen-Addad

Jain's iterative rounding theorem is a well-known result in the area of approximation algorithms and, more broadly, in combinatorial optimization. The theorem asserts that LP relaxations of several problems in network design and…

Data Structures and Algorithms · Computer Science 2025-04-18 Miles Simmons , Ishan Bansal , Joe Cheriyan

Several important algorithms for machine learning and data analysis use pairwise distances as input. On Riemannian manifolds these distances may be prohibitively costly to compute, in particular for large datasets. To tackle this problem,…

Differential Geometry · Mathematics 2019-04-29 Philipp Harms , Elodie Maignant , Stefan Schlager

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

Consider an m by N matrix Phi with the Restricted Isometry Property of order k and level delta, that is, the norm of any k-sparse vector in R^N is preserved to within a multiplicative factor of 1 +- delta under application of Phi. We show…

Information Theory · Computer Science 2011-02-14 Felix Krahmer , Rachel Ward

The distance matrix of a dataset $X$ of $n$ points with respect to a distance function $f$ represents all pairwise distances between points in $X$ induced by $f$. Due to their wide applicability, distance matrices and related families of…

Data Structures and Algorithms · Computer Science 2022-10-28 Piotr Indyk , Sandeep Silwal

Dense high dimensional vectors are becoming increasingly vital in fields such as computer vision, machine learning, and large language models (LLMs), serving as standard representations for multimodal data. Now the dimensionality of these…

Machine Learning · Computer Science 2024-10-10 Zhonghan Chen , Ruiyuan Zhang , Xi Zhao , Xiaojun Cheng , Xiaofang Zhou

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

Machine Learning · Computer Science 2023-11-27 Clément Bonet