English
Related papers

Related papers: Almost Optimal Explicit Johnson-Lindenstrauss Tran…

200 papers

We investigate the convergence properties of the EM algorithm when applied to overspecified Gaussian mixture models -- that is, when the number of components in the fitted model exceeds that of the true underlying distribution. Focusing on…

Machine Learning · Statistics 2025-06-16 Zhenisbek Assylbekov , Alan Legg , Artur Pak

In the moldable job scheduling problem one has to assign a set of $n$ jobs to $m$ machines, in order to minimize the time it takes to process all jobs. Each job is moldable, so it can be assigned not only to one but any number of the equal…

Data Structures and Algorithms · Computer Science 2023-03-03 Kilian Grage , Klaus Jansen , Felix Ohnesorge

We study the complexity of optimizing nonsmooth nonconvex Lipschitz functions by producing $(\delta,\epsilon)$-stationary points. Several recent works have presented randomized algorithms that produce such points using $\tilde…

Machine Learning · Computer Science 2025-05-05 Michael I. Jordan , Guy Kornowski , Tianyi Lin , Ohad Shamir , Manolis Zampetakis

For a random set $\mathcal{S} \subset U(d)$ of quantum gates we provide bounds on the probability that $\mathcal{S}$ forms a $\delta$-approximate $t$-design. In particular we have found that for $\mathcal{S}$ drawn from an exact $t$-design…

Quantum Physics · Physics 2023-04-26 Piotr Dulian , Adam Sawicki

It has been shown by Indyk and Sidiropoulos [IS07] that any graph of genus g>0 can be stochastically embedded into a distribution over planar graphs with distortion 2^O(g). This bound was later improved to O(g^2) by Borradaile, Lee and…

Computational Geometry · Computer Science 2010-05-24 Anastasios Sidiropoulos

Principal Components Regression (PCR) is a traditional tool for dimension reduction in linear regression that has been both criticized and defended. One concern about PCR is that obtaining the leading principal components tends to be…

Statistics Theory · Mathematics 2017-10-10 Martin Slawski

For massive data, the family of subsampling algorithms is popular to downsize the data volume and reduce computational burden. Existing studies focus on approximating the ordinary least squares estimate in linear regression, where…

Computation · Statistics 2019-06-27 HaiYing Wang , Rong Zhu , Ping Ma

Explorable heap selection is the problem of selecting the $n$th smallest value in a binary heap. The key values can only be accessed by traversing through the underlying infinite binary tree, and the complexity of the algorithm is measured…

Data Structures and Algorithms · Computer Science 2024-09-12 Sander Borst , Daniel Dadush , Sophie Huiberts , Danish Kashaev

We derive and analyze an infinite-dimensional semidefinite program which computes least distortion embeddings of flat tori $\mathbb{R}^n/L$, where $L$ is an $n$-dimensional lattice, into Hilbert spaces. This enables us to provide a constant…

Optimization and Control · Mathematics 2023-11-22 Arne Heimendahl , Moritz Lücke , Frank Vallentin , Marc Christian Zimmermann

We prove the Johnson-Lindenstrauss property for matrices $\Phi D_\xi$ where $\Phi$ has the restricted isometry property and $D_\xi$ is a diagonal matrix containing the entries of a Kronecker product $\xi = \xi^{(1)} \otimes \dots \otimes…

Data Structures and Algorithms · Computer Science 2021-06-28 Stefan Bamberger , Felix Krahmer , Rachel Ward

To achieve the greatest possible speed, practitioners regularly implement randomized algorithms for low-rank approximation and least-squares regression with structured dimension reduction maps. Despite significant research effort, basic…

Data Structures and Algorithms · Computer Science 2025-09-01 Chris Camaño , Ethan N. Epperly , Raphael A. Meyer , Joel A. Tropp

The Kronecker product is an important matrix operation with a wide range of applications in supporting fast linear transforms, including signal processing, graph theory, quantum computing and deep learning. In this work, we introduce a…

Information Theory · Computer Science 2020-11-25 Ruhui Jin , Tamara G. Kolda , Rachel Ward

We observe that embeddings into random metrics can be fruitfully used to study the $L_1$-embeddability of lamplighter graphs or groups, and more generally lamplighter metric spaces. Once this connection has been established, several new…

Metric Geometry · Mathematics 2020-05-26 Florent P. Baudier , Pavlos Motakis , Thomas Schlumprecht , András Zsák

Many mathematical imaging problems are posed as non-convex optimization problems. When numerically tractable global optimization procedures are not available, one is often interested in testing ex post facto whether or not a locally…

Signal Processing · Electrical Eng. & Systems 2020-07-13 Joel W. LeBlanc , Brian J. Thelen , Alfred O. Hero

Cohen-Addad, Le, Pilipczuk, and Pilipczuk [CLPP23] recently constructed a stochastic embedding with expected $1+\varepsilon$ distortion of $n$-vertex planar graphs (with polynomial aspect ratio) into graphs of treewidth…

Data Structures and Algorithms · Computer Science 2024-11-04 Hsien-Chih Chang , Vincent Cohen-Addad , Jonathan Conroy , Hung Le , Marcin Pilipczuk , Michał Pilipczuk

This paper deals with two related problems, namely distance-preserving binary embeddings and quantization for compressed sensing . First, we propose fast methods to replace points from a subset $\mathcal{X} \subset \mathbb{R}^n$, associated…

Information Theory · Computer Science 2018-07-19 Thang Huynh , Rayan Saab

We introduce sparse random projection, an important dimension-reduction tool from machine learning, for the estimation of discrete-choice models with high-dimensional choice sets. Initially, high-dimensional data are compressed into a…

Machine Learning · Statistics 2016-04-21 Khai X. Chiong , Matthew Shum

Finding the length of the longest increasing subsequence (LIS) is a classic algorithmic problem. Let $n$ denote the size of the array. Simple $O(n\log n)$ algorithms are known for this problem. We develop a polylogarithmic time randomized…

Data Structures and Algorithms · Computer Science 2013-08-06 M. Saks , C. Seshadhri

We study the problem of $2$-dimensional orthogonal range counting with additive error. Given a set $P$ of $n$ points drawn from an $n\times n$ grid and an error parameter $\eps$, the goal is to build a data structure, such that for any…

Data Structures and Algorithms · Computer Science 2016-05-24 Zhewei Wei , Ke Yi

Many streaming algorithms provide only a high-probability relative approximation. These two relaxations, of allowing approximation and randomization, seem necessary -- for many streaming problems, both relaxations must be employed…

Data Structures and Algorithms · Computer Science 2023-05-16 Vladimir Braverman , Robert Krauthgamer , Aditya Krishnan , Shay Sapir