English
Related papers

Related papers: Lower Bounds for Sparse Oblivious Subspace Embeddi…

200 papers

The Sum-of-Squares (SoS) hierarchy of semidefinite programs is a powerful algorithmic paradigm which captures state-of-the-art algorithmic guarantees for a wide array of problems. In the average case setting, SoS lower bounds provide strong…

Computational Complexity · Computer Science 2021-11-18 Chris Jones , Aaron Potechin , Goutham Rajendran , Madhur Tulsiani , Jeff Xu

The sparse regression problem, also known as best subset selection problem, can be cast as follows: Given a set $S$ of $n$ points in $\mathbb{R}^d$, a point $y\in \mathbb{R}^d$, and an integer $2 \leq k \leq d$, find an affine combination…

Data Structures and Algorithms · Computer Science 2020-01-01 Jean Cardinal , Aurélien Ooms

In stochastic convex optimization problems, most existing adaptive methods rely on prior knowledge about the diameter bound $D$ when the smoothness or the Lipschitz constant is unknown. This often significantly affects performance as only a…

Optimization and Control · Mathematics 2025-10-08 Clément Lezane , Alexandre d'Aspremont

Let $X$ be a set of $n$ points of norm at most $1$ in the Euclidean space $R^k$, and suppose $\varepsilon>0$. An $\varepsilon$-distance sketch for $X$ is a data structure that, given any two points of $X$ enables one to recover the square…

Metric Geometry · Mathematics 2017-04-04 Noga Alon , Bo'az Klartag

The field of compressed sensing has become a major tool in high-dimensional analysis, with the realization that vectors can be recovered from relatively very few linear measurements as long as the vectors lie in a low-dimensional structure,…

Information Theory · Computer Science 2020-04-30 Pete Casazza , Xuemei Chen , Richard Lynch

Given a database, a common problem is to find the pairs or $k$-tuples of items that frequently co-occur. One specific problem is to create a small space "sketch" of the data that records which $k$-tuples appear in more than an $\epsilon$…

Data Structures and Algorithms · Computer Science 2014-10-13 Eric Price

Good approximations have been attained for the sparsest cut problem by rounding solutions to convex relaxations via low-distortion metric embeddings. Recently, Bryant and Tupper showed that this approach extends to the hypergraph setting by…

Data Structures and Algorithms · Computer Science 2023-03-09 Adam D. Jozefiak , F. Bruce Shepherd

Let $d$ and $k$ be integers with $1 \leq k \leq d-1$. Let $\Lambda$ be a $d$-dimensional lattice and let $K$ be a $d$-dimensional compact convex body symmetric about the origin. We provide estimates for the minimum number of $k$-dimensional…

Combinatorics · Mathematics 2018-01-04 Martin Balko , Josef Cibulka , Pavel Valtr

Let X be a data matrix of rank \rho, whose rows represent n points in d-dimensional space. The linear support vector machine constructs a hyperplane separator that maximizes the 1-norm soft margin. We develop a new oblivious dimension…

Machine Learning · Computer Science 2014-04-18 Saurabh Paul , Christos Boutsidis , Malik Magdon-Ismail , Petros Drineas

We present the Object-Based Sub-Environment Recognition (OBSER) framework, a novel Bayesian framework that infers three fundamental relationships between sub-environments and their constituent objects. In the OBSER framework, metric and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Won-Seok Choi , Dong-Sig Han , Suhyung Choi , Hyeonseo Yang , Byoung-Tak Zhang

The densest subgraph problem, introduced in the 80s by Picard and Queyranne as well as Goldberg, is a classic problem in combinatorial optimization with a wide range of applications. The lowest outdegree orientation problem is known to be…

Data Structures and Algorithms · Computer Science 2022-09-13 Hsin-Hao Su , Hoa T. Vu

A range counting problem is specified by a set $P$ of size $|P| = n$ of points in $\mathbb{R}^d$, an integer weight $x_p$ associated to each point $p \in P$, and a range space ${\cal R} \subseteq 2^{P}$. Given a query range $R \in {\cal…

Data Structures and Algorithms · Computer Science 2012-03-27 S. Muthukrishnan , Aleksandar Nikolov

In this paper, we address learning problems for high dimensional data. Previously, oblivious random projection based approaches that project high dimensional features onto a random subspace have been used in practice for tackling…

Machine Learning · Computer Science 2016-12-07 Yi Xu , Haiqin Yang , Lijun Zhang , Tianbao Yang

Constructing a sparse spanning subgraph is a fundamental primitive in graph theory. In this paper, we study this problem in the Centralized Local model, where the goal is to decide whether an edge is part of the spanning subgraph by…

Data Structures and Algorithms · Computer Science 2017-07-20 Christoph Lenzen , Reut Levi

We consider several related problems of estimating the 'sparsity' or number of nonzero elements $d$ in a length $n$ vector $\mathbf{x}$ by observing only $\mathbf{b} = M \odot \mathbf{x}$, where $M$ is a predesigned test matrix independent…

Information Theory · Computer Science 2017-07-24 Abhishek Agarwal , Larkin Flodin , Arya Mazumdar

We study how well one can recover sparse principal components of a data matrix using a sketch formed from a few of its elements. We show that for a wide class of optimization problems, if the sketch is close (in the spectral norm) to the…

Machine Learning · Computer Science 2015-03-16 Abhisek Kundu , Petros Drineas , Malik Magdon-Ismail

The estimation of a sparse vector in the linear model is a fundamental problem in signal processing, statistics, and compressive sensing. This paper establishes a lower bound on the mean-squared error, which holds regardless of the…

Information Theory · Computer Science 2013-03-04 Emmanuel J. Candès , Mark A. Davenport

Recently (Elkin, Filtser, Neiman 2017) introduced the concept of a {\it terminal embedding} from one metric space $(X,d_X)$ to another $(Y,d_Y)$ with a set of designated terminals $T\subset X$. Such an embedding $f$ is said to have…

Data Structures and Algorithms · Computer Science 2024-08-07 Yeshwanth Cherapanamjeri , Jelani Nelson

Occlusion boundaries (OBs) geometrically localize occlusion events in 2D images and provide critical cues for scene understanding. In this paper, we present the first systematic study of Interactive Occlusion Boundary Estimation (IOBE),…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Lintao Xu , Chaohui Wang

Evaluating the statistical dimension is a common tool to determine the asymptotic phase transition in compressed sensing problems with Gaussian ensemble. Unfortunately, the exact evaluation of the statistical dimension is very difficult and…

Information Theory · Computer Science 2019-06-06 Sajad Daei , Farzan Haddadi , Arash Amini , Martin Lotz