English
Related papers

Related papers: Adaptive Robustness of Hypergrid Johnson-Lindenstr…

200 papers

Persistence diagrams are important tools in the field of topological data analysis that describe the presence and magnitude of features in a filtered topological space. However, current approaches for comparing a persistence diagram to a…

Computational Geometry · Computer Science 2021-03-24 Brittany Terese Fasy , Xiaozhou He , Zhihui Liu , Samuel Micka , David L. Millman , Binhai Zhu

The Discrepancy of a hypergraph is the minimum attainable value, over two-colorings of its vertices, of the maximum absolute imbalance of any hyperedge. The Hereditary Discrepancy of a hypergraph, defined as the maximum discrepancy of a…

Data Structures and Algorithms · Computer Science 2014-07-24 Aleksandar Nikolov , Kunal Talwar

We propose a general random subspace framework for unconstrained nonconvex optimization problems that requires a weak probabilistic assumption on the subspace gradient, which we show to be satisfied by various random matrix ensembles, such…

Optimization and Control · Mathematics 2022-11-21 Coralia Cartis , Jaroslav Fowkes , Zhen Shao

The symmetric binary perceptron ($\texttt{SBP}$) exhibits a dramatic statistical-to-computational gap: the densities at which known efficient algorithms find solutions are far below the threshold for the existence of solutions. Furthermore,…

Computational Complexity · Computer Science 2022-03-30 David Gamarnik , Eren C. Kızıldağ , Will Perkins , Changji Xu

This work constructs Jonson-Lindenstrauss embeddings with best accuracy, as measured by variance, mean-squared error and exponential concentration of the length distortion. Lower bounds for any data and embedding dimensions are determined,…

Machine Learning · Computer Science 2021-01-05 Maciej Skorski

For a set $X$ of $N$ points in $\mathbb{R}^D$, the Johnson-Lindenstrauss lemma provides random linear maps that approximately preserve all pairwise distances in $X$ -- up to multiplicative error $(1\pm \epsilon)$ with high probability --…

Probability · Mathematics 2023-07-18 Michael P. Casey

This paper is concerned with inference in threshold regression models when the practitioners do not know whether at the threshold point the true specification has a kink or a jump. We nest previous works that assume either continuity or…

Statistics Theory · Mathematics 2020-01-15 Javier Hidalgo , Jungyoon Lee , Myung Hwan Seo

Jain's iterative rounding theorem is a well-known result in the area of approximation algorithms and, more broadly, in combinatorial optimization. The theorem asserts that LP relaxations of several problems in network design and…

Data Structures and Algorithms · Computer Science 2025-04-18 Miles Simmons , Ishan Bansal , Joe Cheriyan

Feature hashing, also known as {\em the hashing trick}, introduced by Weinberger et al. (2009), is one of the key techniques used in scaling-up machine learning algorithms. Loosely speaking, feature hashing uses a random sparse projection…

Machine Learning · Computer Science 2018-05-23 Casper Benjamin Freksen , Lior Kamma , Kasper Green Larsen

When deploying deep learning models to a device, it is traditionally assumed that available computational resources (compute, memory, and power) remain static. However, real-world computing systems do not always provide stable resource…

Machine Learning · Computer Science 2021-10-11 Elvis Nunez , Maxwell Horton , Anish Prabhu , Anurag Ranjan , Ali Farhadi , Mohammad Rastegari

We show an algorithm that, given an $n$-vertex graph $G$ and a parameter $k$, in time $2^{O(k \log k)} n^{O(1)}$ finds a tree decomposition of $G$ with the following properties: * every adhesion of the tree decomposition is of size at most…

Data Structures and Algorithms · Computer Science 2020-09-29 Marek Cygan , Paweł Komosa , Daniel Lokshtanov , Michał Pilipczuk , Marcin Pilipczuk , Saket Saurabh , Magnus Wahlström

We consider the hashing mechanism for constructing binary embeddings, that involves pseudo-random projections followed by nonlinear (sign function) mappings. The pseudo-random projection is described by a matrix, where not all entries are…

Machine Learning · Computer Science 2016-07-04 Anna Choromanska , Krzysztof Choromanski , Mariusz Bojarski , Tony Jebara , Sanjiv Kumar , Yann LeCun

The Survivable Network Design problem (SNDP) is a well-studied problem, motivated by the design of networks that are robust to faults under the assumption that any subset of edges up to a specific number can fail. We consider non-uniform…

Data Structures and Algorithms · Computer Science 2024-03-26 Chandra Chekuri , Rhea Jain

The problem of optimizing over random structures emerges in many areas of science and engineering, ranging from statistical physics to machine learning and artificial intelligence. For many such structures finding optimal solutions by means…

Computational Complexity · Computer Science 2022-10-12 David Gamarnik

Rigid graph theory is an active area with many open problems, especially regarding embeddings in $\mathbb{R}^d$ or other manifolds, and tight upper bounds on their number for a given number of vertices. Our premise is to relate the number…

Algebraic Geometry · Mathematics 2020-07-06 Evangelos Bartzos , Ioannis Z. Emiris , Josef Schicho

In centralized, distributed, and federated learning with stochastic gradients and $n$ workers, it was recently shown that it is infeasible to find an $\varepsilon$-stationary point faster than $\tilde{\Omega}\left(\min\left\{\frac{d \kappa…

Optimization and Control · Mathematics 2026-05-11 Grigory Begunov , Alexander Tyurin

This is an updated version of a paper which appeared in the proceedings of the 1979 Berlin Colloquium on Global Differential Geometry. This paper contains the original exposition together with some notes by the authors made in 2025 (as…

Differential Geometry · Mathematics 2025-10-30 Thomas E. Cecil , Patrick J. Ryan

In this note, we revisit the edge-degree constrained subgraph (EDCS) introduced by Bernstein and Stein (ICALP'15). An EDCS is a sparse subgraph satisfying simple edge-degree constraints that is guaranteed to include an (almost)…

Data Structures and Algorithms · Computer Science 2021-10-13 Soheil Behnezhad

We present a simplified and unified analysis of the Johnson-Lindenstrauss (JL) lemma, a cornerstone of dimensionality reduction for managing high-dimensional data. Our approach simplifies understanding and unifies various constructions…

Machine Learning · Statistics 2024-07-22 Yingru Li

Robustness is a critical measure of the resilience of large networked systems, such as transportation and communication networks. Most prior works focus on the global robustness of a given graph at large, e.g., by measuring its overall…

Social and Information Networks · Computer Science 2015-01-09 Hau Chan , Shuchu Han , Leman Akoglu