English
Related papers

Related papers: Machinery for Proving Sum-of-Squares Lower Bounds …

200 papers

In this work, we consider the problem of recovery a planted $k$-densest sub-hypergraph on $d$-uniform hypergraphs. This fundamental problem appears in different contexts, e.g., community detection, average-case complexity, and neuroscience…

Machine Learning · Computer Science 2021-01-29 Luca Corinzia , Paolo Penna , Wojciech Szpankowski , Joachim M. Buhmann

Randomized algorithms can be used to speed up the analysis of large datasets. In this paper, we develop a unified methodology for statistical inference via randomized sketching or projections in two of the most fundamental problems in…

Statistics Theory · Mathematics 2024-04-02 Leda Wang , Zhixiang Zhang , Edgar Dobriban

We prove that with high probability over the choice of a random graph $G$ from the Erd\H{o}s-R\'enyi distribution $G(n,1/2)$, a natural $n^{O(\varepsilon^2 \log n)}$-time, degree $O(\varepsilon^2 \log n)$ sum-of-squares semidefinite program…

Computational Complexity · Computer Science 2021-05-18 Pravesh K. Kothari , Peter Manohar

We give new algorithms based on the sum-of-squares method for tensor decomposition. Our results improve the best known running times from quasi-polynomial to polynomial for several problems, including decomposing random overcomplete…

Data Structures and Algorithms · Computer Science 2016-10-07 Tengyu Ma , Jonathan Shi , David Steurer

For the past 25 years, one of the most studied algorithms in the field of Nonlinear Approximation Theory has been the Thresholding Greedy Algorithm. In this paper, we propose new summability methods for this algorithm, generating two new…

Functional Analysis · Mathematics 2025-05-02 Miguel Berasategui , Pablo M. Berná , Stephen J. Dilworth , Denka Kutzarova

We study statistical and computational limits of clustering when the means of the centres are sparse and their dimension is possibly much larger than the sample size. Our theoretical analysis focuses on the model $X_i = z_i \theta +…

Statistics Theory · Mathematics 2021-03-23 Matthias Löffler , Alexander S. Wein , Afonso S. Bandeira

Let $P:\{0,1\}^k \to \{0,1\}$ be a nontrivial $k$-ary predicate. Consider a random instance of the constraint satisfaction problem $\mathrm{CSP}(P)$ on $n$ variables with $\Delta n$ constraints, each being $P$ applied to $k$ randomly chosen…

Computational Complexity · Computer Science 2017-01-18 Pravesh K. Kothari , Ryuhei Mori , Ryan O'Donnell , David Witmer

We use the Sum of Squares method to develop new efficient algorithms for learning well-separated mixtures of Gaussians and robust mean estimation, both in high dimensions, that substantially improve upon the statistical guarantees achieved…

Data Structures and Algorithms · Computer Science 2017-11-21 Samuel B. Hopkins , Jerry Li

We study the fine-grained complexity of evaluating Boolean Conjunctive Queries and their generalization to sum-of-product problems over an arbitrary semiring. For these problems, we present a general semiring-oblivious reduction from the…

Databases · Computer Science 2023-05-11 Austen Z. Fan , Paraschos Koutris , Hangdong Zhao

We study $\textit{sparse singular value certificates}$ for random rectangular matrices. If $M$ is an $n \times d$ matrix with independent Gaussian entries, we give a new family of polynomial-time algorithms which can certify upper bounds on…

Data Structures and Algorithms · Computer Science 2024-12-31 Ilias Diakonikolas , Samuel B. Hopkins , Ankit Pensia , Stefan Tiegel

The 3SUM problem is one of the cornerstones of fine-grained complexity. Its study has led to countless lower bounds, but as has been sporadically observed before -- and as we will demonstrate again -- insights on 3SUM can also lead to…

Data Structures and Algorithms · Computer Science 2024-10-29 Nick Fischer , Ce Jin , Yinzhan Xu

Various key problems from theoretical computer science can be expressed as polynomial optimization problems over the boolean hypercube. One particularly successful way to prove complexity bounds for these types of problems are based on sums…

Data Structures and Algorithms · Computer Science 2018-02-28 Mareike Dressler , Adam Kurpisz , Timo de Wolff

Decision trees are important both as interpretable models amenable to high-stakes decision-making, and as building blocks of ensemble methods such as random forests and gradient boosting. Their statistical properties, however, are not well…

Machine Learning · Statistics 2021-10-20 Yan Shuo Tan , Abhineet Agarwal , Bin Yu

We develop a general framework to significantly reduce the degree of sum-of-squares proofs by introducing new variables. To illustrate the power of this framework, we use it to speed up previous algorithms based on sum-of-squares for two…

Data Structures and Algorithms · Computer Science 2021-01-06 David Steurer , Stefan Tiegel

Motivated by applications in robotics and computer vision, we study problems related to spatial reasoning of a 3D environment using sublevel sets of polynomials. These include: tightly containing a cloud of points (e.g., representing an…

Optimization and Control · Mathematics 2017-03-09 Amir Ali Ahmadi , Georgina Hall , Ameesh Makadia , Vikas Sindhwani

One fundamental goal of high-dimensional statistics is to detect or recover planted structure (such as a low-rank matrix) hidden in noisy data. A growing body of work studies low-degree polynomials as a restricted model of computation for…

Statistics Theory · Mathematics 2022-06-22 Tselil Schramm , Alexander S. Wein

Sign-Perturbed Sum (SPS) is a powerful finite-sample system identification algorithm which can construct confidence regions for the true data generating system with exact coverage probabilities, for any finite sample size. SPS was developed…

Machine Learning · Statistics 2024-01-30 Szabolcs Szentpéteri , Balázs Csanád Csáji

We study the computational complexity of two related problems: recovering a planted $q$-coloring in $G(n,1/2)$, and finding efficiently verifiable witnesses of non-$q$-colorability (a.k.a. refutations) in $G(n,1/2)$. Our main results show…

Computational Complexity · Computer Science 2023-03-02 Pravesh K. Kothari , Santosh S. Vempala , Alexander S. Wein , Jeff Xu

Given a real projective curve with homogeneous coordinate ring R and a nonnegative homogeneous element f in R, we bound the degree of a nonzero homogeneous sum-of-squares g in R such that the product fg is again a sum of squares. Better…

Algebraic Geometry · Mathematics 2019-09-13 Grigoriy Blekherman , Gregory G. Smith , Mauricio Velasco

Non-Gaussian Component Analysis (NGCA) is the statistical task of finding a non-Gaussian direction in a high-dimensional dataset. Specifically, given i.i.d.\ samples from a distribution $P^A_{v}$ on $\mathbb{R}^n$ that behaves like a known…

Machine Learning · Computer Science 2024-10-30 Ilias Diakonikolas , Sushrut Karmalkar , Shuo Pang , Aaron Potechin
‹ Prev 1 3 4 5 6 7 10 Next ›